Browse webpages with your eyes via a chrome extension. Read pages without having to scroll manually, as the extension intuitively scrolls as you read up or down a page.
A little side project from May'24 to June'24 using WebGazer, an eye tracking library. I took some inspiration from just a couple others who have attempted this specific project (website navigation using gaze prediction from built-in webcams, specifically with webgazer) and many more who have tried and failed with other gaze prediction libraries.
Managed to work around limitations faced by Rhys Mills in his eyegaze-browser with the help of offscreen DOMs in Manifest V3.
This extension runs WebGazer in an offscreen DOM which then calls on the currently active tab's content script which executes the scrolls on the page. WebGazer does all the heavy lifting with fast and relatively accurate gaze predictions using a pretrained eye tracking model.
The extension UI I designed is simple and easy to use with just one button to enable and disable your webcam and visual prompts for calibration.
Future improvements include side scrolling, blink gestures for back and forwards navigation and switching tabs.
Download this from the chrome extension store. Otherwise:
- Download this repository. Run
npm ito install required packages. - Turn on developer mode in your chrome extensions page.
- Click load unpacked and load this repository.
- Go to any website. If you have a current tab open, refresh it to allow the content script to run.
- Click the extension in your extension toolbar.
- In the popup, you can now enable/disable your webcam.
- One enabled, wait a few seconds. You should see a red/yellow flashing circle for you to look at and allow the program to calibrate your gaze.
- Once done, read up and down the page as you normally would and watch as the page scrolls on its own!