Google opens Project Gameface for hands-free cursor control on Android apps

Google has made a significant move to enhance accessibility on Android devices by releasing the code for Project Gameface, an innovative hands-free gaming ‘mouse’ that lets users control the cursor using facial gestures.

The project, originally announced during last year’s Google I/O for desktop, is now open-source for Android developers, allowing them to integrate this feature into their apps.

With Project Gameface, users can control the cursor by making facial expressions or moving their heads. For instance, opening the mouth moves the cursor, while raising the eyebrows clicks and drags. This functionality relies on the device’s camera and a database of facial expressions from MediaPipe’s Face Landmarks Detection API.

Through the device’s camera, it seamlessly tracks facial expressions and head movements, translating them into intuitive and personalized control,

Google explained in its announcement.

Developers can now build applications where their users can configure their experience by customizing facial expressions, gesture sizes, cursor speed, and more.

Initially designed for gamers, Project Gameface aims to provide a more accessible and affordable alternative to expensive head-tracking systems.