AI can have a positive impact. please listen. We saw the proof at Google I/O 2023.
While many of us spend time worrying that artificial intelligence chatbots like ChatGPT will take our jobs or cause World War II, AI-based solutions solves real-world problems and sometimes even helps people bounce back (or better) from recessions. tragedy.
After the Google I/O 2023 keynote wrapped up, announcing an impressive collection of AI-based products and software updates, and a new collection of hardware including the exciting Google Pixel Fold, Pixel Tablet and Pixel 7a, Google AI Advocacy Leaders, Authors, and Others – then-AI artist Lawrence Moloney (opens in new tab) Presented the story at the developer’s keynote speech (opens in new tab) Perhaps more than a few people thought, “I’m not crying.” you I cried,” was the reaction of the audience.
from the ashes
Two years ago, quadriplegic gamestreamer Lance Carr lost everything in a fire. The fire actually happened during his live stream. Carr, who has muscular dystrophy, lost not only his home in Colorado, but all of the assistive devices he used to play video games live on Twitch. Worse, the custom equipment was outdated and almost irreplaceable.
Controlling a PC to play games or stream would be impossible for Kerr, who can’t control any part of his body below the shoulders.
But Google’s Project GameFace changed everything. Instead of buying and modding assistive gaming devices, Google and Carr settled on the novel idea of using his face to control his PC and games.
Moloney says Project GameFace uses off-the-shelf webcams and Google’s MediaPipe. The system combines multiple AI ML models (he didn’t disclose which ones) to build a 468-point live mesh on any surface. These points translate into mouse clicks and movement telemetry. MediaPipe was also previously used to create virtual avatars.
This is all tied to an interface that allows you to map facial expressions and head movements to computer input. This means that Project GameFace is not one-size-fits-all and can be customized to the way you control your actions. The system is so accurate that Carr can use it to write his name in cursive.
As Kerr points out, he’s now controlling the computer with a funny look on his face. In a video about the project, Kerr explained that his muscular dystrophy makes him weaker now than he was when he was six months old. “With muscular dystrophy, this really added.
Google has no plans to produce Project GameFace directly, but we have open sourced all the code and posted it on GitHub. (opens in new tab). The project page warns that “this project is not intended for life-threatening decisions,” but what could be more important than a game? Ask any TRG friend and they’ll say “Nothing!”
Another good news is that while Project GameFace constantly tracks facial movements, it doesn’t store images or data for facial recognition.
So the next time someone tells you that the apparent end goal of all AI is global destruction, stop for a moment and think about Kaa. Or you could mention the car. Where there is utility and purpose, there is potential. In fact, AI has a lot of potential for good as well as harm.
Perhaps we just need to point it in the right direction. perhaps.
