AI assistants are capturing more senses. On Monday, OpenAI unveiled a new ChatGPT model that promises to: see, hear, speak Through new features such as smartphones. Now, Google has announced a rival assistant with similar functionality.
At the company's I/O developer conference on Tuesday, DeepMind CEO Demis Hassabis showed off a prototype of Google's new expert AI assistant that can see through users' phones and other objects such as smart glasses. Assistant “Build”[s] It's powered by Gemini, Google's existing chatbot, and the company says some of its functionality will be coming to the Gemini app and web experience later this year.
The development is part of Google DeepMind's Project Astra, which aims to create a “general purpose AI agent” for users' daily lives. “Imagining a future where you have a professional assistant by your side through new and exciting form factors like cell phones and glasses,” Hassabis told thousands of developers gathered in Mountain View, California. It's easy.''
A demo video shows a person walking through an office and talking to an AI agent via a mobile phone. Through the camera, they show the AI assistant a container of crayons and ask it to make a “creative alliteration” as if they were talking on FaceTime.
It said, “Creative crayons color cheerfully.'' “They certainly make colorful pieces.” During the walk, the person realized that he had forgotten his glasses after continuing to interact with the AI bot, and asked for help finding them. “It's on the desk near the red apple,” the bot responds.
When a user puts on these glasses, the AI assistant can also see through them and identify an illustration representing Schrödinger's Cat on a whiteboard.
It's unclear whether these glasses are new products that Google plans to launch. The augmented reality glasses on display in the demo looked nothing like the company's existing smart glasses, Google Glass, nor did they resemble a typical large headset.
“These agents, like the rest of us, must understand and respond to a complex and dynamic world,” Hassabis said at the conference. “To understand context and take action, we must take in what we see and remember it. And it must be active, teachable, and personal. You can have a natural conversation.”
That is Project Astra's goal, he said, and it is making “significant progress.”
On the other hand, Google A prototype of the AI assistant is available for demo to attendees at the Google I/O conference, but it will likely be a while before the technology is available to consumers.
