Google upgrades AI mode using Live with video input, PDF support and canvas features

AI Video & Visuals


Google is adding several new features to its latest AI mode, AI-powered search experience. On Tuesday, Mountain View-based Tech Giant unveiled four new features to increase the ease of use of the tool. The most notable inclusion is the extension of Search Live. This allows users to ask questions from the Google Lens video feed. Apart from this, new canvas mode and PDF file support has also been added to AI mode.

AI Mode gets new features

In a blog post, Tech Giants detailed the new features that will be featured in AI mode. Some of these features will arrive next week, while others may take a little longer to release. Although the company did not specify this, it is expected that these features will be available in the US first. Interestingly, all of these features are already available via Gemini.

Last month, Google introduced AI mode search live. This allows users to have real-time voice conversations before and after with the chatbot, just like Gemini Live. The company is currently adding video support to its features. This feature can be accessed through Google Lens, where Search Live is already integrated.

Users can open the lens in the Google app, tap the live icon and ask AI mode questions about the objects in the frame. Chatbots can analyze the content of your video feed in real time and answer user queries. It will be released this week on Mobile in the US for users registered in the AI Mode Lab experiment.

AI mode allows users to upload images and ask for queries about their content. Next week, the company is also adding PDF support to its desktop. Users can upload files and ask questions about their content, and chatbots can answer user queries and contextualize information from the web.

Google said in the future, AI mode will also support file types other than PDFs and images, including Google Drive files.

Another new feature that appears in AI mode is Canvas. Similar to the versions of tools available in Gemini, you can use this feature to create plans and organize your information. The tool does not have a dedicated button. Instead, when the user asks for a query that fits a canvas use case, the AI mode represents a “Create Canvas” button. Tapping opens a dynamic side panel where the chatbot creates the requested plan.

Once a canvas is created, users can improve it by asking for follow-up queries, highlighting certain parts of the text, or requesting changes. According to Google, users can also quickly customize plans using context from files such as class notes and course syllabus. This feature will reach users registered in the US AI Mode Lab experiments on desktops over the next few weeks.

Finally, Tech Giant also integrates AI modes into Google Chrome via the lens. This feature allows users to ask AI mode about what's on the user's screen. You can access it by clicking on the Chrome address bar and selecting a new option called “About this page Google Ask Ask.”

This opens an AI mode in the side panel on the page, allowing the chatbot to answer any queries that the user may have. Users can also select any element or text on the page to allow them to retrieve the chatbot for the query.



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *