What you need to know
- Google has unveiled a series of experimental features for its Arts & Culture app.
- Users can try “World Toon Video,” which transforms selfies into cartoon style (or puppets) and uses them in generated educational clips about specific topics.
- Alongside Art Chat, Google also announced its “Learn Everything” experiment, which uses photos as metaphors for learning new things.
Learning can seem a bit of a disadvantage, but Google is rolling out AI updates for arts and sciences that could make it exciting, if not outlandish.
Announced this week, Google highlighted an experimental AI update to its Arts & Culture app that lets you integrate yourself or someone you know into educational clips. A highlight of this AI update is the app’s “World Toon Video” experiment. According to the memo, Google says users will be able to take a selfie, which will be incorporated into the narrative in generative AI “educational video clips.”
After taking a selfie, users can swipe through “styles” such as puppets, cartoons, and old cartoons. Then select “Scene”. This is what determines the pedagogical reason for a character to cruise on the moon or meander through a dense jungle. Google’s AI generates characters and settings, then animates them into video clips.
watch on
The second arts and culture experiment is called “Learn Everything.” This feature was designed based on the fact that everyday events in our lives can actually be great teaching moments. Google notes that users can start by simply taking a photo of a common object, such as a coffee mug, a light bulb, or a plant. The AI uses your photo as a “metaphor” for that teaching moment. Then the user can decide on it.
In Google’s example, a user can take a photo of a light bulb and tell the AI that they want to learn about Stellar Evolution at an intermediate level (there are also beginner and advanced levels).
AI instantly generates descriptions fueled by your photos.
The final experiment, already available in the Arts & Culture app, is “Arts Chat.” This is a similar experience to what users who have used AI chatbots will recognize. Google says users will be able to talk to the AI in “real time” about famous artists and their works, and watch “explanatory videos” about art genres. Of course, the backbone of this feature is Gemini, so it leans a little more into that recognizable experience.
never forgotten
Google’s AI seems to have no limits, and we’re hard at work developing features (even experimental ones) for our Arts & Culture app. There was a big update a while back that added new features like Inspire Feed and AI Poetry. Adding to the Inspire feed are apps about artifacts and historical/cultural stories.[探索]It was a tab. Additionally, AI poetry was provided to users by Google’s PaLM 2 model.
The generated ones can also be sent to friends and family.
Also, the app’s new World Toon Video looks like an extension of the Art Selfie that the app already had. Users can take a selfie of themselves and have it transformed into a historical work of art, allowing others to guess where it came from. It’s a little game mixed with educational learning, and after all, it might help you kill at least some time.
