In the vast expanse of technological innovation, the fusion of art and artificial intelligence has produced amazing creations. Microsoft has announced a new artificial intelligence (AI) model that can create highly lifelike movies with talking human faces.
AI makes Mona Lisa sing
Microsoft has removed VASA-1.
This AI can make a single image expressively sing or speak from an audio reference.Similar to Alibaba's EMO
10 wild examples:
1. Mona Lisa rapping paparazzi pic.twitter.com/LSGF3mMVnD
— Minchoi (@minchoi) April 18, 2024
The AI image-to-video model, known as VASA-1, can transform still images of people's faces into vibrant animations. According to the company, the videos produced will feature natural-looking facial expressions and head movements, along with synchronized lip movements to the soundtrack. People were surprised recently when a video showcasing the app's features became popular on social media. In the AI-generated film, the famous Leonardo da Vinci painting 'Mona Lisa' is seen lip-syncing to Anne Hathaway's song 'Paparazzi'.
The video was first published on Microsoft's official website and gained huge popularity on social media due to its charming depiction of Mona Lisa rapping. The video went viral as some people found this humorous movie funny. “I rolled on the floor laughing when I saw the Mona Lisa clip,” one user commented. Another said: “Oh, I wish Leonardo da Vinci could have seen this.''
Concerns about its unethical use, particularly in the creation of deepfakes, were also expressed by several. Microsoft has made it clear that it does not currently intend to make this technology publicly available for online demos, APIs, or other implementations until it is confident that it will be used appropriately and in accordance with legal requirements.
Also read: Instacart removes disturbing AI-generated food images combining hot dogs and strangely textured salmon
What is VASA?
2. Realism and vibrancy – Example 1 pic.twitter.com/Kz0Bm2NRNy
— Minchoi (@minchoi) April 18, 2024
VASA is the foundation for creating virtual characters with engaging visual-affective skills (VAS) and believable conversations. According to Microsoft experts, it not only delivers realistic lip and voice synchronization, but also captures a wide range of emotions, expressive facial expressions, and natural head movements. As AI apps evolve, they move beyond mere imitation and into the realm of artistic innovation. The top model, VASA-1, can reproduce natural head gestures and various subtle facial movements in addition to lip movements in response to sounds.
The wonders of AI-powered image animation offer a glimpse into a future where creativity knows no bounds and imagination knows no bounds. So, what do you think about this new technology?
Cover image credit: X/Choi Min
