Yelp has begun rolling out artificial intelligence-generated videos across the platform, aimed at enhancing user engagement by creating short, visually engaging content about restaurants, food spots and nightlife businesses. Currently, these AI stitch videos, widely available on Yelp's iOS app, form part of the Tiktok style vertical feed on the app's homepage.
https://www.youtube.com/watch?v=vjrv941qgrc
This initiative marks the latest use of Yelp's Generate AI to curate dynamic content from submeated photos, videos and reviews by users. After a limited testing period that began in 2023, the company has now expanded its functionality to all iOS users in the US.
How to create an AI video
Yelp's AI-generated videos are created through collaborations between several artificial intelligence tools. This process starts with Openai's large-scale language model, analyzing the content, writing descriptive scripts, and selecting the angle of storytelling. These scripts are narrated using ElevenLabs' AI Voice Technology, but Amazon Transcribe generates on-screen captions that match the audio content.
The resulting video will showcase highlights such as food quality, drink offerings, atmosphere, and overall customer experience. Each video combines user-uploaded images and clip selections and sews together to form a seamless visual narrative with narration and captions.
These videos are made from publicly available user content, but individuals are currently unable to opt out of using media in this way. Furthermore, business owners are not given previews or controls on the videos generated for the list. Only videos generated by one AI per business are published at a time, and may be updated over time if new content becomes available.
Content mitigation and personalization
Yelp says that AI Stitch videos will only be produced for businesses that have enough visual and textual material to tell a compelling story. “We want to make as many videos as possible,” Yelp's chief product officer Craig Saldanha said in a recent interview. However, Saldanha revealed that the creation of these videos is heavily dependent on the amount and quality of existing photos, reviews and videos in the business.
The decision to display the video to a particular user is based on personalized engagement signals such as previous activities and preferences. However, the video itself is not customized for each audience. Standardized videos available for each business are always available.
Suppose the video is deemed inaccurate or inappropriate by either the user or the business. In that case, Yelp provides a reporting mechanism that can be accessed through the 3-dot menu in the top right corner of the video interface. According to Saldanha, Yelp also conducts a daily large-scale audit to ensure the accuracy and appropriateness of AI-generated content.
Part of a broader AI strategy
Videos generated for the new AI are part of Yelp's broader efforts to incorporate artificial intelligence into the platform. Recent additions include AI-powered review summaries and intelligent filters that help users navigate massive reviews more effectively.
By leveraging Generated AI, Yelp aims to provide users with a more engaging and visually engaging way for users to explore local businesses, increasing the chances of discovering venues with powerful user-generated content. It appears the company is working to expand these tools as it continues to explore ways to use AI to improve user experience and business visibility.
