Apple is scheduled to hold a “Let Loose” event on Tuesday, May 7th, where it will announce new iPad Air and iPad Pro models, as well as the new Apple Pencil. However, Worldwide Developers Conference (WWDC) 2024, to be held on June 10th, could be an event to watch as it could change the company's approach to devices, especially the iPhone. The Cupertino-based tech giant is said to announce its artificial intelligence (AI) strategy and introduce new features with iOS 18. Based on a paper published by Apple researchers, we can understand the company's vision behind it.
A report from The Verge takes a deep dive into Apple's recently released research paper, highlighting the company's focus on making Siri, the iPhone's virtual assistant, more efficient and smart. Although that's one big possibility, there are enough clues to suggest that AI capabilities could completely change the way users interact with their iPhones. It's unlikely that all new features will be removed at once, but changes will likely be introduced gradually over the next few years.
Most of the research papers published by Apple focus on small language models (SLMs) that can operate independently within devices. For example, the company published a paper on his AI model called ReALM. This is an abbreviation for Reference Resolution As Language Model. The functionality of this model is described as using the context language to perform and complete tasks as directed. This description suggests that this model could be used to upgrade Siri.
Another similar research paper mentions “Ferret-UI,” a multimodal AI model. This model is “designed to properly interpret and execute free-form language instructions while performing precise referencing and grounding tasks specific to UI screens.” Essentially, it can read the screen and perform actions on any interface, including the home screen and apps. This feature essentially makes using your iPhone more intuitive with finger gestures and verbal commands.
Then there's Keyframer, which claims to be able to generate animations from still images, and another AI model that allows you to edit images using AI. These features greatly improve the Photos app, allowing users to perform complex edits in a few simple steps, similar to what DALL-E and Midjourney offer.
However, please note that these speculations are based on research papers published by Apple, and there is no guarantee that they will be featured. Apple's vision for AI will become clearer after the WWDC 2024 keynote.
