7 I can't wait to wait for the AI feature to come to iOS 26 (and how you can try them)

Applications of AI


iOS 26 Camera

Sabrina Ortiz/Zdnet

The Apple Worldwide Developers' Conference (WWDC) was there a month ago. In other words, iOS 26 Public Beta should be released at any time.

Apple has yet to announce the expected Siri upgrade yet, but the company says it will hear more info next year – at WWDC, Apple has announced a number of AI features across devices and operating systems such as IOS, MacOS, WatchOS, iPados, and more.

Also: Apple's iOS 26 and iPads 26 Public Betas are now available: What to expect

The features aren't the flashiest, but many of them address issues Apple users have had for a long time on their devices and everyday workflows, while others are really enjoyable.

I collected the announced AI features and ranked them according to what I'm most excited about using and how people on the web are buzzing.

1. Visual Intelligence

Apple Visual Intelligence

Sabrina Ortiz/Zdnet

Last year, Apple introduced visual intelligence with the launch of the iPhone 16. At the time, users were able to take photos of surrounding objects and use the iPhone's AI feature to search for them to find more information. Last month, Apple upgraded the experience by adding visual intelligence to its iPhone screen.

To use it, you need to take a screenshot. Visual Intelligence can use Apple Intelligence to help you find out more from screenshots and suggest actions such as adding events to your calendar. You can also use the “Ask Button” to ask ChatGpt for help for a particular image. This is useful for tasks where ChatGpt can provide assistance, such as solving puzzles. You can also tap “Search” to view it online.

Also: The entire iPhone screen can now be searched with a new visual intelligence feature

Google already offered the same functionality in Circle to Search a few years ago, but this is a huge win for Apple users as it was functional and ran well. Rather than trying to build inferior models, we leverage ChatGpt's already capable models.

2. Real-time translation

Generated AI has been a useful application that has emerged since its popularity exploded, real-time translation. LLM has a deep understanding of the language and how people speak, allowing you to translate your speeches using precisely literally as well as additional context. Apple will roll out this powerful feature across its own devices with new real-time translation capabilities.

Also: Apple Intelligence gets more languages – and AI-powered translations

This feature allows you to translate text messages and voice over FaceTime and phone. If you are using it for verbal conversations, simply click the call button. This warns others that live translation is about to take place. After the speaker says something, there is a brief pause and then receives audio feedback in the conversational version of what is said in the language of your choice.

This feature is valuable as it can help people communicate with each other. It's also easy to access as it's burned into the communication platform that people already rely on every day.

3. Appleixin Apple Music

iPhone Automix Features

Sabrina Ortiz/Zdnet

Automix features use AI to add a seamless transition from one song to another, mimicking what DJs do by stretching time and beat matching. In the beta settings app, Apple says, “based on analyzing the keys and tempo of the music, the song moves to the perfect moment.”

Also: How to use the Viral Automix feature on iOS 26 (and iPhone models support it)

It works in conjunction with the Autoplay feature, so if you're playing songs like DJs, you can play another song that matches the vibe while moving seamlessly. Many users have already tried it on developer beta devices and have gone to social media to post very impressive results.

4. Shortcuts using Apple Intelligence

The update to the shortcuts was easy to overlook during the keynote, but it is one of the best use cases for AI. If you're like me, you usually avoid programming shortcuts as they seem too complicated to create. This is where Apple Intelligence can help.

Also: My favorite iPhone productivity feature has undergone a massive upgrade on iOS 26 (and it's not Siri)

The new Intelligent Actions feature allows you to unleash a new, much more advanced feature set with Apple Intelligence Models or Private Cloud Compute within shortcuts. For example, you can set a shortcut to shoot all the files you want to add to the home screen and sort them into files using Apple Intelligence.

According to Apple, the process aims to use Private Cloud Compute using Apple Intelligence models to generate responses that feed into the remaining shortcuts, using dedicated actions and Apple Intelligence models. However, if even this seems too daunting, there is also a gallery feature to try out a few features and get building inspiration.

5. Hold Assist

The Hold Assist feature is a typical example of a feature that is not on the top but can save a lot of time in your daily life. The mechanism is simple. If it is on hold and your phone detects it holds music, it asks if there are call spots in line, notify you when it's your turn to talk to someone, and alerts people at the other end of the call you're there.

The iPad also gets a massive upgrade for free. 4 Features Can't wait to use it on your iPados26

Imagine when you get back from the phone with customer service. If this feature appears familiar, it's because Google has a similar “Hold for Me” feature. This allows users to use Wait On You using Call Assist to notify them when they return. Having said this, it may not be the original feature, but it will be something that Apple users will be happy to have.

6. Space Photo

Apple Vision Pro introduced the idea of enjoying your precious memories with an immersive experience that puts you in the scene. However, to take advantage of this feature, I had to take a spatial photo and record spatial video. A similar feature is now appearing on iOS, allowing users to convert it into 3D-like images that separate the foreground and background for spatial effects.

Also: iOS 26 enables iPhone photos with 3D spatial effects

The best part is that you can add these photos to your lock screen. This means that when you move your phone, 3D elements appear to move. It may seem like AI is not involved, but according to Craig Federighi, Apple's software engineering SVP, “advanced computer vision technology running in neural engines” you can convert 2D photos into 3D effects.

7. Workout Buddy

Using AI for insights is nothing new, as most fitness wearable companies, including Whoop and Oura, have implemented such features before. However, Workout Buddy is a unique feature and an AI application you've never seen before. Essentially, you use fitness data such as history, pace, activity rings, and training loads to provide your own feedback during your workout.

Additionally, the Apple Watch has been getting a major upgrade. The best features of Watchos 26 are:

This feature is part of an upgrade to WatchOS and although I happen to own it, it seems like a fun, creative way to use AI. As someone who doesn't have all the desire to exercise, I know that having motivational reminders can have a positive impact on my workout lifespan.

Honorable mention

The above list is already quite extensive, but Apple has announced more AI features.

  • Order Tracking with Apple Wallet: Apple Intelligence can analyze emails to track details and enter all the information in your Apple wallet, even if you use a different payment method than Apple Pay.
  • Message poll: Apple Intelligence can detect and suggest messages when voting is useful. Users can use image playgrounds to create different backgrounds for polls.
  • Better routes on the map: Using device-on-device intelligence, users can better understand the user's daily routes and provide more customized suggestions.
  • genmoji and image playground: Update Genmoji is easy. Now you can combine two emojis to create a new one. I upgraded Image Playground to create images that utilize ChatGpt's image generation model for specific styles.

How to get early access

Apple has not yet released its official public beta release date, with the official page saying “coming soon.” Following the previous year's patterns and reports, it should happen any time now. The final most stable version will be released in the fall and the latest devices will be released.

To register for the public beta version, go to the Apple Beta Software program site and click the blue sign up button. The program is free and opens to anyone with an Apple account that accepts the Apple Beta Software program agreement when signed on.

Also, five familiar “new” iOS 26 features (I've been using them on Android for years)

Apple has already released the iOS 26 beta for developers as well. To get started, you need an iPhone 11 or a new running iOS 16.5 or later, and an Apple ID used by the Apple Developer Program. The ZDNET Guide provides step-by-step instructions on downloading betas.

It's worth keeping in mind that with either beta, this beta gives users access to all the latest features available on iOS 26, but the downside is that many are buggies as the features are not fully developed. Since you won't get the best experience, a good habit is to use a secondary phone or make sure your data is backed up properly in case something goes wrong.

Get the top stories of the morning in your inbox every day Tech Today newsletter.





Source link

Leave a Reply

Your email address will not be published. Required fields are marked *