Apple Intelligence features explained - everything you need to know about Apple AI and when you can use it

The iPhone 16 and iPhone 16 Pro are here and Apple’s next best iPhones are the 'first iPhones built from the ground up for Apple Intelligence.' This year’s iPhones introduce bigger screens, faster chips, better cameras, new colors, and a snazzy Camera Control button made for Visual Intelligence.

The iPhone 16 lineup launches on September 20 and will come with iOS 18 and no Apple Intelligence features. That's because Apple Intelligence won’t be available until iOS 18.1, iPadOS 18.1, and macOS Sequoia 15.1 are released, when lots of the advertised features come to your Apple devices.

If that sounds hard to understand and a bit complicated, then we've done all the hard work for you. Here’s every Apple Intelligence feature, what device you'll need, and when you can expect to use them.

Writing Tools

Imagine Grammarly, but Apple. Apple Intelligence's Writing Tools allow you to proofread text, rewrite text in your choice of tone of voice, quick reply to messages or emails, and even summarise conversations in group chats.

These new tools will be available across iOS, iPadOS, and macOS, completely removing typos from your life and at the same time creating a potential dystopian future where every Apple user sounds exactly the same.

Summaries

Summaries are a huge part of what Apple Intelligence offers, whether that's summarising group chats, as we mentioned above, or emails in the Mail app. On any webpage you can now summarize articles with just the press of a button, built-in to Reader on Safari. The most impressive use of summaries, however, is with notifications where your Apple device will condense notifications and prioritise them to prevent distractions.

Siri redesign

Your favorite voice assistant is getting a complete redesign, so much so that the changes will arrive gradually over the next few months. Initially Siri will get a completely new look on Mac, iPhone and iPad. On the iPhone and iPad it will pulsate from the edges of your device when activated, and on Mac you’ll be able to place Siri wherever you want to.

In iOS 18.1, Siri will get smarter thanks to Apple Intelligence, allowing you to ask follow up queries and more difficult questions. You'll also be able to interact with Siri by using Type to Siri, so when you're out in public you don't need to talk out loud to a virtual assistant. While we've had accessibility features that allow typing to Siri in the past, this new design allows you to choose between voice or text without opening Settings.

Photos improvements

The Photos app with Apple Intelligence will add Clean Up, Apple's competitor to Google's Magic Eraser and in our testing it works really well. You can simply select an object and remove it completely from a photo, just like magic.

Searching within the app will also be much improved by the ability to use natural language prompts and find exactly what you're looking for in seconds. You can also create Memories from prompts, a more curated version of the Photos apps' current Memories offering.

Mail

The Mail app gets a whole lot easier to use thanks to Apple Intelligence. Not only will you be able to use smart replies, as mentioned above, but Mail will now prioritize your most important emails, summarize them, so you don't have to read the whole thing, and categorize every incoming message for you.

Speech to text

Transcription is excellent on iOS 18.1 thanks to Apple Intelligence. With Apple's AI transcription tools you can now record phone calls and turn them into notes (don't worry everyone on the call will be alerted that this tool is in use).

Not only can you record calls, but you can even use the Notes app for voice recordings, perfect for combining with other Apple Intelligence tools, like the summaries, to get a quick idea of what's been said.

Visual Intelligence

Visual Intelligence is the snazzy new iPhone 16-exclusive Apple Intelligence feature and it's seriously cool. Imagine Google Lens, but Apple. By pressing and holding the new Camera Control button, you'll launch Visual Intelligence which allows you to search for anything you point your camera at.

In Apple's presentation at the 'Glowtime' event, the feature was demonstrated by a man taking a photo of his friend's dog, getting the name of the breed in an instant. You'll also be able to use Visual Intelligence with Google and ChatGPT in the future.

Interested in Visual Intelligence? Read our hands-on iPhone 16 review or our hands-on iPhone 16 Pro review to see what we think of the phones it's available on.

Genmoji

Genmoji is exactly what it says on the tin: generative emoji. Want to see a dinosaur on a skateboard? You can. How about a frog playing a banjo? Yep. Pineapple on a pizza? Nope, too far.

With Genmoji, any combination of emojis you can think of can combine to create AI-generated versions of everyone's favorite yellow smiley face.

Siri 2.0

Expected in 2025, Siri's most impressive Apple Intelligence feature will arrive: The ability to have on-screen awareness and reply to your prompts based on the thing you're doing.

This is a seriously impressive use of AI and one that we can't wait to use. Siri's major overhaul has been rumored to arrive with iOS 18.4, but we'll need to wait and see to know for sure.

Image Playground

You've seen the weird AI-generated images that look like Pixar with no soul? Well Image Playground is exactly that. Apple's image generation tool lets you draw pictures in notes and quickly improve them or imagine anything you want in almost in any app.

Expect this feature towards the end of 2024. How useful it is? Time will tell.

ChatGPT Integration

Last but not least, Siri will get ChatGPT integration at some point in the near future allowing you to send more complex prompts to OpenAI's server instead of Apple's.

You'll have to grant access every time you do it, and Apple has made it very clear that privacy in Apple Intelligence is pivotal, so this might be the best way to interact with the world's most famous chatbot.

How It works

Search Crack for

Latest IT News

Sep 17
Windows 11’s latest update boosts gaming performance for some AMD users, but others are seemingly facing crashes and glitches.
Sep 17
Fed up with the Photos app running sluggishly? That’ll hopefully soon be a thing of the past, and the same is true for other stock apps, too.
Sep 17
ChatGPT won't be messaging first anymore, at least for now
Sep 17
After a year of suspense, Sonoma's successor is finally here. Here's how to download it right now.
Sep 17
Researchers demonstrate AI chatbot that can dismantle conspiracy theories.
Sep 16
Runway adds video-to-video feature to its Gen-3 AI video generator.
Sep 16
Copilot is back to invigorate Microsoft 365 with a brand-new Business Chat and collaborative Pages, plus a few extra tweaks to the 365 apps.

Latest cracks