The newly announced Apple Intelligence for iPhone, iPad and Mac — combines the power of generative models with personal context (Photo: Apple)
Cover The newly announced Apple Intelligence for iPhone, iPad and Mac combines the power of generative models with personal context
The newly announced Apple Intelligence for iPhone, iPad and Mac — combines the power of generative models with personal context (Photo: Apple)

Apple unveiled new AI tools that promise to enhance user experience and full integration of ChatGPT across its devices

At Apple’s annual Worldwide Developers Conference (WWDC), the company introduced Apple Intelligence, a new personal intelligence system aimed at enhancing productivity and creativity for all users of its devices. The new feature will be built directly into its next major software upgrades for its various devices including the iPhone, iPad and Mac computers.

Apple’s nearly two-hour-long presentation put a large focus on artificial intelligence (AI) and generative AI features that will take centre stage when its new software update rolls out during the third quarter of 2024. The Cupertino company presented this as a significant event and said that its new AI features will enable users to rewrite text, generate custom images and make everyday tasks more convenient.

Read more: Apple to open its first official store in The Exchange TRX

The newly announced Apple Intelligence is said to use advanced generative models, enabling users to create AI images and generate custom emojis and deeper integration between its virtual assistant, Siri with ChatGPT.

Here are five key takeaways from Apple’s event.

Siri gets a major upgrade

Tatler Asia
Now users can type to Siri and switch between text and voice to communicate with Siri (Photo: Apple)
Above Now users can type to Siri and switch between text and voice to communicate with Siri
Now users can type to Siri and switch between text and voice to communicate with Siri (Photo: Apple)

The new version of Siri can interact with files, activate specific features within apps and maintain context from one request to the next. Siri can now also tap into a vast knowledge base, providing more accurate and contextually relevant responses. This integration allows Siri to handle more complex tasks and offer deeper assistance across Apple devices.

See also: Ok, doc: Apple Vision Pro is now being used in surgery

AI-powered writing tools

Tatler Asia
ChatGPT will be available in Apple’s systemwide Writing Tools in macOS, which help users generate content for anything they are writing about (Photo: Apple)
Above ChatGPT will be available in Apple’s systemwide Writing Tools in macOS, which help users generate content for anything they are writing about
ChatGPT will be available in Apple’s systemwide Writing Tools in macOS, which help users generate content for anything they are writing about (Photo: Apple)

In iOS 18, iPadOS 18 and macOS Sequoia, Apple has implemented Writing Tools that work across the entire system. These tools enable users to rewrite, revise and summarise text in third-party applications, as well as in applications such as Mail, Notes and Pages. Apple stated that the addition of new features such as Rewrite, Proofread and Summarise will assist users in improving their writing by modifying tone, verifying grammar and simplifying text.

Image generative tools built-in

Tatler Asia
n Messages, users can use Image Playground to quickly create fun images for their friends, and see personalised suggested concepts related to their conversations (Photo: Apple)
Above In Messages, users can use Image Playground to quickly create fun images for their friends, and see personalised suggested concepts related to their conversations
n Messages, users can use Image Playground to quickly create fun images for their friends, and see personalised suggested concepts related to their conversations (Photo: Apple)

Users can create custom images quickly and easily with Apple’s AI-driven Image Playground. Apple announced that the feature will be integrated into apps like Messages, Keynote and Freeform. Additionally, users can generate images based on descriptions, making communication more engaging and personalised. If you love emojis, the new Genmoji will allow you to create unique emojis that reflect your expressions and personality.

Don't miss: How Casetify and Pestle and Mortar are creating tech accessories with Southeast Asian flair

Advanced photo management and search capabilities

Tatler Asia
The new Memories is said to enable Apple Intelligence to pick out the best photos and videos based on a user’s description, craft a storyline and arrange it all into a movie (Photo: Apple)
Above The new Memories enables Apple Intelligence to pick out the best photos and videos based on a user’s description, craft a storyline and arrange it all into a movie
The new Memories is said to enable Apple Intelligence to pick out the best photos and videos based on a user’s description, craft a storyline and arrange it all into a movie (Photo: Apple)

Searching for photos and videos is said to be easier with Apple Intelligence. Users will be able to find specific moments in their photo and video albums by using natural language queries such as, “Maya skateboarding in a tie-dye shirt”. There will also be the ability to search within videos to find specific moments in clips so users can go right to the relevant segment. 

Read more: Is Apple developing foldable versions of the iPhone and iPad?

Another new enhancement is the Clean Up tool, which deletes background elements from photos while keeping the main subject untouched. Additionally, the Memories feature generates customised storylines from user descriptions of photos and videos. It includes suggested music from Apple Music to provide a captivating way to revisit special moments.

Privacy-focused AI implementation

Tatler Asia
Apple claims Apple Intelligence relies on understanding deep personal context while also protecting user privacy (Photo: Apple)
Above Apple claims Apple Intelligence relies on understanding deep personal context while also protecting user privacy
Apple claims Apple Intelligence relies on understanding deep personal context while also protecting user privacy (Photo: Apple)

Apple claims that its new AI features are processed directly on your device, ensuring that personal data stays on your device and is not sent to external servers. This approach reduces the risk of data breaches and keeps sensitive information under your control.

Apple has created a system called Private Cloud Compute for handling more complex tasks that need server assistance. The system only sends essential data to Apple’s servers without storing it. Apple designed its system to be opt-in, ensuring that data is not recorded or transmitted unless you choose to share it. Users can see the shared data in their device settings, giving them transparency and control over their information.

Credits

Images: Apple

Topics