Apple’s Music Haptics feature is now live, as part of the official release of iOS 18. This is an accessibility tool that integrates with Apple Music on iPhones. Simply put, it uses the phone’s speaker-based haptics system, which the company refers to as the Taptic Engine, to create “taps, textures and refined vibrations to the audio of the song.”
This is quite obviously aimed toward those affected by hearing loss, allowing them to feel the music. It works with Apple Music, but also with Apple Music Classical and Shazam. The company says it’ll also integrate with some third-party apps, so long as the iPhone is connected to Wi-Fi or cellular.
To get started, just head into the Accessibility settings menu and turn on “Music Haptics.” An easily identifiable logo will appear on the Now Playing screen in the Apple Music app when activated. Tapping this logo will pause the feature and tapping it again will turn it back on. Music Haptics is supported globally on iPhone 12 and later, as long as the device is updated to iOS 18.
To commemorate the launch, Apple Music has released a series of playlists that take advantage of the haptic technology. These channels have names like Haptics Beats and Haptics Bass, so they are filled with songs with plenty of opportunity for taps and vibrations.
People have already been experimenting with the feature. Some users have suggested that it “sounds like an Atari game” when a phone is placed on a box with Music Haptics turned on. I don’t agree but, well, listen for yourself.
It’s WWDC 2024 keynote time! Each year Apple kicks off its Worldwide Developers Conference with a few hours of just straight announcements, like the long-awaited Apple Intelligence and a makeover for smart AI assistant, Siri. We expected much of them to revolve around the company’s artificial intelligence ambitions (and here), and Apple didn’t disappoint. We also bring you news about Vision Pro and lots of feature refreshes.
Spotlight Search gets better at natural language queries in iOS 18
Apple is making it easier for people to discover the content inside their apps using natural language — or “semantic” — queries. Already, Spotlight has been able to search for content in developers’ apps, but it would only return results when search terms matched exactly. With this year’s addition of semantic search capabilities, people will be able to search for content in apps using search terms that are just similar in meaning. Read more
Here are the best WWDC 2024 features you missed
Now that people are using developer betas and exploring the sessions at the event, more features that were not announced onstage are surfacing. Remember that only certain devices will be compatible with iOS 18 when it’s released later in the fall. Read more
iOS 18 cracks down on apps asking for full address book access
Instead, Apple is adding a new two-step permissions pop-up screen that will first ask users to allow or deny access to their contacts, as before, and then, if the user allows access, will allow them to choose which contacts they want to share, if not all. Read more
Apple Watch is finally adding a feature I’ve been requesting for years
Image credit: AppleImage Credits: Apple
Brian Heater writes about consistently requesting this certain feature from Apple: the ability to pause your activity rings. If you’re down due to a cold, on an international flight, or find that you’re vigorously shaking your wrist at 9 p.m. just to finish closing your rings, you can now pause progress via the Watch or through the connected iPhone app. Read more
The apps that Apple Sherlocked at WWDC 2024
Apple has been on a spree of late, announcing a host of new features for its various devices earlier this week. But a lot of those features were already available to some extent on Apple devices through third-party apps. So, just like the past few years, we will examine the ideas that Apple “Sherlocked” in this year’s updates. Read more
Why Apple is taking a small-model approach to generative AI
The company has since revealed some of what makes its approach to generative AI different. First and foremost is scope. Many of the most prominent companies in the space take a “bigger is better” approach to their models. Read more
Apple’s AI, Apple Intelligence, is boring and practical — that’s why it works
Instead of trying to overwhelm users with too many AI features to count, the Cupertino tech giant is carefully rolling out AI where it believes it could be useful. That means the tech won’t be included where it could be much of a threat to the carefully crafted consumer experience of using an Apple device. Read more
Apple’s Messages app will support RCS and scheduling texts
Apple delivered two of the biggest features iMessage and its Messages app that consumers were wanting for a long time: the ability to schedule messages to send at a later date and time and support for RCS, the next-gen messaging standard and replacement for SMS that will make texting with Android folks much less painful. Is it the end of the green bubbles? Read more
More App Store improvements
Apple is giving developers more tools to increase their app revenues and promote their apps with win-back offers and the release of a new commerce API. Read more
iOS 18 compatible devices
Among the highlights of the new operating system version are a set of customization options, such as being able to arrange apps and widgets on the Home Screen and customize buttons. Other features include new text effects, the ability to lock and hide apps, new ways to manage your Mail inbox, the introduction of iMessages over satellite, a significant redesign of the Photos app and more. Now let’s see if your device is compatible. Read more
All the Apple Intelligence news
There was a lot, wasn’t there? Apple’s AI push was at the heart of WWDC 2024, and our AI expert Kyle Wiggers took some time to process all of the announcements before bringing together a guide to all of the news across Siri, Genmoji, ChatGPT integrations, photo editing and beyond. Read more
Apple to work with AI partners beyond OpenAI
In a post-keynote event, Apple SVP Craig Federighi confirmed that the company would work with other third-party models beyond OpenAI, with Google’s Gemini model being highlighted as the first example. He clarified that Apple had “nothing to announce right now, but that’s our general direction.” Read more
Elon Musk lumps OpenAI, Apple together
Tesla, SpaceX and xAI exec Elon Musk took to X to continue his campaign against rival OpenAI, threatening to ban Apple devices from his businesses “if Apple integrates OpenAI at the OS level,” among other responses and reactions to the conversations around WWDC on X. Read more
Apple Intelligence’s (limited) availability
Before you get too excited about putting Apple Intelligence to the test, check if your devices are new enough. Only the iPhone 15 Pro and 15 Pro Max, along with iPads and Macs with M1 or newer chips, will be able to run the new features coming alongside Apple’s AI push. Read more
ChatGPT in Siri
Apple is bringing ChatGPT, its AI-powered chatbot experience, to Siri and other Apple apps, powered by OpenAI’s GPT-4 and other generative AI models. Read more
Apple Intelligence is an image and emoji playground
Image Credits: Apple
One of the Apple Intelligence-powered features coming in iOS 18 will allow iPhone users to create AI images of people they’re messaging with — a feature that works something like an AI-upgraded Bitmoji. The goal, of course, is to make your “everyday conversations more enjoyable.”
Apple Intelligence will have an understanding of who you’re talking with in a messaging conversation, so if you want to personalize that chat with a custom AI image, you can create one on the fly. Read more
Apple TV+
Image Credits: Apple
For those of you who use Apple TV+, there is a new feature called InSight. The feature will allow viewers to learn actor names and song titles as they appear on the screen. Lauren Forristal writes that it’s similar to Amazon’s X-Ray technology, where Fire TV users get an overview of actor bios and behind-the-scenes information while watching TV shows and movies.
What stands out about InSight, however, is its Shazam-like functionality, which highlights the song playing in the TV show or movie and gives users the option to add it to an Apple Music playlist to listen to later. Read more
Siri
Image Credits: Apple
Apple also made some enhancements to its smart assistant, Siri. These include adding some generative AI features that make Siri seem more natural and more personal. There’s also a new glowing light. And, Siri can also handle stumbles in speech and better understand context. Plus, for those who would rather type, you can do that now. Read more
Apple Intelligence is here
Image Credits: Apple
The new feature is called Apple Intelligence (AI, get it?). The company promised the feature will be built with safety at its core, along with highly personalized experiences.
“Most importantly, it has to understand you and be grounded in your personal context, like your routine, your relationships, your communications and more,” CEO Tim Cook noted at WWDC Monday. “And of course, it has to be built with privacy from the ground up together. All of this goes beyond artificial intelligence. It’s personal intelligence, and it’s the next big step for Apple.” Read more
That covers the consumer side of things, but WWDC is a conference for developers, and Apple revealed how developers will soon be able to bring the Apple Intelligence experience into their software. A number of AI features will be added to existing SDKs, allowing for generative AI image generation, or new prompts to Siri, to allow devs to expand the Apple Intelligence footprint. Read more
Apple’s new Passwords app
Image Credits: Apple
While you can already use your iCloud account to store and sync passwords across your devices, it wasn’t easy to figure out. Now, the company introduced a Passwords app. Some of the features include a new column on the left that lets you more easily navigate your password collection. For instance, you can view all your passwords or just Wi-Fi passwords (a new addition), passkeys or codes that aren’t related to a website or service. Read more
Smart Script in iPad
Image Credits: Apple
A new “Smart Script” feature will clean up your handwriting when using an Apple Pencil to write in Notes. Apple says it’s making handwriting your notes even smoother and straighter. The feature improves the appearance of your writing as you write by using on-device machine learning to recreate your handwriting from your notes. You’ll see your own handwriting, just smoother and more legible. Read more
Calculator for iPad
Image Credits: Apple
Who would have thought a calculator would liven up a developer’s conference? Well, Apple’s new Calculator for iPad app got everyone excited.
iOS’ perennial tips calculating app is finally coming to the larger screen. The feature utilizes the additional screen real estate to bring new features that the company couldn’t really jam into the iPhone. The biggest arrival here is the addition of Math Notes. The additional feature does the math for you. Read more
macOS Sequoia
Image Credits: Apple
The latest operating system version is called macOS Sequoia.
One of the biggest features of this new OS is iPhone mirroring. Now, through macOS’ Continuity feature, you can mirror your iPhone’s screen and control it right from your Mac. Notifications on Mac pop you into iPhone mirror mode, and iPhone audio comes through the Mac as well, but the paired iPhone stays locked while in mirror mode. Read more
OK, let’s do a little deeper dive into iPhone mirroring. While Apple didn’t detail many use cases for the feature, Sarah Perez writes that it seems it would make it easier to demo apps over video calls or in person, as users could move between a slideshow presentation and a live demo of the iPhone app by launching it as if it’s another app on your Mac. Read more
Messages via Satellite
Image Credits: Apple
This new feature works much like Apple’s emergency SOS feature. When you have no signal, you’ll be given the option to find a satellite to relay the data. You’ll have to keep the phone pointed in the right direction while you do it, however, there’s an overlay above your messages to remind you. Read more
Photos app
Image Credits: Apple
Apple showed off the new Photos app as it will appear in the upcoming release of the iOS software. The new app introduces new navigation, new organizational features and other ways to discover your favorite photos, including those of friends, family, pets, trips and more.
Some things to know: The new design will lead to less time searching for photos as it puts everything you need within easy reach.
One major change involves how the app has been unified into a single view with the photo grid at the top and the library, organized by theme, below. Read more
Tap to Cash
One of the more interesting additions is Tap to Cash, which is more or less what it sounds like, letting users pay for things by tapping together a pair of iPhones.
As Brian Heater writes, the feature is effectively an outgrowth of Apple Pay’s longstanding Tap to Pay feature. Similarly, the new addition likely uses the device’s NFC functionality. Apple notes that the feature transfers money without having to share any personal info — a nice added privacy element. Read more
iOS 18
Image Credits: Apple
Users will now be able to lock an app when they hand over their phone to do things like show someone a picture or let them play a game. When you lock an app, if someone tries to tap your phone, they will be required to authenticate using Face ID, Touch ID or their passcode. While you have the app lock feature enabled, information from inside the app won’t appear in other places, like search and notifications. Read more
Apple also shared some initial details for the upcoming major release of iOS, which is its operating system specifically designed for the iPhone. As expected, much of this involves artificial intelligence. Remember when icons were locked to the grid? Well, they can now be laid out however you want on your home screen so that they don’t hide your background photos.
“iOS 18 is a big release that delivers more ways to customize your iPhone, stay connected and relive special moments,” Apple SVP of software engineering Craig Federighi said. Read more
Speaking of icons, most of these updates are those long-requested functionalities, like the ability to set app icons and widgets wherever you want on the Home Screen, plus support for dark mode icons with different color schemes. Read more
visionOS 2
Image Credits: Apple
visionOS 2 brings with it productivity enhancements and “new immersive experiences.” One lets you “spatialize” photos from regular photos, leveraging AI tech. Another is a new navigation option: visionOS 2 lets you switch to the home screen by just tapping, or flip your hand over to bring up the control center with notifications, shortcuts and more. Read more
One of the bigger announcements with this includes the ability to turn existing images into spatial photos. The new feature utilizes machine learning to build out additional angles, marking a change from the existing method, which required images to be shot on an iPhone 15 Pro or the Vision Pro itself. Read more
For those of you outside of the U.S., the Vision Pro headset will be available in eight new countries. Read more
Useful AI, not flashy AI
Apple has fallen behind its peers in the AI race, and it probably feels like it needs to pull out all the stops to impress fans and shareholders. But that shouldn’t mean overpromising on features. Read more
Generative AI
For smart assistants: While rumors point to the company transitioning a number of employees to generative AI operations following its electric car implosion, all signs point to Apple having ceded a significant head start to the competition. As such, its most logical play is a partnership with a reigning powerhouse like OpenAI. Read more
Maybe not for iPhone 15: Some other rumors say that when this generative AI comes into play, a limited number of older devices will also be able to run the system, including iPads and Macs running an M1 chip or higher and the iPhone 15 Pro. That means the standard iPhone 15 may be left out in the cold on this one. Read more
It’s WWDC 2024 keynote time! Each year Apple kicks off its Worldwide Developers Conference with a few hours of just straight announcements, like the long-awaited Apple Intelligence and a makeover for smart AI assistant, Siri. We expected much of them to revolve around the company’s artificial intelligence ambitions (and here), and Apple didn’t disappoint. We also bring you news about Vision Pro and lots of feature refreshes.
Apple’s Messages app will support RCS and scheduling texts
Apple delivered two of the biggest features iMessage and its Messages app that consumers were wanting for a long time: the ability to schedule messages to send at a later date and time and support for RCS, the next-gen messaging standard and replacement for SMS that will make texting with Android folks much less painful. Is it the end of the green bubbles? Read more
More App Store improvements
Apple is giving developers more tools to increase their app revenues and promote their apps with win-back offers and the release of a new commerce API. Read more
iOS 18 compatible devices
Among the highlights of the new operating system version are a set of customization options, such as being able to arrange apps and widgets on the Home Screen and customize buttons. Other features include new text effects, the ability to lock and hide apps, new ways to manage your Mail inbox, the introduction of iMessages over satellite, a significant redesign of the Photos app and more. Now let’s see if your device is compatible. Read more
All the Apple Intelligence news
There was a lot, wasn’t there? Apple’s AI push was at the heart of WWDC 2024, and our AI expert Kyle Wiggers took some time to process all of the announcements before bringing together a guide to all of the news across Siri, Genmoji, ChatGPT integrations, photo editing and beyond. Read more
Apple to work with AI partners beyond OpenAI
In a post-keynote event, Apple SVP Craig Federighi confirmed that the company would work with other third-party models beyond OpenAI, with Google’s Gemini model being highlighted as the first example. He clarified that Apple had “nothing to announce right now, but that’s our general direction.” Read more
Elon Musk lumps OpenAI, Apple together
Tesla, SpaceX and xAI exec Elon Musk took to X to continue his campaign against rival OpenAI, threatening to ban Apple devices from his businesses “if Apple integrates OpenAI at the OS level,” among other responses and reactions to the conversations around WWDC on X. Read more
Apple Intelligence’s (limited) availability
Before you get too excited about putting Apple Intelligence to the test, check if your devices are new enough. Only the iPhone 15 Pro and 15 Pro Max, along with iPads and Macs with M1 or newer chips, will be able to run the new features coming alongside Apple’s AI push. Read more
ChatGPT in Siri
Apple is bringing ChatGPT, its AI-powered chatbot experience, to Siri and other Apple apps, powered by OpenAI’s GPT-4 and other generative AI models. Read more
Apple Intelligence is an image and emoji playground
Image Credits: Apple
One of the Apple Intelligence-powered features coming in iOS 18 will allow iPhone users to create AI images of people they’re messaging with — a feature that works something like an AI-upgraded Bitmoji. The goal, of course, is to make your “everyday conversations more enjoyable.”
Apple Intelligence will have an understanding of who you’re talking with in a messaging conversation, so if you want to personalize that chat with a custom AI image, you can create one on the fly. Read more
Apple TV+
Image Credits: Apple
For those of you who use Apple TV+, there is a new feature called InSight. The feature will allow viewers to learn actor names and song titles as they appear on the screen. Lauren Forristal writes that it’s similar to Amazon’s X-Ray technology, where Fire TV users get an overview of actor bios and behind-the-scenes information while watching TV shows and movies.
What stands out about InSight, however, is its Shazam-like functionality, which highlights the song playing in the TV show or movie and gives users the option to add it to an Apple Music playlist to listen to later. Read more
Siri
Image Credits: Apple
Apple also made some enhancements to its smart assistant, Siri. These include adding some generative AI features that make Siri seem more natural and more personal. There’s also a new glowing light. And, Siri can also handle stumbles in speech and better understand context. Plus, for those who would rather type, you can do that now. Read more
Apple Intelligence is here
Image Credits: Apple
The new feature is called Apple Intelligence (AI, get it?). The company promised the feature will be built with safety at its core, along with highly personalized experiences.
“Most importantly, it has to understand you and be grounded in your personal context, like your routine, your relationships, your communications and more,” CEO Tim Cook noted at WWDC Monday. “And of course, it has to be built with privacy from the ground up together. All of this goes beyond artificial intelligence. It’s personal intelligence, and it’s the next big step for Apple.” Read more
That covers the consumer side of things, but WWDC is a conference for developers, and Apple revealed how developers will soon be able to bring the Apple Intelligence experience into their software. A number of AI features will be added to existing SDKs, allowing for generative AI image generation, or new prompts to Siri, to allow devs to expand the Apple Intelligence footprint. Read more
Apple’s new Passwords app
Image Credits: Apple
While you can already use your iCloud account to store and sync passwords across your devices, it wasn’t easy to figure out. Now, the company introduced a Passwords app. Some of the features include a new column on the left that lets you more easily navigate your password collection. For instance, you can view all your passwords or just Wi-Fi passwords (a new addition), passkeys or codes that aren’t related to a website or service. Read more
Smart Script in iPad
Image Credits: Apple
A new “Smart Script” feature will clean up your handwriting when using an Apple Pencil to write in Notes. Apple says it’s making handwriting your notes even smoother and straighter. The feature improves the appearance of your writing as you write by using on-device machine learning to recreate your handwriting from your notes. You’ll see your own handwriting, just smoother and more legible. Read more
Calculator for iPad
Image Credits: Apple
Who would have thought a calculator would liven up a developer’s conference? Well, Apple’s new Calculator for iPad app got everyone excited.
iOS’ perennial tips calculating app is finally coming to the larger screen. The feature utilizes the additional screen real estate to bring new features that the company couldn’t really jam into the iPhone. The biggest arrival here is the addition of Math Notes. The additional feature does the math for you. Read more
macOS Sequoia
Image Credits: Apple
The latest operating system version is called macOS Sequoia.
One of the biggest features of this new OS is iPhone mirroring. Now, through macOS’ Continuity feature, you can mirror your iPhone’s screen and control it right from your Mac. Notifications on Mac pop you into iPhone mirror mode, and iPhone audio comes through the Mac as well, but the paired iPhone stays locked while in mirror mode. Read more
OK, let’s do a little deeper dive into iPhone mirroring. While Apple didn’t detail many use cases for the feature, Sarah Perez writes that it seems it would make it easier to demo apps over video calls or in person, as users could move between a slideshow presentation and a live demo of the iPhone app by launching it as if it’s another app on your Mac. Read more
Messages via Satellite
Image Credits: Apple
This new feature works much like Apple’s emergency SOS feature. When you have no signal, you’ll be given the option to find a satellite to relay the data. You’ll have to keep the phone pointed in the right direction while you do it, however, there’s an overlay above your messages to remind you. Read more
Photos app
Image Credits: Apple
Apple showed off the new Photos app as it will appear in the upcoming release of the iOS software. The new app introduces new navigation, new organizational features and other ways to discover your favorite photos, including those of friends, family, pets, trips and more.
Some things to know: The new design will lead to less time searching for photos as it puts everything you need within easy reach.
One major change involves how the app has been unified into a single view with the photo grid at the top and the library, organized by theme, below. Read more
Tap to Cash
One of the more interesting additions is Tap to Cash, which is more or less what it sounds like, letting users pay for things by tapping together a pair of iPhones.
As Brian Heater writes, the feature is effectively an outgrowth of Apple Pay’s longstanding Tap to Pay feature. Similarly, the new addition likely uses the device’s NFC functionality. Apple notes that the feature transfers money without having to share any personal info — a nice added privacy element. Read more
iOS 18
Image Credits: Apple
Users will now be able to lock an app when they hand over their phone to do things like show someone a picture or let them play a game. When you lock an app, if someone tries to tap your phone, they will be required to authenticate using Face ID, Touch ID or their passcode. While you have the app lock feature enabled, information from inside the app won’t appear in other places, like search and notifications. Read more
Apple also shared some initial details for the upcoming major release of iOS, which is its operating system specifically designed for the iPhone. As expected, much of this involves artificial intelligence. Remember when icons were locked to the grid? Well, they can now be laid out however you want on your home screen so that they don’t hide your background photos.
“iOS 18 is a big release that delivers more ways to customize your iPhone, stay connected and relive special moments,” Apple SVP of software engineering Craig Federighi said. Read more
Speaking of icons, most of these updates are those long-requested functionalities, like the ability to set app icons and widgets wherever you want on the Home Screen, plus support for dark mode icons with different color schemes. Read more
visionOS 2
Image Credits: Apple
visionOS 2 brings with it productivity enhancements and “new immersive experiences.” One lets you “spatialize” photos from regular photos, leveraging AI tech. Another is a new navigation option: visionOS 2 lets you switch to the home screen by just tapping, or flip your hand over to bring up the control center with notifications, shortcuts and more. Read more
One of the bigger announcements with this includes the ability to turn existing images into spatial photos. The new feature utilizes machine learning to build out additional angles, marking a change from the existing method, which required images to be shot on an iPhone 15 Pro or the Vision Pro itself. Read more
For those of you outside of the U.S., the Vision Pro headset will be available in eight new countries. Read more
Useful AI, not flashy AI
Apple has fallen behind its peers in the AI race, and it probably feels like it needs to pull out all the stops to impress fans and shareholders. But that shouldn’t mean overpromising on features. Read more
Generative AI
For smart assistants: While rumors point to the company transitioning a number of employees to generative AI operations following its electric car implosion, all signs point to Apple having ceded a significant head start to the competition. As such, its most logical play is a partnership with a reigning powerhouse like OpenAI. Read more
Maybe not for iPhone 15: Some other rumors say that when this generative AI comes into play, a limited number of older devices will also be able to run the system, including iPads and Macs running an M1 chip or higher and the iPhone 15 Pro. That means the standard iPhone 15 may be left out in the cold on this one. Read more
It’s WWDC 2024 keynote time! Each year Apple kicks off its Worldwide Developers Conference with a few hours of just straight announcements, like the long-awaited Apple Intelligence and a makeover for smart AI assistant, Siri. We expected much of them to revolve around the company’s artificial intelligence ambitions (and here), and Apple didn’t disappoint. We also bring you news about Vision Pro and lots of feature refreshes.
In a post-keynote event, Apple SVP Craig Federighi confirmed that the company would work with other third-party models beyond OpenAI, with Google’s Gemini model being highlighted as the first example. He clarified that Apple had “nothing to announce right now, but that’s our general direction.” Read more
Elon Musk lumps OpenAI, Apple together
Tesla, SpaceX and xAI exec Elon Musk took to X to continue his campaign against rival OpenAI, threatening to ban Apple devices from his businesses “if Apple integrates OpenAI at the OS level,” among other responses and reactions to the conversations around WWDC on X. Read more
Apple Intelligence’s (limited) availability
Before you get too excited about putting Apple Intelligence to the test, check if your devices are new enough. Only the iPhone 15 Pro and 15 Pro Max, along with iPads and Macs with M1 or newer chips, will be able to run the new features coming alongside Apple’s AI push. Read more
ChatGPT in Siri
Apple is bringing ChatGPT, its AI-powered chatbot experience, to Siri and other Apple apps, powered by OpenAI’s GPT-4 and other generative AI models. Read more
Apple Intelligence is an image and emoji playground
Image Credits: Apple
One of the Apple Intelligence-powered features coming in iOS 18 will allow iPhone users to create AI images of people they’re messaging with — a feature that works something like an AI-upgraded Bitmoji. The goal, of course, is to make your “everyday conversations more enjoyable.”
Apple Intelligence will have an understanding of who you’re talking with in a messaging conversation, so if you want to personalize that chat with a custom AI image, you can create one on the fly. Read more
Apple TV+
Image Credits: Apple
For those of you who use Apple TV+, there is a new feature called InSight. The feature will allow viewers to learn actor names and song titles as they appear on the screen. Lauren Forristal writes that it’s similar to Amazon’s X-Ray technology, where Fire TV users get an overview of actor bios and behind-the-scenes information while watching TV shows and movies.
What stands out about InSight, however, is its Shazam-like functionality, which highlights the song playing in the TV show or movie and gives users the option to add it to an Apple Music playlist to listen to later. Read more
Siri
Image Credits: Apple
Apple also made some enhancements to its smart assistant, Siri. These include adding some generative AI features that make Siri seem more natural and more personal. There’s also a new glowing light. And, Siri can also handle stumbles in speech and better understand context. Plus, for those who would rather type, you can do that now. Read more
Apple Intelligence is here
Image Credits: Apple
The new feature is called Apple Intelligence (AI, get it?). The company promised the feature will be built with safety at its core, along with highly personalized experiences.
“Most importantly, it has to understand you and be grounded in your personal context, like your routine, your relationships, your communications and more,” CEO Tim Cook noted at WWDC Monday. “And of course, it has to be built with privacy from the ground up together. All of this goes beyond artificial intelligence. It’s personal intelligence, and it’s the next big step for Apple.” Read more
That covers the consumer side of things, but WWDC is a conference for developers, and Apple revealed how developers will soon be able to bring the Apple Intelligence experience into their software. A number of AI features will be added to existing SDKs, allowing for generative AI image generation, or new prompts to Siri, to allow devs to expand the Apple Intelligence footprint. Read more
Apple’s new Passwords app
Image Credits: Apple
While you can already use your iCloud account to store and sync passwords across your devices, it wasn’t easy to figure out. Now, the company introduced a Passwords app. Some of the features include a new column on the left that lets you more easily navigate your password collection. For instance, you can view all your passwords or just Wi-Fi passwords (a new addition), passkeys or codes that aren’t related to a website or service. Read more
Smart Script in iPad
Image Credits: Apple
A new “Smart Script” feature will clean up your handwriting when using an Apple Pencil to write in Notes. Apple says it’s making handwriting your notes even smoother and straighter. The feature improves the appearance of your writing as you write by using on-device machine learning to recreate your handwriting from your notes. You’ll see your own handwriting, just smoother and more legible. Read more
Calculator for iPad
Image Credits: Apple
Who would have thought a calculator would liven up a developer’s conference? Well, Apple’s new Calculator for iPad app got everyone excited.
iOS’ perennial tips calculating app is finally coming to the larger screen. The feature utilizes the additional screen real estate to bring new features that the company couldn’t really jam into the iPhone. The biggest arrival here is the addition of Math Notes. The additional feature does the math for you. Read more
macOS Sequoia
Image Credits: Apple
The latest operating system version is called macOS Sequoia.
One of the biggest features of this new OS is iPhone mirroring. Now, through macOS’ Continuity feature, you can mirror your iPhone’s screen and control it right from your Mac. Notifications on Mac pop you into iPhone mirror mode, and iPhone audio comes through the Mac as well, but the paired iPhone stays locked while in mirror mode. Read more
OK, let’s do a little deeper dive into iPhone mirroring. While Apple didn’t detail many use cases for the feature, Sarah Perez writes that it seems it would make it easier to demo apps over video calls or in person, as users could move between a slideshow presentation and a live demo of the iPhone app by launching it as if it’s another app on your Mac. Read more
Messages via Satellite
Image Credits: Apple
This new feature works much like Apple’s emergency SOS feature. When you have no signal, you’ll be given the option to find a satellite to relay the data. You’ll have to keep the phone pointed in the right direction while you do it, however, there’s an overlay above your messages to remind you. Read more
Photos app
Image Credits: Apple
Apple showed off the new Photos app as it will appear in the upcoming release of the iOS software. The new app introduces new navigation, new organizational features and other ways to discover your favorite photos, including those of friends, family, pets, trips and more.
Some things to know: The new design will lead to less time searching for photos as it puts everything you need within easy reach.
One major change involves how the app has been unified into a single view with the photo grid at the top and the library, organized by theme, below. Read more
Tap to Cash
One of the more interesting additions is Tap to Cash, which is more or less what it sounds like, letting users pay for things by tapping together a pair of iPhones.
As Brian Heater writes, the feature is effectively an outgrowth of Apple Pay’s longstanding Tap to Pay feature. Similarly, the new addition likely uses the device’s NFC functionality. Apple notes that the feature transfers money without having to share any personal info — a nice added privacy element. Read more
iOS 18
Image Credits: Apple
Users will now be able to lock an app when they hand over their phone to do things like show someone a picture or let them play a game. When you lock an app, if someone tries to tap your phone, they will be required to authenticate using Face ID, Touch ID or their passcode. While you have the app lock feature enabled, information from inside the app won’t appear in other places, like search and notifications. Read more
Apple also shared some initial details for the upcoming major release of iOS, which is its operating system specifically designed for the iPhone. As expected, much of this involves artificial intelligence. Remember when icons were locked to the grid? Well, they can now be laid out however you want on your home screen so that they don’t hide your background photos.
“iOS 18 is a big release that delivers more ways to customize your iPhone, stay connected and relive special moments,” Apple SVP of software engineering Craig Federighi said. Read more
Speaking of icons, most of these updates are those long-requested functionalities, like the ability to set app icons and widgets wherever you want on the Home Screen, plus support for dark mode icons with different color schemes. Read more
visionOS 2
Image Credits: Apple
visionOS 2 brings with it productivity enhancements and “new immersive experiences.” One lets you “spatialize” photos from regular photos, leveraging AI tech. Another is a new navigation option: visionOS 2 lets you switch to the home screen by just tapping, or flip your hand over to bring up the control center with notifications, shortcuts and more. Read more
One of the bigger announcements with this includes the ability to turn existing images into spatial photos. The new feature utilizes machine learning to build out additional angles, marking a change from the existing method, which required images to be shot on an iPhone 15 Pro or the Vision Pro itself. Read more
For those of you outside of the U.S., the Vision Pro headset will be available in eight new countries. Read more
Useful AI, not flashy AI
Apple has fallen behind its peers in the AI race, and it probably feels like it needs to pull out all the stops to impress fans and shareholders. But that shouldn’t mean overpromising on features. Read more
Generative AI
For smart assistants: While rumors point to the company transitioning a number of employees to generative AI operations following its electric car implosion, all signs point to Apple having ceded a significant head start to the competition. As such, its most logical play is a partnership with a reigning powerhouse like OpenAI. Read more
Maybe not for iPhone 15: Some other rumors say that when this generative AI comes into play, a limited number of older devices will also be able to run the system, including iPads and Macs running an M1 chip or higher and the iPhone 15 Pro. That means the standard iPhone 15 may be left out in the cold on this one. Read more
Apple shared the first details for the upcoming major release of iOS, its operating system specifically designed for the iPhone, at WWDC 2024.
As expected, this is a pivotal moment for the mobile platform as iOS 18 is going to focus on artificial intelligence.
“I’m excited that we’ll introduce profound new intelligence capabilities that we hope will inspire developers, delight users, and make our platforms even smarter and more useful than ever,” Apple CEO Tim Cook said during its introduction of the event. Later in the presentation, Apple announced that it is integrating ChatGPT into Siri and other system-wide interactions.
But before talking about AI, Apple mentioned new customization features. Icons can now be laid out however you want on your home screen so that they don’t hide your background photos.
“iOS 18 is a big release that delivers more ways to customize your iPhone, stay connected and relive special moments,” said Apple SVP of software engineering Craig Federighi.
Icons can be customized with a tint color. For instance, if you want all your icons to look yellow, you can tint all app icons to this color.
Control Center is also getting an update. It isn’t limited to just the buttons you see on the main control center page. You can swipe down to view media playback and home controls. You can also edit Control Center from Control Center directly by tapping on an edit button in a corner.
There is a new set of APIs for Control Center, meaning that third-party developers will be able to create Control Center and lock screen shortcuts. For instance, Apple showed that you can replace the camera button on the lock screen with a Snapchat button.
Apps can now be individually locked. This way, you need to identify with Face ID, Touch ID or your passcode to unlock this app. This app also doesn’t appear in search results. Being able to hide apps will be important for AI features, too.
Messages are getting a much welcome update to tapbacks. You can now react to messages with any emoji or sticker and they’ll appear in color (pretty much like in every other messaging apps). You’ll be able to send messages later and format text (underline, strikethrough, etc.). Apple is also adding RCS support to iOS 18. It was previously announced but the timeline was unclear. As a reminder, RCS is an update to the SMS protocol with more features, such as native group support.
Mail will also get new categories, a bit like Gmail categories so that promotions, newsletters and other transactional emails are hidden from your inbox. There’s also a new digest view that pulls all the relevant emails you’ve received, such as your flight information before heading to the airport.
Calendar is receiving a small update with an optional integration with Reminders. You can decide to view reminders directly in your calendar.
Wallet is getting new capabilities. You can Tap to Cash to pay someone back by holding your phone together. It uses Apple Cash behind the scenes to charge your card and send the money to your friend or family member. Event cards are receiving an update with more information about your event, such as a stadium map.
Journal, the recently introduced journaling app is receiving an update with insights and a new way to quickly find past entries. Game mode, a special mode that boosts device performances, is coming to the iPhone. It’s no longer limited to macOS.
The Photos app is receiving its annual update but this one is bigger than usual. It’s a complete redesign with a unified, single view. You get the good old photo grid at the top with years and months filters. There are buttons to filter out screenshots, zoom in and zoom out. It should be a bit easier to understand than the old design.
Below the grid, when you scroll down, you access collections that you can browse by topic: people, trips, favorite memories, etc. These memories were already available but hidden in a separate tab. But you can now reorganize collections, create pinned collections and customize the app to your favorite photos.
If you swipe left, you get an autoplaying video of favorite photos and videos. Apple is calling it the carousel and there will be new favorite moments to watch every day.
While this isn’t exactly an iOS 18 feature, the next release of macOS is going to feature iPhone mirroring. If you’re a Mac owner, you’ll be able to mirror your iPhone screen to your Mac. You can interact with your iPhone using your trackpad and keyboard. iOS notifications will also show up on your Mac.
iOS gets a new AI brain
All those new features are nice quality-of-life updates, but they only tell part of the story around iOS 18. Apple also unveiled Apple Intelligence at WWDC, its new “personal intelligence system” that will be used across all of Apple’s platforms.
“We’re tremendously excited about the power of generative models, and there are already some really impressive chat tools out there that perform a vast array of tasks using world knowledge, but these tools know very little about you or your needs,” Federighi said.
Apple Intelligence will enable your iPhone to understand languages and images on your device. It will be able to take actions based on your personal context.
And it starts with a new notification system. Your iPhone prioritizes your notifications that are more important. There’s a new smart focus mode that also lets you device decide to hide notifications automatically. But it expands to many areas of the operating system. If you’re writing something in Notes, Mail, Pages or third-party apps, Apple Intelligence can also help you write more clearly and make less mistakes. It’s a system-wide writing tool that helps you communicate more effectively by rewriting your text. Apple showed a cover letter as an example but users can also select a large block of text and ask Apple Intelligence to summarize the text.
In the Mail app, you can generate smart replies without having to type anything. Apple Intelligence will ask you basic questions, such as if you want to go this event or not. In the email list, Apple is rewriting the email previews to summarize the content of the email in just a couple of lines. There is a new feature to summarize the content of your inbox too.
Image Credits: Apple
Apple intelligence also adds new capabilities for images, from photos to emojis and GIFs. You can create AI-generated images with your friends and family members (just like Easel, a third-party app created by former Snap engineers and that we covered). It is based on the photos on your device and you can select between different styles, such as animation movie or illustration.
The company also unveiled Genmoji. These are emojis that you generate with a prompt and you can use in the Messages app. You can also generate emojis that look like your friends based on your photo library.
These AI-generated images will live in a new Image Playground. It will be available as an overlay on top of your app, such as Messages. But Apple is also going to ship a dedicated Image Playground app. Third-party developers will also be able to access and play with this Image Playground.
Photo editing in the Photos app has also been updated with a new AI-powered cleanup tool. These new AI capabilities also let you search through your library to find something very specific — it could be something that happens in the middle of a video.
While Siri has been around for many years, it’s not great. Apple is also updating Siri’s design. When you talk to Siri, it adds a line around your screen to show that you’re talking to Siri without hiding anything on your screen. You can get a weather pop-up, create an event or get instructions to send emails at a later date.
Image Credits: Apple
Siri will have the ability to take hundreds of new actions in and across apps. For instance, you can find an old photo from a family trip, tell Siri to make it pop more and add it to a note without touching your device. It’s a new interaction method based on App Intents, a framework that is already used for Siri, Shortcuts and other automation features. Third-party developers can build their own App Intents.
It will be interesting to test this new version of Siri when it’s available; the demos worked well in Apple’s prerecorded video. If you want to type with Siri, you can double tap the multitasking line at the bottom of the phone to pull up a conversation with Siri. This could be useful for multi-step requests like in ChatGPT.
Apple said that the company has built a ChatGPT integration powered by the GPT-4 model. It is built into Siri and the new system-wide writing tools. You’ll need to accept to share information with OpenAI when you want to talk to ChatGPT. All of Apple Intelligence’s feature will be available for free for now if you have an iPhone 15 Pro or later. You don’t need to create an OpenAI account to use the feature, but you can log in to unlock ChatGPT Plus features. The company says that it plans to integrate with other models in the future.
