ReportWire

Tag: wwdc 2024

  • Here’s everything Apple announced at the WWDC 2024 keynote, including Apple Intelligence, Siri makeover | TechCrunch

    Here’s everything Apple announced at the WWDC 2024 keynote, including Apple Intelligence, Siri makeover | TechCrunch

    [ad_1]

    It’s WWDC 2024 keynote time! Each year Apple kicks off its Worldwide Developers Conference with a few hours of just straight announcements, like the long-awaited Apple Intelligence and a makeover for smart AI assistant, Siri. We expected much of them to revolve around the company’s artificial intelligence ambitions (and here), and Apple didn’t disappoint. We also bring you news about Vision Pro and lots of feature refreshes. 

    Here’s how to watch the archive of WWDC 2024.

    Developers should expect hardware and software updates, per the usual, and some other items we initially thought would be unveiled. Brian Heater also went on Equity to dish. Now sit back and relax while the team runs down all of the biggest news in an easy-to-skim digest.

    Spotlight Search gets better at natural language queries in iOS 18

    Apple is making it easier for people to discover the content inside their apps using natural language — or “semantic” — queries. Already, Spotlight has been able to search for content in developers’ apps, but it would only return results when search terms matched exactly. With this year’s addition of semantic search capabilities, people will be able to search for content in apps using search terms that are just similar in meaning. Read more

    Here are the best WWDC 2024 features you missed

    Now that people are using developer betas and exploring the sessions at the event, more features that were not announced onstage are surfacing. Remember that only certain devices will be compatible with iOS 18 when it’s released later in the fall. Read more

    iOS 18 cracks down on apps asking for full address book access

    Instead, Apple is adding a new two-step permissions pop-up screen that will first ask users to allow or deny access to their contacts, as before, and then, if the user allows access, will allow them to choose which contacts they want to share, if not all. Read more

    Apple Watch is finally adding a feature I’ve been requesting for years

    Image credit: Apple
    Image Credits: Apple

    Brian Heater writes about consistently requesting this certain feature from Apple: the ability to pause your activity rings. If you’re down due to a cold, on an international flight, or find that you’re vigorously shaking your wrist at 9 p.m. just to finish closing your rings, you can now pause progress via the Watch or through the connected iPhone app. Read more

    The apps that Apple Sherlocked at WWDC 2024

    Apple has been on a spree of late, announcing a host of new features for its various devices earlier this week. But a lot of those features were already available to some extent on Apple devices through third-party apps. So, just like the past few years, we will examine the ideas that Apple “Sherlocked” in this year’s updates. Read more

    Why Apple is taking a small-model approach to generative AI

    The company has since revealed some of what makes its approach to generative AI different. First and foremost is scope. Many of the most prominent companies in the space take a “bigger is better” approach to their models. Read more

    Apple’s AI, Apple Intelligence, is boring and practical — that’s why it works

    Instead of trying to overwhelm users with too many AI features to count, the Cupertino tech giant is carefully rolling out AI where it believes it could be useful. That means the tech won’t be included where it could be much of a threat to the carefully crafted consumer experience of using an Apple device. Read more

    Apple’s Messages app will support RCS and scheduling texts

    Apple delivered two of the biggest features iMessage and its Messages app that consumers were wanting for a long time: the ability to schedule messages to send at a later date and time and support for RCS, the next-gen messaging standard and replacement for SMS that will make texting with Android folks much less painful. Is it the end of the green bubbles? Read more

    More App Store improvements

    Apple is giving developers more tools to increase their app revenues and promote their apps with win-back offers and the release of a new commerce API. Read more

    iOS 18 compatible devices

    Among the highlights of the new operating system version are a set of customization options, such as being able to arrange apps and widgets on the Home Screen and customize buttons. Other features include new text effects, the ability to lock and hide apps, new ways to manage your Mail inbox, the introduction of iMessages over satellite, a significant redesign of the Photos app and more. Now let’s see if your device is compatible. Read more

    All the Apple Intelligence news

    There was a lot, wasn’t there? Apple’s AI push was at the heart of WWDC 2024, and our AI expert Kyle Wiggers took some time to process all of the announcements before bringing together a guide to all of the news across Siri, Genmoji, ChatGPT integrations, photo editing and beyond. Read more

    Apple to work with AI partners beyond OpenAI

    In a post-keynote event, Apple SVP Craig Federighi confirmed that the company would work with other third-party models beyond OpenAI, with Google’s Gemini model being highlighted as the first example. He clarified that Apple had “nothing to announce right now, but that’s our general direction.” Read more

    Elon Musk lumps OpenAI, Apple together

    Tesla, SpaceX and xAI exec Elon Musk took to X to continue his campaign against rival OpenAI, threatening to ban Apple devices from his businesses “if Apple integrates OpenAI at the OS level,” among other responses and reactions to the conversations around WWDC on X. Read more

    Apple Intelligence’s (limited) availability

    Before you get too excited about putting Apple Intelligence to the test, check if your devices are new enough. Only the iPhone 15 Pro and 15 Pro Max, along with iPads and Macs with M1 or newer chips, will be able to run the new features coming alongside Apple’s AI push. Read more

    ChatGPT in Siri

    Apple is bringing ChatGPT, its AI-powered chatbot experience, to Siri and other Apple apps, powered by OpenAI’s GPT-4 and other generative AI models. Read more

    Apple Intelligence is an image and emoji playground

    Image Credits: Apple

    One of the Apple Intelligence-powered features coming in iOS 18 will allow iPhone users to create AI images of people they’re messaging with — a feature that works something like an AI-upgraded Bitmoji. The goal, of course, is to make your “everyday conversations more enjoyable.”

    Apple Intelligence will have an understanding of who you’re talking with in a messaging conversation, so if you want to personalize that chat with a custom AI image, you can create one on the fly. Read more

    Apple TV+

    Image Credits: Apple

    For those of you who use Apple TV+, there is a new feature called InSight. The feature will allow viewers to learn actor names and song titles as they appear on the screen. Lauren Forristal writes that it’s similar to Amazon’s X-Ray technology, where Fire TV users get an overview of actor bios and behind-the-scenes information while watching TV shows and movies.

    What stands out about InSight, however, is its Shazam-like functionality, which highlights the song playing in the TV show or movie and gives users the option to add it to an Apple Music playlist to listen to later. Read more

    Siri

    Image Credits: Apple

    Apple also made some enhancements to its smart assistant, Siri. These include adding some generative AI features that make Siri seem more natural and more personal. There’s also a new glowing light. And, Siri can also handle stumbles in speech and better understand context. Plus, for those who would rather type, you can do that now. Read more

    Apple Intelligence is here

    Image Credits: Apple

    The new feature is called Apple Intelligence (AI, get it?). The company promised the feature will be built with safety at its core, along with highly personalized experiences.

    “Most importantly, it has to understand you and be grounded in your personal context, like your routine, your relationships, your communications and more,” CEO Tim Cook noted at WWDC Monday. “And of course, it has to be built with privacy from the ground up together. All of this goes beyond artificial intelligence. It’s personal intelligence, and it’s the next big step for Apple.” Read more

    That covers the consumer side of things, but WWDC is a conference for developers, and Apple revealed how developers will soon be able to bring the Apple Intelligence experience into their software. A number of AI features will be added to existing SDKs, allowing for generative AI image generation, or new prompts to Siri, to allow devs to expand the Apple Intelligence footprint. Read more

    Apple’s new Passwords app

    Image Credits: Apple

    While you can already use your iCloud account to store and sync passwords across your devices, it wasn’t easy to figure out. Now, the company introduced a Passwords app. Some of the features include a new column on the left that lets you more easily navigate your password collection. For instance, you can view all your passwords or just Wi-Fi passwords (a new addition), passkeys or codes that aren’t related to a website or service. Read more

    Smart Script in iPad

    Image Credits: Apple

    A new “Smart Script” feature will clean up your handwriting when using an Apple Pencil to write in Notes. Apple says it’s making handwriting your notes even smoother and straighter. The feature improves the appearance of your writing as you write by using on-device machine learning to recreate your handwriting from your notes. You’ll see your own handwriting, just smoother and more legible. Read more

    Calculator for iPad

    Apple
    Image Credits: Apple

    Who would have thought a calculator would liven up a developer’s conference? Well, Apple’s new Calculator for iPad app got everyone excited.

    iOS’ perennial tips calculating app is finally coming to the larger screen. The feature utilizes the additional screen real estate to bring new features that the company couldn’t really jam into the iPhone. The biggest arrival here is the addition of Math Notes. The additional feature does the math for you. Read more

    macOS Sequoia

    Apple
    Image Credits: Apple

    The latest operating system version is called macOS Sequoia.

    One of the biggest features of this new OS is iPhone mirroring. Now, through macOS’ Continuity feature, you can mirror your iPhone’s screen and control it right from your Mac. Notifications on Mac pop you into iPhone mirror mode, and iPhone audio comes through the Mac as well, but the paired iPhone stays locked while in mirror mode. Read more

    OK, let’s do a little deeper dive into iPhone mirroring. While Apple didn’t detail many use cases for the feature, Sarah Perez writes that it seems it would make it easier to demo apps over video calls or in person, as users could move between a slideshow presentation and a live demo of the iPhone app by launching it as if it’s another app on your Mac. Read more

    Messages via Satellite

    Image Credits: Apple

    This new feature works much like Apple’s emergency SOS feature. When you have no signal, you’ll be given the option to find a satellite to relay the data. You’ll have to keep the phone pointed in the right direction while you do it, however, there’s an overlay above your messages to remind you. Read more

    Photos app

    Image Credits: Apple

    Apple showed off the new Photos app as it will appear in the upcoming release of the iOS software. The new app introduces new navigation, new organizational features and other ways to discover your favorite photos, including those of friends, family, pets, trips and more.

    Some things to know: The new design will lead to less time searching for photos as it puts everything you need within easy reach.

    One major change involves how the app has been unified into a single view with the photo grid at the top and the library, organized by theme, below. Read more

    Tap to Cash

    One of the more interesting additions is Tap to Cash, which is more or less what it sounds like, letting users pay for things by tapping together a pair of iPhones.

    As Brian Heater writes, the feature is effectively an outgrowth of Apple Pay’s longstanding Tap to Pay feature. Similarly, the new addition likely uses the device’s NFC functionality. Apple notes that the feature transfers money without having to share any personal info — a nice added privacy element. Read more

    iOS 18

    Image Credits: Apple

    Users will now be able to lock an app when they hand over their phone to do things like show someone a picture or let them play a game. When you lock an app, if someone tries to tap your phone, they will be required to authenticate using Face ID, Touch ID or their passcode. While you have the app lock feature enabled, information from inside the app won’t appear in other places, like search and notifications. Read more

    Apple also shared some initial details for the upcoming major release of iOS, which is its operating system specifically designed for the iPhone. As expected, much of this involves artificial intelligence. Remember when icons were locked to the grid? Well, they can now be laid out however you want on your home screen so that they don’t hide your background photos.

    “iOS 18 is a big release that delivers more ways to customize your iPhone, stay connected and relive special moments,” Apple SVP of software engineering Craig Federighi said. Read more

    Speaking of icons, most of these updates are those long-requested functionalities, like the ability to set app icons and widgets wherever you want on the Home Screen, plus support for dark mode icons with different color schemes. Read more

    visionOS 2

    VisionOS 2's updates, as seen from WWDC 2024
    Image Credits: Apple

    visionOS 2 brings with it productivity enhancements and “new immersive experiences.” One lets you “spatialize” photos from regular photos, leveraging AI tech. Another is a new navigation option: visionOS 2 lets you switch to the home screen by just tapping, or flip your hand over to bring up the control center with notifications, shortcuts and more. Read more

    One of the bigger announcements with this includes the ability to turn existing images into spatial photos. The new feature utilizes machine learning to build out additional angles, marking a change from the existing method, which required images to be shot on an iPhone 15 Pro or the Vision Pro itself. Read more

    For those of you outside of the U.S., the Vision Pro headset will be available in eight new countries. Read more

    Useful AI, not flashy AI

    Apple has fallen behind its peers in the AI race, and it probably feels like it needs to pull out all the stops to impress fans and shareholders. But that shouldn’t mean overpromising on features. Read more

    Generative AI

    For smart assistants: While rumors point to the company transitioning a number of employees to generative AI operations following its electric car implosion, all signs point to Apple having ceded a significant head start to the competition. As such, its most logical play is a partnership with a reigning powerhouse like OpenAI. Read more

    Maybe not for iPhone 15: Some other rumors say that when this generative AI comes into play, a limited number of older devices will also be able to run the system, including iPads and Macs running an M1 chip or higher and the iPhone 15 Pro. That means the standard iPhone 15 may be left out in the cold on this one. Read more

    [ad_2]

    Christine Hall

    Source link

  • Here’s everything Apple announced at the WWDC 2024 keynote, including Apple Intelligence, Siri makeover | TechCrunch

    Here’s everything Apple announced at the WWDC 2024 keynote, including Apple Intelligence, Siri makeover | TechCrunch

    [ad_1]

    It’s WWDC 2024 keynote time! Each year Apple kicks off its Worldwide Developers Conference with a few hours of just straight announcements, like the long-awaited Apple Intelligence and a makeover for smart AI assistant, Siri. We expected much of them to revolve around the company’s artificial intelligence ambitions (and here), and Apple didn’t disappoint. We also bring you news about Vision Pro and lots of feature refreshes. 

    Here’s how to watch the archive of WWDC 2024.

    Developers should expect hardware and software updates, per the usual, and some other items we initially thought would be unveiled. Brian Heater also went on Equity to dish. Now sit back and relax while the team runs down all of the biggest news in an easy-to-skim digest.

    Apple’s Messages app will support RCS and scheduling texts

    Apple delivered two of the biggest features iMessage and its Messages app that consumers were wanting for a long time: the ability to schedule messages to send at a later date and time and support for RCS, the next-gen messaging standard and replacement for SMS that will make texting with Android folks much less painful. Is it the end of the green bubbles? Read more

    More App Store improvements

    Apple is giving developers more tools to increase their app revenues and promote their apps with win-back offers and the release of a new commerce API. Read more

    iOS 18 compatible devices

    Among the highlights of the new operating system version are a set of customization options, such as being able to arrange apps and widgets on the Home Screen and customize buttons. Other features include new text effects, the ability to lock and hide apps, new ways to manage your Mail inbox, the introduction of iMessages over satellite, a significant redesign of the Photos app and more. Now let’s see if your device is compatible. Read more

    All the Apple Intelligence news

    There was a lot, wasn’t there? Apple’s AI push was at the heart of WWDC 2024, and our AI expert Kyle Wiggers took some time to process all of the announcements before bringing together a guide to all of the news across Siri, Genmoji, ChatGPT integrations, photo editing and beyond. Read more

    Apple to work with AI partners beyond OpenAI

    In a post-keynote event, Apple SVP Craig Federighi confirmed that the company would work with other third-party models beyond OpenAI, with Google’s Gemini model being highlighted as the first example. He clarified that Apple had “nothing to announce right now, but that’s our general direction.” Read more

    Elon Musk lumps OpenAI, Apple together

    Tesla, SpaceX and xAI exec Elon Musk took to X to continue his campaign against rival OpenAI, threatening to ban Apple devices from his businesses “if Apple integrates OpenAI at the OS level,” among other responses and reactions to the conversations around WWDC on X. Read more

    Apple Intelligence’s (limited) availability

    Before you get too excited about putting Apple Intelligence to the test, check if your devices are new enough. Only the iPhone 15 Pro and 15 Pro Max, along with iPads and Macs with M1 or newer chips, will be able to run the new features coming alongside Apple’s AI push. Read more

    ChatGPT in Siri

    Apple is bringing ChatGPT, its AI-powered chatbot experience, to Siri and other Apple apps, powered by OpenAI’s GPT-4 and other generative AI models. Read more

    Apple Intelligence is an image and emoji playground

    Image Credits: Apple

    One of the Apple Intelligence-powered features coming in iOS 18 will allow iPhone users to create AI images of people they’re messaging with — a feature that works something like an AI-upgraded Bitmoji. The goal, of course, is to make your “everyday conversations more enjoyable.”

    Apple Intelligence will have an understanding of who you’re talking with in a messaging conversation, so if you want to personalize that chat with a custom AI image, you can create one on the fly. Read more

    Apple TV+

    Image Credits: Apple

    For those of you who use Apple TV+, there is a new feature called InSight. The feature will allow viewers to learn actor names and song titles as they appear on the screen. Lauren Forristal writes that it’s similar to Amazon’s X-Ray technology, where Fire TV users get an overview of actor bios and behind-the-scenes information while watching TV shows and movies.

    What stands out about InSight, however, is its Shazam-like functionality, which highlights the song playing in the TV show or movie and gives users the option to add it to an Apple Music playlist to listen to later. Read more

    Siri

    Image Credits: Apple

    Apple also made some enhancements to its smart assistant, Siri. These include adding some generative AI features that make Siri seem more natural and more personal. There’s also a new glowing light. And, Siri can also handle stumbles in speech and better understand context. Plus, for those who would rather type, you can do that now. Read more

    Apple Intelligence is here

    Image Credits: Apple

    The new feature is called Apple Intelligence (AI, get it?). The company promised the feature will be built with safety at its core, along with highly personalized experiences.

    “Most importantly, it has to understand you and be grounded in your personal context, like your routine, your relationships, your communications and more,” CEO Tim Cook noted at WWDC Monday. “And of course, it has to be built with privacy from the ground up together. All of this goes beyond artificial intelligence. It’s personal intelligence, and it’s the next big step for Apple.” Read more

    That covers the consumer side of things, but WWDC is a conference for developers, and Apple revealed how developers will soon be able to bring the Apple Intelligence experience into their software. A number of AI features will be added to existing SDKs, allowing for generative AI image generation, or new prompts to Siri, to allow devs to expand the Apple Intelligence footprint. Read more

    Apple’s new Passwords app

    Image Credits: Apple

    While you can already use your iCloud account to store and sync passwords across your devices, it wasn’t easy to figure out. Now, the company introduced a Passwords app. Some of the features include a new column on the left that lets you more easily navigate your password collection. For instance, you can view all your passwords or just Wi-Fi passwords (a new addition), passkeys or codes that aren’t related to a website or service. Read more

    Smart Script in iPad

    Image Credits: Apple

    A new “Smart Script” feature will clean up your handwriting when using an Apple Pencil to write in Notes. Apple says it’s making handwriting your notes even smoother and straighter. The feature improves the appearance of your writing as you write by using on-device machine learning to recreate your handwriting from your notes. You’ll see your own handwriting, just smoother and more legible. Read more

    Calculator for iPad

    Apple
    Image Credits: Apple

    Who would have thought a calculator would liven up a developer’s conference? Well, Apple’s new Calculator for iPad app got everyone excited.

    iOS’ perennial tips calculating app is finally coming to the larger screen. The feature utilizes the additional screen real estate to bring new features that the company couldn’t really jam into the iPhone. The biggest arrival here is the addition of Math Notes. The additional feature does the math for you. Read more

    macOS Sequoia

    Apple
    Image Credits: Apple

    The latest operating system version is called macOS Sequoia.

    One of the biggest features of this new OS is iPhone mirroring. Now, through macOS’ Continuity feature, you can mirror your iPhone’s screen and control it right from your Mac. Notifications on Mac pop you into iPhone mirror mode, and iPhone audio comes through the Mac as well, but the paired iPhone stays locked while in mirror mode. Read more

    OK, let’s do a little deeper dive into iPhone mirroring. While Apple didn’t detail many use cases for the feature, Sarah Perez writes that it seems it would make it easier to demo apps over video calls or in person, as users could move between a slideshow presentation and a live demo of the iPhone app by launching it as if it’s another app on your Mac. Read more

    Messages via Satellite

    Image Credits: Apple

    This new feature works much like Apple’s emergency SOS feature. When you have no signal, you’ll be given the option to find a satellite to relay the data. You’ll have to keep the phone pointed in the right direction while you do it, however, there’s an overlay above your messages to remind you. Read more

    Photos app

    Image Credits: Apple

    Apple showed off the new Photos app as it will appear in the upcoming release of the iOS software. The new app introduces new navigation, new organizational features and other ways to discover your favorite photos, including those of friends, family, pets, trips and more.

    Some things to know: The new design will lead to less time searching for photos as it puts everything you need within easy reach.

    One major change involves how the app has been unified into a single view with the photo grid at the top and the library, organized by theme, below. Read more

    Tap to Cash

    One of the more interesting additions is Tap to Cash, which is more or less what it sounds like, letting users pay for things by tapping together a pair of iPhones.

    As Brian Heater writes, the feature is effectively an outgrowth of Apple Pay’s longstanding Tap to Pay feature. Similarly, the new addition likely uses the device’s NFC functionality. Apple notes that the feature transfers money without having to share any personal info — a nice added privacy element. Read more

    iOS 18

    Image Credits: Apple

    Users will now be able to lock an app when they hand over their phone to do things like show someone a picture or let them play a game. When you lock an app, if someone tries to tap your phone, they will be required to authenticate using Face ID, Touch ID or their passcode. While you have the app lock feature enabled, information from inside the app won’t appear in other places, like search and notifications. Read more

    Apple also shared some initial details for the upcoming major release of iOS, which is its operating system specifically designed for the iPhone. As expected, much of this involves artificial intelligence. Remember when icons were locked to the grid? Well, they can now be laid out however you want on your home screen so that they don’t hide your background photos.

    “iOS 18 is a big release that delivers more ways to customize your iPhone, stay connected and relive special moments,” Apple SVP of software engineering Craig Federighi said. Read more

    Speaking of icons, most of these updates are those long-requested functionalities, like the ability to set app icons and widgets wherever you want on the Home Screen, plus support for dark mode icons with different color schemes. Read more

    visionOS 2

    VisionOS 2's updates, as seen from WWDC 2024
    Image Credits: Apple

    visionOS 2 brings with it productivity enhancements and “new immersive experiences.” One lets you “spatialize” photos from regular photos, leveraging AI tech. Another is a new navigation option: visionOS 2 lets you switch to the home screen by just tapping, or flip your hand over to bring up the control center with notifications, shortcuts and more. Read more

    One of the bigger announcements with this includes the ability to turn existing images into spatial photos. The new feature utilizes machine learning to build out additional angles, marking a change from the existing method, which required images to be shot on an iPhone 15 Pro or the Vision Pro itself. Read more

    For those of you outside of the U.S., the Vision Pro headset will be available in eight new countries. Read more

    Useful AI, not flashy AI

    Apple has fallen behind its peers in the AI race, and it probably feels like it needs to pull out all the stops to impress fans and shareholders. But that shouldn’t mean overpromising on features. Read more

    Generative AI

    For smart assistants: While rumors point to the company transitioning a number of employees to generative AI operations following its electric car implosion, all signs point to Apple having ceded a significant head start to the competition. As such, its most logical play is a partnership with a reigning powerhouse like OpenAI. Read more

    Maybe not for iPhone 15: Some other rumors say that when this generative AI comes into play, a limited number of older devices will also be able to run the system, including iPads and Macs running an M1 chip or higher and the iPhone 15 Pro. That means the standard iPhone 15 may be left out in the cold on this one. Read more

    [ad_2]

    Christine Hall

    Source link

  • Here’s everything Apple announced at the WWDC 2024 keynote, including Apple Intelligence, Siri makeover | TechCrunch

    Here’s everything Apple announced at the WWDC 2024 keynote, including Apple Intelligence, Siri makeover | TechCrunch

    [ad_1]

    It’s WWDC 2024 keynote time! Each year Apple kicks off its Worldwide Developers Conference with a few hours of just straight announcements, like the long-awaited Apple Intelligence and a makeover for smart AI assistant, Siri. We expected much of them to revolve around the company’s artificial intelligence ambitions (and here), and Apple didn’t disappoint. We also bring you news about Vision Pro and lots of feature refreshes. 

    Here’s how to watch the archive of WWDC 2024.

    Developers should expect hardware and software updates, per the usual, and some other items we initially thought would be unveiled. Brian Heater also went on Equity to dish. Now sit back and relax while the team runs down all of the biggest news in an easy-to-skim digest.

    Apple to work with AI partners beyond OpenAI

    In a post-keynote event, Apple SVP Craig Federighi confirmed that the company would work with other third-party models beyond OpenAI, with Google’s Gemini model being highlighted as the first example. He clarified that Apple had “nothing to announce right now, but that’s our general direction.” Read more

    Elon Musk lumps OpenAI, Apple together

    Tesla, SpaceX and xAI exec Elon Musk took to X to continue his campaign against rival OpenAI, threatening to ban Apple devices from his businesses “if Apple integrates OpenAI at the OS level,” among other responses and reactions to the conversations around WWDC on X. Read more

    Apple Intelligence’s (limited) availability

    Before you get too excited about putting Apple Intelligence to the test, check if your devices are new enough. Only the iPhone 15 Pro and 15 Pro Max, along with iPads and Macs with M1 or newer chips, will be able to run the new features coming alongside Apple’s AI push. Read more

    ChatGPT in Siri

    Apple is bringing ChatGPT, its AI-powered chatbot experience, to Siri and other Apple apps, powered by OpenAI’s GPT-4 and other generative AI models. Read more

    Apple Intelligence is an image and emoji playground

    Image Credits: Apple

    One of the Apple Intelligence-powered features coming in iOS 18 will allow iPhone users to create AI images of people they’re messaging with — a feature that works something like an AI-upgraded Bitmoji. The goal, of course, is to make your “everyday conversations more enjoyable.”

    Apple Intelligence will have an understanding of who you’re talking with in a messaging conversation, so if you want to personalize that chat with a custom AI image, you can create one on the fly. Read more

    Apple TV+

    Image Credits: Apple

    For those of you who use Apple TV+, there is a new feature called InSight. The feature will allow viewers to learn actor names and song titles as they appear on the screen. Lauren Forristal writes that it’s similar to Amazon’s X-Ray technology, where Fire TV users get an overview of actor bios and behind-the-scenes information while watching TV shows and movies.

    What stands out about InSight, however, is its Shazam-like functionality, which highlights the song playing in the TV show or movie and gives users the option to add it to an Apple Music playlist to listen to later. Read more

    Siri

    Image Credits: Apple

    Apple also made some enhancements to its smart assistant, Siri. These include adding some generative AI features that make Siri seem more natural and more personal. There’s also a new glowing light. And, Siri can also handle stumbles in speech and better understand context. Plus, for those who would rather type, you can do that now. Read more

    Apple Intelligence is here

    Image Credits: Apple

    The new feature is called Apple Intelligence (AI, get it?). The company promised the feature will be built with safety at its core, along with highly personalized experiences.

    “Most importantly, it has to understand you and be grounded in your personal context, like your routine, your relationships, your communications and more,” CEO Tim Cook noted at WWDC Monday. “And of course, it has to be built with privacy from the ground up together. All of this goes beyond artificial intelligence. It’s personal intelligence, and it’s the next big step for Apple.” Read more

    That covers the consumer side of things, but WWDC is a conference for developers, and Apple revealed how developers will soon be able to bring the Apple Intelligence experience into their software. A number of AI features will be added to existing SDKs, allowing for generative AI image generation, or new prompts to Siri, to allow devs to expand the Apple Intelligence footprint. Read more

    Apple’s new Passwords app

    Image Credits: Apple

    While you can already use your iCloud account to store and sync passwords across your devices, it wasn’t easy to figure out. Now, the company introduced a Passwords app. Some of the features include a new column on the left that lets you more easily navigate your password collection. For instance, you can view all your passwords or just Wi-Fi passwords (a new addition), passkeys or codes that aren’t related to a website or service. Read more

    Smart Script in iPad

    Image Credits: Apple

    A new “Smart Script” feature will clean up your handwriting when using an Apple Pencil to write in Notes. Apple says it’s making handwriting your notes even smoother and straighter. The feature improves the appearance of your writing as you write by using on-device machine learning to recreate your handwriting from your notes. You’ll see your own handwriting, just smoother and more legible. Read more

    Calculator for iPad

    Apple
    Image Credits: Apple

    Who would have thought a calculator would liven up a developer’s conference? Well, Apple’s new Calculator for iPad app got everyone excited.

    iOS’ perennial tips calculating app is finally coming to the larger screen. The feature utilizes the additional screen real estate to bring new features that the company couldn’t really jam into the iPhone. The biggest arrival here is the addition of Math Notes. The additional feature does the math for you. Read more

    macOS Sequoia

    Apple
    Image Credits: Apple

    The latest operating system version is called macOS Sequoia.

    One of the biggest features of this new OS is iPhone mirroring. Now, through macOS’ Continuity feature, you can mirror your iPhone’s screen and control it right from your Mac. Notifications on Mac pop you into iPhone mirror mode, and iPhone audio comes through the Mac as well, but the paired iPhone stays locked while in mirror mode. Read more

    OK, let’s do a little deeper dive into iPhone mirroring. While Apple didn’t detail many use cases for the feature, Sarah Perez writes that it seems it would make it easier to demo apps over video calls or in person, as users could move between a slideshow presentation and a live demo of the iPhone app by launching it as if it’s another app on your Mac. Read more

    Messages via Satellite

    Image Credits: Apple

    This new feature works much like Apple’s emergency SOS feature. When you have no signal, you’ll be given the option to find a satellite to relay the data. You’ll have to keep the phone pointed in the right direction while you do it, however, there’s an overlay above your messages to remind you. Read more

    Photos app

    Image Credits: Apple

    Apple showed off the new Photos app as it will appear in the upcoming release of the iOS software. The new app introduces new navigation, new organizational features and other ways to discover your favorite photos, including those of friends, family, pets, trips and more.

    Some things to know: The new design will lead to less time searching for photos as it puts everything you need within easy reach.

    One major change involves how the app has been unified into a single view with the photo grid at the top and the library, organized by theme, below. Read more

    Tap to Cash

    One of the more interesting additions is Tap to Cash, which is more or less what it sounds like, letting users pay for things by tapping together a pair of iPhones.

    As Brian Heater writes, the feature is effectively an outgrowth of Apple Pay’s longstanding Tap to Pay feature. Similarly, the new addition likely uses the device’s NFC functionality. Apple notes that the feature transfers money without having to share any personal info — a nice added privacy element. Read more

    iOS 18

    Image Credits: Apple

    Users will now be able to lock an app when they hand over their phone to do things like show someone a picture or let them play a game. When you lock an app, if someone tries to tap your phone, they will be required to authenticate using Face ID, Touch ID or their passcode. While you have the app lock feature enabled, information from inside the app won’t appear in other places, like search and notifications. Read more

    Apple also shared some initial details for the upcoming major release of iOS, which is its operating system specifically designed for the iPhone. As expected, much of this involves artificial intelligence. Remember when icons were locked to the grid? Well, they can now be laid out however you want on your home screen so that they don’t hide your background photos.

    “iOS 18 is a big release that delivers more ways to customize your iPhone, stay connected and relive special moments,” Apple SVP of software engineering Craig Federighi said. Read more

    Speaking of icons, most of these updates are those long-requested functionalities, like the ability to set app icons and widgets wherever you want on the Home Screen, plus support for dark mode icons with different color schemes. Read more

    visionOS 2

    VisionOS 2's updates, as seen from WWDC 2024
    Image Credits: Apple

    visionOS 2 brings with it productivity enhancements and “new immersive experiences.” One lets you “spatialize” photos from regular photos, leveraging AI tech. Another is a new navigation option: visionOS 2 lets you switch to the home screen by just tapping, or flip your hand over to bring up the control center with notifications, shortcuts and more. Read more

    One of the bigger announcements with this includes the ability to turn existing images into spatial photos. The new feature utilizes machine learning to build out additional angles, marking a change from the existing method, which required images to be shot on an iPhone 15 Pro or the Vision Pro itself. Read more

    For those of you outside of the U.S., the Vision Pro headset will be available in eight new countries. Read more

    Useful AI, not flashy AI

    Apple has fallen behind its peers in the AI race, and it probably feels like it needs to pull out all the stops to impress fans and shareholders. But that shouldn’t mean overpromising on features. Read more

    Generative AI

    For smart assistants: While rumors point to the company transitioning a number of employees to generative AI operations following its electric car implosion, all signs point to Apple having ceded a significant head start to the competition. As such, its most logical play is a partnership with a reigning powerhouse like OpenAI. Read more

    Maybe not for iPhone 15: Some other rumors say that when this generative AI comes into play, a limited number of older devices will also be able to run the system, including iPads and Macs running an M1 chip or higher and the iPhone 15 Pro. That means the standard iPhone 15 may be left out in the cold on this one. Read more

    [ad_2]

    Christine Hall

    Source link

  • Apple unveils iOS 18 with tons of AI-powered features | TechCrunch

    Apple unveils iOS 18 with tons of AI-powered features | TechCrunch

    [ad_1]

    Apple shared the first details for the upcoming major release of iOS, its operating system specifically designed for the iPhone, at WWDC 2024.

    As expected, this is a pivotal moment for the mobile platform as iOS 18 is going to focus on artificial intelligence.

    “I’m excited that we’ll introduce profound new intelligence capabilities that we hope will inspire developers, delight users, and make our platforms even smarter and more useful than ever,” Apple CEO Tim Cook said during its introduction of the event. Later in the presentation, Apple announced that it is integrating ChatGPT into Siri and other system-wide interactions.

    But before talking about AI, Apple mentioned new customization features. Icons can now be laid out however you want on your home screen so that they don’t hide your background photos.

    “iOS 18 is a big release that delivers more ways to customize your iPhone, stay connected and relive special moments,” said Apple SVP of software engineering Craig Federighi.

    Icons can be customized with a tint color. For instance, if you want all your icons to look yellow, you can tint all app icons to this color.

    Control Center is also getting an update. It isn’t limited to just the buttons you see on the main control center page. You can swipe down to view media playback and home controls. You can also edit Control Center from Control Center directly by tapping on an edit button in a corner.

    There is a new set of APIs for Control Center, meaning that third-party developers will be able to create Control Center and lock screen shortcuts. For instance, Apple showed that you can replace the camera button on the lock screen with a Snapchat button.

    Apps can now be individually locked. This way, you need to identify with Face ID, Touch ID or your passcode to unlock this app. This app also doesn’t appear in search results. Being able to hide apps will be important for AI features, too.

    Messages are getting a much welcome update to tapbacks. You can now react to messages with any emoji or sticker and they’ll appear in color (pretty much like in every other messaging apps). You’ll be able to send messages later and format text (underline, strikethrough, etc.). Apple is also adding RCS support to iOS 18. It was previously announced but the timeline was unclear. As a reminder, RCS is an update to the SMS protocol with more features, such as native group support.

    Mail will also get new categories, a bit like Gmail categories so that promotions, newsletters and other transactional emails are hidden from your inbox. There’s also a new digest view that pulls all the relevant emails you’ve received, such as your flight information before heading to the airport.

    Calendar is receiving a small update with an optional integration with Reminders. You can decide to view reminders directly in your calendar.

    Wallet is getting new capabilities. You can Tap to Cash to pay someone back by holding your phone together. It uses Apple Cash behind the scenes to charge your card and send the money to your friend or family member. Event cards are receiving an update with more information about your event, such as a stadium map.

    Journal, the recently introduced journaling app is receiving an update with insights and a new way to quickly find past entries. Game mode, a special mode that boosts device performances, is coming to the iPhone. It’s no longer limited to macOS.

    The Photos app is receiving its annual update but this one is bigger than usual. It’s a complete redesign with a unified, single view. You get the good old photo grid at the top with years and months filters. There are buttons to filter out screenshots, zoom in and zoom out. It should be a bit easier to understand than the old design.

    Below the grid, when you scroll down, you access collections that you can browse by topic: people, trips, favorite memories, etc. These memories were already available but hidden in a separate tab. But you can now reorganize collections, create pinned collections and customize the app to your favorite photos.

    If you swipe left, you get an autoplaying video of favorite photos and videos. Apple is calling it the carousel and there will be new favorite moments to watch every day.

    While this isn’t exactly an iOS 18 feature, the next release of macOS is going to feature iPhone mirroring. If you’re a Mac owner, you’ll be able to mirror your iPhone screen to your Mac. You can interact with your iPhone using your trackpad and keyboard. iOS notifications will also show up on your Mac.

    iOS gets a new AI brain

    All those new features are nice quality-of-life updates, but they only tell part of the story around iOS 18. Apple also unveiled Apple Intelligence at WWDC, its new “personal intelligence system” that will be used across all of Apple’s platforms.

    “We’re tremendously excited about the power of generative models, and there are already some really impressive chat tools out there that perform a vast array of tasks using world knowledge, but these tools know very little about you or your needs,” Federighi said.

    Apple Intelligence will enable your iPhone to understand languages and images on your device. It will be able to take actions based on your personal context.

    And it starts with a new notification system. Your iPhone prioritizes your notifications that are more important. There’s a new smart focus mode that also lets you device decide to hide notifications automatically. But it expands to many areas of the operating system. If you’re writing something in Notes, Mail, Pages or third-party apps, Apple Intelligence can also help you write more clearly and make less mistakes. It’s a system-wide writing tool that helps you communicate more effectively by rewriting your text. Apple showed a cover letter as an example but users can also select a large block of text and ask Apple Intelligence to summarize the text.

    In the Mail app, you can generate smart replies without having to type anything. Apple Intelligence will ask you basic questions, such as if you want to go this event or not. In the email list, Apple is rewriting the email previews to summarize the content of the email in just a couple of lines. There is a new feature to summarize the content of your inbox too.

    Image Credits: Apple

    Apple intelligence also adds new capabilities for images, from photos to emojis and GIFs. You can create AI-generated images with your friends and family members (just like Easel, a third-party app created by former Snap engineers and that we covered). It is based on the photos on your device and you can select between different styles, such as animation movie or illustration.

    The company also unveiled Genmoji. These are emojis that you generate with a prompt and you can use in the Messages app. You can also generate emojis that look like your friends based on your photo library.

    These AI-generated images will live in a new Image Playground. It will be available as an overlay on top of your app, such as Messages. But Apple is also going to ship a dedicated Image Playground app. Third-party developers will also be able to access and play with this Image Playground.

    Photo editing in the Photos app has also been updated with a new AI-powered cleanup tool. These new AI capabilities also let you search through your library to find something very specific — it could be something that happens in the middle of a video.

    Of course, Apple Intelligence will also boost Siri’s capabilities. You can say things like “find this file that Arthur shared with me last week” or “show me photos of Tim and me”.

    While Siri has been around for many years, it’s not great. Apple is also updating Siri’s design. When you talk to Siri, it adds a line around your screen to show that you’re talking to Siri without hiding anything on your screen. You can get a weather pop-up, create an event or get instructions to send emails at a later date.

    Image Credits: Apple

    Siri will have the ability to take hundreds of new actions in and across apps. For instance, you can find an old photo from a family trip, tell Siri to make it pop more and add it to a note without touching your device. It’s a new interaction method based on App Intents, a framework that is already used for Siri, Shortcuts and other automation features. Third-party developers can build their own App Intents.

    It will be interesting to test this new version of Siri when it’s available; the demos worked well in Apple’s prerecorded video. If you want to type with Siri, you can double tap the multitasking line at the bottom of the phone to pull up a conversation with Siri. This could be useful for multi-step requests like in ChatGPT.

    Apple said that the company has built a ChatGPT integration powered by the GPT-4 model. It is built into Siri and the new system-wide writing tools. You’ll need to accept to share information with OpenAI when you want to talk to ChatGPT. All of Apple Intelligence’s feature will be available for free for now if you have an iPhone 15 Pro or later. You don’t need to create an OpenAI account to use the feature, but you can log in to unlock ChatGPT Plus features. The company says that it plans to integrate with other models in the future.

    Image Credits: Apple

    [ad_2]

    Romain Dillet

    Source link

  • Apple to release Vision Pro in international markets | TechCrunch

    Apple to release Vision Pro in international markets | TechCrunch

    [ad_1]

    Apple announced at WWDC 2024 that it’s making its Vision Pro headset available in eight new countries: China, Japan, Singapore, Australia, Canada, France, Germany and the United Kingdom.

    Apple will first release the headset in China, Japan and Singapore on June 28, with preorders starting June 13. The Vision Pro will be available in Australia, Canada, France, Germany and the U.K. on July 12, with preorders starting June 28.

    Until now, the company has offered a headset for $3,499 in the U.S. Plus, developers could experience the Vision Pro in some locations worldwide.

    “The enthusiasm for Apple Vision Pro has been extraordinary, and we are thrilled to introduce the magic of spatial computing to more customers around the world,” Apple CEO Tim Cook said.

    “We can’t wait for more people to see the impossible become possible, whether working and collaborating with an infinite canvas for apps, reliving treasured memories in three dimensions, watching TV shows and movies in a one-of-a-kind personal cinema, or enjoying brand-new spatial experiences that defy imagination.”

    Apple also released VisionOS 2 on Monday with “spatialized” photos and support for trains in the travel mode.

    [ad_2]

    Ivan Mehta

    Source link

  • Siri and Google Assistant look to generative AI for a new lease on life | TechCrunch

    Siri and Google Assistant look to generative AI for a new lease on life | TechCrunch

    [ad_1]

    There’s a lot riding on next week’s WWDC 2024 keynote. The presentation’s stakes are far higher than your standard post-event market moves. The pressure for Tim Cook and crew to deliver the goods is, in a very real sense, even higher than it was in the lead up to last year’s Vision Pro announcement.

    On Monday, Apple will lay out its AI plans. The subject has been a massive question mark looming over Cupertino for the last few years, as competitors like Google and Microsoft have embraced generative AI. There’s a broad industry consensus that systems powered by large language models like ChatGPT and Gemini will profoundly affect how we interact with our devices.

    Apple is expected to announce a partnership with OpenAI that will bring the company’s smarts to the iPhone and Mac. Apple’s near-term strategy is a deep integration between existing properties and generative AI, with Siri at the center. Since its debut in 2011, Apple has pushed to make the voice assistant an integral part of all its operating systems.

    In the intervening 13 years, however, Siri has fallen short of the revolution Apple promised. There are plenty of reasons for this, though the primary is capability. The concept of an artificial voice assistant pre-dates Siri by decades, but no one fully cracked it for a reason. As phone makers and app developers have transformed smartphones into everything devices, these assistants’ jobs have become increasingly complex.

    As impressive as the Stanford Research Institute’s work was, the technology required for a frictionless experience simply wasn’t ready. Siri co-founder Norman Winarsky addressed the underlying issue in 2018, noting that Apple’s initial plan was a far more limited assistant that handled things like entertainment and travel. “These are hard problems, and when you’re a company dealing with up to a billion people, the problems get harder yet,” Winarsky noted at the time. “They’re probably looking for a level of perfection they can’t get.”

    Generative AI isn’t at that level of perfection, either — not yet, at least. Hallucinations are still a problem. That’s precisely why, even after the massive buzz of the past few years, it still feels like we’re very much in the baby steps phase. If anything, I would say that Google, for one, has been overly aggressive in places. The best example of this is the company’s decision to surface Gemini results at the top of searches.

    When something is prioritized above trusted resources in the world’s dominate search engine, it needs to get things right as much as humanly possible, and not, you know, tell people to eat glue. Google labels Gemini results a product of its “Search Labs,” but surely a majority of users don’t understand what that means in terms of product maturity, nor can they be bothered to click through for more information.

    Over the past few years, I’ve met several researchers who have used the term “magic” to describe the results of “black box” surrounding large language models. This isn’t a knock against all of the amazing work happening in the space, so much as a realization that there’s still so much we don’t know about the technology.

    Arthur C. Clarke put it best: “Any sufficiently advanced technology is indistinguishable from magic.”

    One place Google has been more intentional, however, is with its integration of Gemini into Android. Rather than replacing Assistant outright, Google has been integrating its generative AI platform into different applications. Users can also opt-in to making Gemini their default by assigning it to the Assistant button on Pixel devices. This implementation requires deliberate action on the user’s part at least thus far.

    While Gemini hasn’t completely conquered Android yet, however, Google is clearly signaling at a day in the not too distant future when it replaces Assistant outright. I half expected an announcement along those lines at I/O last month, though I’m glad it ultimately opted to give Gemini more time to bake.

    Whether the Assistant name sticks around is ultimately a branding decision. For its part, Apple is very wedded to the Siri name. It has, after all, spent well over a decade pitching the product to consumers. Sooner than later, however, generative AI will eat the smart assistant space.

    Voice assistants in general are having an existential moment. Smart speakers have a broader bellwether for platforms like Siri, Alexa and Google Assistant. Shipments have declined, after heating up during the pandemic. It’s unfair to characterize the category as doomed, but it will be in the long run, without the proper shot in the arm.

    Generative AI is poised to be the logical successor, but the first round of hardware devices built around these models, including the Humane Ai Pin and Rabbit R1, have only been testaments to how far the category has to go before it can be considered a consistent experience for mainstream users.

    Apple will finally show its hand on Monday. While rumors point to the company transitioning a number of employees to generative AI operations following its electric car implosion, all signs point to Apple having ceded a significant head start to the competition. As such, its most logical play is a partnership with a reigning powerhouse like OpenAI.

    Shortly after the Siri acquisition was announced, Steve Jobs was asked whether the company was trying to beat Google at its own game. “It’s an AI company,” Jobs noted. “We’re not going into the search business. We don’t care about it. Other people do it well.”

    The company’s approach to generative AI is currently in the same place. At this stage, Apple can’t beat OpenAI at its own game, so it’s partnering instead. But even the best of the current models have a way to go before they’re ready to fully replace the current crop of smart assistants.  

    [ad_2]

    Brian Heater

    Source link

  • Apple’s WWDC 2024 keynote is scheduled for June 10

    Apple’s WWDC 2024 keynote is scheduled for June 10

    [ad_1]

    Apple just announced that the 35th annual Worldwide Developers Conference (WWDC) is set to occur from June 10 until June 14. The WWDC 2024 keynote is scheduled for June 10 at the Apple Park campus in Cupertino, California. The remaining festivities are online and free for developers to attend.

    What should we expect at this year’s keynote? WWDC is typically a software-centric event, so we might hear some details on the work Apple has been doing around AI over the last year or so. Other reports indicate that Apple will show off a suite of upcoming updates, including iOS 18, iPadOS 18, tvOS 18, macOS 15 and watchOS 11, according to MacRumors. It’s also likely the company will reveal the next operating system for the recently-released Apple Vision Pro headset, visionOS 2.

    It’s even possible we’ll get some new hardware announcements. Though typically software-adjacent, last year’s WWDC was chock full of product announcements, from the aforementioned Vision Pro to the 15-inch M2 MacBook Air. The Mac Mini has been missing from recent product refreshes, so maybe the company will announce an M3-based update.

    As for the new software, there have been plenty of rumors regarding iOS 18. It has been reported that Apple might integrate Google’s Gemini AI with Siri and various iPhone apps. Check the suspicious capitalization of “Absolutely Incredible” in the above post from Apple’s VP of worldwide marketing Brad Joswiak for a winking acknowledgement of the move. It’s also been suggested that the smartphone software will allow users to place apps anywhere on the home screen grid and will offer RCS support in the Messages app, along with the usual array of design changes.

    The keynote event will be available on the Apple Developer app, the Apple website and YouTube. The company is also inviting 50 winners of its annual Swift Student Challenge to attend WWDC in person.

    This article contains affiliate links; if you click such a link and make a purchase, we may earn a commission.

    [ad_2]

    Lawrence Bonk

    Source link