Blackmagic is developing a camera for immersive Apple Vision Pro videos

At Apple's WWDC presentation this year, the company said it was working with Blackmagic Design to make immersive videos for the Vision Pro easier to work with and capture. Turns out Blackmagic is currently developing a camera specifically to capture immersive films for Apple's mixed-reality headset. The digital cinema company and manufacturer announced the Blackmagic URSA Cine Immersive camera on X/Twitter and made sure to add a few photos to give us a glimpse of what it would look like. 

It didn't share a lot of details about the device other than it's "designed to capture content for Apple Vision Pro" with 8,160 x 7,200 resolution per eye and "16 stops of dynamic range for 90fps stereoscopic 3D immersive cinema content." Based on the images Blackmagic attached to its post, users will even be able to strap the camera to a drone for aerial videos.

The company is hoping to release the camera sometime later this year, though it didn't say how much the device would cost. In the past, Blackmagic released a camera that can shoot in 12K for $9,995, which is much lower than what other comparable models cost. Last year, it unveiled its first full-frame model that can shoot video in 6K for $2,595. 

A camera against a white background.
Blackmagic Design

Blackmagic said it's also releasing an update of its DaVinci Resolve video editing app with changes that make creating Vision Pro content easier. On top of allowing editing of Vision Pro material, the app will introduce a "new immersive video viewer will let editors pan, tilt and roll clips for viewing on 2D monitors or on Apple Vision Pro for an even more immersive editing experience." It will also introduce a feature that removes transitions created by Vision Pro, along with presets that create a package that can be viewed directly on Vision Pro headsets. 

Apple showed off the new lens Canon is working on for its R7 camera at WWDC, as well. The 7.8mm f/4 dedicated spatial lens is also meant to capture content for the Apple Vision Pro. While the brand has previously released lenses for virtual reality, it said that none of its current cameras are fast enough to offer video that matches Apple's headset. Like Blackmagic's announcement, Canon's was light on details, though we'll most likely hear more information the nearer we get to the lens' release date. 

Catch up here for all the news out of Apple's WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/blackmagic-is-developing-a-camera-for-immersive-apple-vision-pro-videos-022834820.html?src=rss

How Apple Intelligence could avoid Microsoft and Google’s AI mistakes

Apple's spin on AI is finally here, and it already seems smarter than Microsoft Copilot and Google Bard. Apple Intelligence focuses on privacy and "personal intelligence," with a bit of an assist from ChatGPT. While we haven't tested it ourselves yet, Apple appears to be avoiding the pitfalls of Microsoft's Recall feature, as well as Google Bard's unfortunate early gaffes. The company isn't trying to capture everything you're doing on your computer, and it's being careful about how it's using larger AI models like ChatGPT. 

Shortly after the WWDC 2024 keynote ended, Engadget's Cherlynn Low and Devindra Hardawar discussed why they think Apple is taking a more thoughtful approach to AI.

This article originally appeared on Engadget at https://www.engadget.com/how-apple-intelligence-could-avoid-microsoft-and-googles-ai-mistakes-000751533.html?src=rss

How does Apple send your data to its cloud AI servers? Very carefully, it claims.

For years, Apple has touted privacy as its major advantage over rivals like Google and Microsoft. Instead of relying on cloud processing to improve or organize your images, which requires sending your photos to Google's servers, Apple handles those tasks directly on your device. But with the advent of Apple Intelligence, the company's take on artificial intelligence, the company is stepping out of its comfort zone with "Private Cloud Compute." It says "private" right in the name, so it has to be secure, right?

While Apple AI will run some models locally, it will occasionally have to send data to Apple's servers for complex requests. So how is the company squaring this with its previous security stance? 

According to Craig Federighi, Apple's SVP of Software Engineering, the company is being very careful about how its sending your data to its servers. "You're putting a lot of faith in the cloud... with Private Cloud Compute, the stakes are even higher," he said in a WWDC 2024 conversation with Apple's AI head, John Giannandrea, and YouTube influencer iJustine.

During the WWDC keynote, Federighi showed off how Apple AI could help him reschedule a meeting and determine if he could still attend his daughter's dance recital. Apple AI was able to determine who his daughter actually was, where her event was located, and the estimated travel time from his meeting.

Federighi says Apple isn't sending all of your data to the cloud, instead it's only uploading the most important bits of information relevant to your Apple AI query. Additionally, your server request is anonymous, since it's using the same IP masking technology as iCloud Private Relay. Federighi also noted that Apple's cloud servers have no permanent storage and don't have the ability to keep logs. 

To make things even more secure, Federighi says Private Cloud Compute servers are running software with published images for security researchers to audit. Apple Intelligence devices can only talk with servers running those approved images — if there are any changes to the servers, the local devices will also need to be updated to see them.

That process may a bit restrictive, but that's precisely the point. Federighi calls it "a step up" in the level of trust you can have with server computing. "It's essential that you know no one—not Apple, not anyone else, can access the information used to process your request," he said.  

This article originally appeared on Engadget at https://www.engadget.com/how-does-apple-send-your-data-to-its-cloud-ai-servers-very-carefully-it-claims-233312425.html?src=rss

Apple may integrate Google’s Gemini AI into iOS in the future

Apple is integrating GPT-4o, the large language model that powers ChatGPT into iOS 18, iPadOS 18 and MacOS Sequioa thanks to a partnership with OpenAI announced at WWDC, the company’s annual developer conference, on Monday. But shortly after the keynote ended, Craig Federighi, Apple’s senior vice president of software engineering said that the company might also bake in Gemini, Google’s family of large language model, into its operating systems.

“We want to enable users ultimately to choose the models they want, maybe Google Gemini in the future,” Federighi said in a conversation with YouTuber iJustine after the keynote. “Nothing to announce right now.”

The news is notable because even though Apple did mention plans to add more AI models into its operating system in the keynote, it didn’t mention Gemini specifically. Letting people choose the AI model they want on their devices instead of simply foisting one on them would give Apple devices a level of customization that none of its competitors like Google or Samsung have.

Catch up here for all the news out of Apple's WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/apple-may-integrate-googles-gemini-ai-into-ios-in-the-future-220240081.html?src=rss

Resident Evil 7 and the Resident Evil 2 remake are coming to iPhone, iPad and Mac

On a day when there were a few other Apple-related announcements, Capcom snuck in one of its own. Two more Resident Evil games are coming to iOS, iPadOS and macOS: Resident Evil 7 Biohazard, coming next month, and the Resident Evil 2 remake, which is “currently in development.” Capcom promises a “console quality experience” for the games, which run on the publisher’s RE Engine and use Apple’s MetalFX Upscaling tech.

The company says both games will have a free demo (for “a portion of each game”) at launch, but you’ll need to make “a single purchase” to unlock each title’s full experience. Capcom hasn’t announced pricing for the new games. For reference, the App Store’s current installments in the series, Resident Evil 4 and Resident Evil Village, cost $30 and $16, respectively (plus extra for optional DLC).

Speaking of downloadable content, Capcom says Resident Evil 7’s main game and Not A Hero DLC will launch together as a bundle. Optional DLC will include the Gold Edition upgrade, which includes End of Zoe, Banned Footage Vol. 1 and Vol. 2, the 5-Coin Set, Survival Pack and Madhouse difficulty mode.

The iOS and iPadOS versions of Resident Evil 7 will include “enhanced controls with a new Auto Fire feature.” The idea is to make the game more playable on touch screens with an option to automatically fire weapons after aiming at enemies for a set time. The game will also support MFi gamepads.

To play Resident Evil 7, you’ll need recent Apple devices. It only supports the iPhone 15 Pro series, iPads and Macs with Apple Silicon chips (M1 or later). Capcom hasn’t yet provided the hardware requirements for Resident Evil 2.

Resident Evil 7 Biohazard arrives on July 2, and Capcom says you can pre-order it today. However, it isn’t yet live in the App Store at the time of publication.

This article originally appeared on Engadget at https://www.engadget.com/resident-evil-7-and-the-resident-evil-2-remake-are-coming-to-iphone-ipad-and-mac-210355411.html?src=rss

In case there weren’t enough emoji already, Apple’s Genmoji uses AI to generate even more

Currently, Unicode 15.1 supports just shy of 3,800 various emoji. But for everyone out there that for some reason thinks that's not nearly enough, today at WWDC 2024, Apple announced the ability to use AI to generate unique emoji based on your prompts.

Called Genmoji, which looks to be an awful portmanteu of the words "generate" and "emoji," these new creations are powered by Apple Intelligence, which is a new collection of AI features coming to the iPhone, iPad and Mac sometime later this year. Similar to creating images with services like Midjourney and Dall-E, users will be able to whip up custom emoji by inputting specific prompts. Once made, they can be shared with others as stickers, reactions in a Tapback or simply embedded in-line in messages. 

A demo of Apple Intelligence being used to make a custom Genmoji.
Apple

While the feature isn't expected to be officially available until later this fall, there don't seem to be any major limitations to what you can dream up. In a teaser at WWDC, Apple showed examples like a smiley face with cucumbers over its eyes and a T-rex riding a skateboard while wearing a tutu. That said knowing Apple, there is sure to be some restrictions for Genmoji made using more graphic prompts like guns or blood. 

Now on some level, it could be fun to razz your friends with Genmoji based on their latest mishap. But at the same time, part of the magic of emoji has always been being able to convey a message using the limited number of icons while still getting your point across. Also, it's truly hard to imagine how much added value a bagel with lox Genmoji (see the lead picture above) provides compared to the classic image. But since AI is so hot right now, seeing Apple Intelligence get applied to emoji was probably an inevitability. 🤷‍♂️

This article originally appeared on Engadget at https://www.engadget.com/in-case-there-werent-enough-emoji-already-apples-genmoji-uses-ai-to-generate-even-more-200011608.html?src=rss

iOS 18 embraces Apple Intelligence, deeper customization and a more useful Siri

WWDC is always where we learn about the year's biggest updates to Apple's operating systems. Given that the iPhone is Apple's most important product, it's no surprise that iOS takes up a major chunk of the attention each June. WWDC 2024 is no exception, as Apple had a ton of new features and updates to go over, many of which concerned AI (or Apple Intelligence, as the company is calling it).

Apple Intelligence is all over iOS 18, as well as iPadOS 18 and macOS Sequoia. Apple is using a blend of its own tech and capabilities powered by OpenAI (as was widely expected). ChatGPT will be integrated into Apple Intelligence too.

As part of this new era, Siri is getting a major overhaul. The voice assistant will be able to get much more done as it will be more deeply integrated into your apps and have more contextual awareness. You'll be able to use Siri for things like photo editing, rewriting emails and prioritizing notifications. There's the option to type your Siri commands as well, which is a nice accessibility upgrade.

The language models will be able to rewrite, proofread and summarize text for you in apps such as Mail, Notes, Safari, Pages and Keynote, as well as third-party apps. Image generation will be available too in sketch, illustration and animation styles — so you won't be able to generate realistic images using Apple's tech. Image generation is built into apps such as Notes, Freeform and Pages.

Screenshots of a call transcription on iPhone
Apple

You'll be able to use natural language prompts to search for photos of certain people. There's also the promise of more intelligent search in the browser and (at long last!) transcriptions of calls and Voice Memos to catch up to a feature Pixel devices have had for a while.

Although Apple Intelligence will pull from your personal information to make sure the systems are applicable to you, it will be aware of your personal data without collecting it, according to Apple software engineering SVP Craig Federighi.

Apple is employing a blend of both on-device and cloud-based AI processing. Your iPhone will handle as much of the legwork locally as it can, with more complex operations being sent to Apple's processing centers. That raises some questions about privacy, one of Apple's central selling points to would-be customers (especially after Apple openly took digs at rivals that use cloud servers for data processing), but Federighi gave some answers to those. 

For one thing, the company has established something called Private Cloud Compute. Apple says the aim is to wield the power of the cloud for more advanced AI processing while making sure your iPhone data remains safe and secure.

To use these new features on iOS, you'll need a device that has at least an Apple A17 Pro chipset — in other words, an iPhone 15 Pro or one of this year's upcoming models. Apple Intelligence features will be available for free on iOS 18, iPadOS 18 and macOS Sequoia this fall in US English.

Apple also focused on customization. You'll be able to make the home screen look more like your own vibe than ever. You'll be able to change the colors of app icons, which can automatically get a different look when you have Dark Mode enabled. Your apps won't need to be locked within a rigid grid anymore either. Your home screen can look almost as messy as you want.

Control Center is getting some big changes. You'll be able to access things like media playback and smart home controls from here. Developers will be able to take advantage of this and offer Control Center management for their apps too. It'll be possible to pin custom controls to the home screen for your most frequently used apps and functions (so you'll be able to switch out the flashlight control for something else, for instance). Custom controls can also be mapped to the physical action button as you see fit.

When it comes to Messages, there's another nice update in the form of scheduling. When you're catching up on things late at night, you'll be able to time a message to send in the morning, for instance. Those who use emoji reactions in Messages (aka Tapbacks) are getting a nice update too. You'll be able to choose from any emoji instead of the five basic reactions Apple has offered for years. 

Text effects (the little animations that show up when you type a certain phrase) are getting an upgrade as well. Meanwhile, Apple will offer satellite messaging support on iPhone 14 and later devices. That's a major update, especially for those who go off the grid often, as messaging will be more useful beyond emergencies. You'll be able to send and receive texts, emoji and Tapbacks via iMessage and SMS.

AI-generated emoji in Messages
Apple

There's also a key AI-related change coming to the Messages app. Your iPhone will be able to generate custom emoji based on what you're writing. You might need a PhD in semiotics to decipher some of the "Genmoji" you receive.

There's one other big update for Messages in iOS 18: Apple will add support for RCS (Rich Communication Services) to Messages. RCS is a more advanced messaging protocol than SMS. It enables better media sharing, Wi-Fi messaging, group chats and, crucially, better security thanks to end-to-end encryption. It should allow for more secure, media-rich messaging between iPhone and Android devices.

Apple for years refused to support RCS in order to keep iMessage a walled garden. But after persistent pressure from Google — and more importantly, new EU laws coming into force — Apple promised to start supporting RCS sometime this year. Apple, which is never petty about anything ever, almost completely glossed over the addition of RCS in its the keynote, relegating it to a three-word mention.

The Photos app is getting is biggest redesign ever, Apple says. It's getting a visual overhaul and one of the key aims is to help you find your photos more easily (filtering out screenshots should be a breeze, for one thing). Your snaps will be organized around memorable moments. Apple Intelligence will power features like Clean Up, which is effectively Apple's version of Google's Magic Eraser tool.

The Mail app will soon be able to categorize emails — just like Gmail has for years. Apple will also organize emails by sender and make it easy to archive or delete every email you get from a certain company. This will be optional, so you can stick to a single inbox if you wish.

Maps, meanwhile, will offer more detailed topographic maps to bring the app more into line with the Apple Watch. This should be useful for planning routes while hiking. As for the Journal app, it will now show stats for things like a daily writing streak.

Wallet is getting a handy new feature that will allow you to send cash without having to exchange personal details. All you need to do is simply tap your phones together. This could be handy for splitting the bill after dinner with a new acquaintance. Tickets saved to Wallet can now include stadium details, recommended Apple Music playlists and other information.

Calendar can show events and tasks from Reminders app, while the Notes app can automatically solve any math equations you enter. The Home app will offer guest access 

Another welcome change is the introduction of a dedicated Passwords app. This will work across iOS, iPadOS, visionOS and macOS and make it easier to find saved passwords from iCloud Keychain. Even better, there will also be Windows support via the iCloud for Windows app. Hopefully, this will make it easier for everyone to use a password manager and have unique passwords for every single account — something we strongly recommend.

This being Apple, of course it has some new privacy controls for apps in iOS 18. You'll have the option to lock apps behind an authentication method (i.e., your PIN or Face ID) so that when you pass your iPhone to someone to show them your camera roll, they can't go snooping in your Messages. You can also hide apps — perhaps ones you use for dating — in a locked folder too. Elsewhere on the app privacy front, you'll be able to decide which of your contacts an app has access to instead of giving them absolutely everyone's phone numbers and personal information.

Elsewhere, Apple is bringing Game Mode to iPhone. This aims to boost performance by minimizing background activity, while controllers and AirPods should be more responsive. 

During an emergency call, dispatchers will be able to send a request to turn it into a video call or to share media from the camera roll. This, Apple suggests, can help first responders better prepare for an incident. The Health app, meanwhile, has been redesigned to make it easier to access vital info in an emergency.

On the accessibility front, users will be able to navigate their iPhone using eye tracking. You'll be able to set up a custom sound that will trigger tasks using the Vocal Shortcut feature, while Music Haptics aims to give those who are deaf or hard of hearing another way to experience music via the Taptic Engine.

A developer beta of iOS 18 is available today and a public version will roll out in July. As always, iOS 18 will roll out to all eligible iPhones this fall. 

If your device can run iOS 17, you'll be able to install iOS 18. The list of eligible devices includes the iPhone 11 and later lineups, along with iPhone Xs, Xs Max, Xr and the second-gen SE.

Catch up here for all the news out of Apple's WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/ios-18-gets-a-revamped-control-center-and-loads-of-home-screen-customization-options-172350046.html?src=rss

Apple’s first attempt at AI is Apple Intelligence

Apple is going all in on AI in the most Apple way possible. At WWDC, Apple's annual conference for developers, the company revealed Apple Intelligence, an Apple-branded version of AI that is more focused on infusing its software with the technology and upgrading existing apps to make them more useful. Apple Intelligence will be powered both by Apple’s homegrown tech as well as a partnership with OpenAI, the maker of ChatGPT, Apple announced. 

One of Apple’s biggest AI upgrades is coming to Siri. The company’s built-in voice assistant will now be powered by large language models, the tech that underlies all modern-day generative AI. Siri, which has languished over the years, may become more useful now that it can interact more closely with Apple’s operating systems and apps. You can, for instance, ask Siri to give you a summary of a news article, delete an email or edit a photo. The assistant will also be able to take more than 100 actions, such as finding photos based on a general description of their contents, or extracting personal information from a picture of your ID to automatically fill in forms online. Finally, you can type your question into Siri instead of using your voice. 

Apple Intelligence will be highlight relevant content in Safari as you browse. You’ll also be able to use it to quickly catch up on priority notifications. And just like Gmail and Outlook, your devices will be able create fleshed out responses to emails and text messages on your behalf. Apple also announced a suite of new features called Writing Tools that uses AI to write, rewrite, proofread and summarize text across the system, useful to draft emails and blog posts, for instance.

Apple Smart Replies
Apple

Apple Intelligence will use AI to record, transcribe and summarize your phone calls, rivaling third-party transcription services like Otter. All participants are automatically notified when you start recording, and a transcript of the conversation's main points is automatically generated at the end. You can also use AI to generate images, stickers and custom emoji (which Apple calls Genmoji) in any app.

Apple Intelligence can transcribe and summarize calls automatically.
Apple


Thanks to its partnership with OpenAI, Apple also is baking the base version of GPT-4o — OpenAI's newest large language model — into Siri as well as Writing Tools. Siri can act as an intermediary for user queries to GTP-4o, and Writing Tools can use the LLM to help compose text. Apple claims unless you connect your paid ChatGPT account to your Apple device, the company won't store your requests or other identifying information like your IP address.

Apple Intelligence, which the company says will be in beta at launch, will be restricted to the iPhone 15 Pro and Pro Max and iPads and Macs with M1 (or higher) chipsets. Your device will also need to be set to US English. 

Apple's AI features are a long time coming. Generative AI has shaken up Silicon Valley ever since OpenAI launched ChatGPT around the end of 2022. Since then, Apple’s rivals like Google, Samsung and Microsoft, as well as companies like Meta have raced to integrate AI features in all their primary products. Last month, Google announced that AI would be a cornerstone of the next version of Android and made major AI-powered changes to its search engine. Samsung, Apple’s primary smartphone competitor, added AI features to its phones earlier this year that can translate calls in real time and edit photos. Microsoft, too, unveiled AI-powered Copilot PCs, aimed at infusing Windows with AI features that include live captioning, image editing, and beefing up systemwide search.

Catch up here for all the news out of Apple's WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/apples-first-attempt-at-ai-is-apple-intelligence-181444846.html?src=rss

watchOS 11 lets you take a day off working out without losing your streak

Many of the new features coming to watchOS 11 are fitness-focused, with a new Training Load feature for the Activities app, pregnancy stats in Cycle Tracking and a brand new Vitals app. Apple's Worldwide Developers Conference (WWDC) on Monday showcased all the things we can expect when the operating system update for Apple Watches hits this fall.  

The new app, Vitals, synthesizes data gathered overnight to give you a better understanding of your overall health. Apple Watch sensors will monitor details like heart rate, wrist temperature and respiration and combine that with data from the Apple Heart and Movement study so it can track changes over time and give you a heads up when things look outside their normal range. From what we've seen, Apple Watch batteries (outside of the Ultra model) don't quite make it through a night after a full day of use, so it'll be interesting to see how useful the new app will prove.  

The Activity app is getting a few new abilities, including Training Load that measures the intensity and duration of your workout to see how it's impacting you over time. Using data from GPS, sensor metrics like heart rate and pace, as well as your personal details like age and weight, the app will determine a rating for each workout from one (easy) to 10 (all out). And if you don't agree with the assessment, you can manually adjust it. In a post workout summary, you can see if you're training above your average or below it.  

The Workout app within the Apple Watch will now include a Check In button to let friends and family know when you're heading out and back home safe from a run.

Using your iPhone, you can set more customizations in the Activity app too. Now you can adjust your goals for the day of the week and set rest days while still hanging onto your streaks. The summary screen in the Fitness app on iPhone is customizable too. 

The Cycle Tracking app can now give you insights during pregnancy, showing applicable health data as it tracks the duration of your pregnancy. This includes a look at your heart rate, which typically rises during pregnancy, as well as a running timeline of the gestational age. Walking stability alerts during the third trimester can also help you avoid falling issues that sometimes arise. Mental health will also get some attention, with reminders to take a monthly assessments to keep you aware of issues that pregnancy and postpartum conditions can trigger, like depression.

WWDC watchOS updates
Apple

Smart Stack — the rolling list of active app widgets you access by swiping up from the bottom of the screen — is getting some updates as well. Now instead of just active apps, the Smart Stack will include time sensitive widgets like precipitation alerts before it rains or the translate widget when traveling. That alerted us to the fact that the Translate app is coming to the Apple Watch, with translation support for 20 languages. Live Activities and Check In will come to the Smart Stack, too.

Apple is opening up access to the Smart Stack to third parties. So, for example, you'll see that your Uber is arriving in the widget carousel. Developers will have access to the Double Tap feature as well, for hands-free interaction with more apps. 

If you like the Photos watch face, there's good news here too. Machine learning models will help you find the best photos to feature by identifying and scoring the images of your friends and family based on facial expressions and image composition. It can even automatically crop and frame them for you.  

Almost as an afterthought, Apple also mentioned the advent of turn-by-turn directions for hiking and walking routes you created yourself. 

If you're itching to try out the new features for yourself, you can do so next month if you're part of Apple's beta software program. Developers gained access as of the announcement. And for regular folk, watchOS 11 will be available as a free software update this fall for Apple Watch Series 6 and newer. 

Catch up here for all the news out of Apple's WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/watchos-11-includes-a-new-vitals-app-to-see-all-your-key-health-metrics-175600647.html?src=rss

iPadOS 18 is getting a big boost with the arrival of Apple Intelligence

Last month, Apple's tablets got a major revamp with the arrival of the M4 chip, two size options for the iPad Air, updates to the Magic Keyboard and a new iPad Pro packing a fancy Tandem OLED display. And now at WWDC 2024, Apple is looking to flesh out the iPad's software with the introduction of Apple Intelligence and a number of fresh features heading to iPadOS 18, which is due out sometime later this year. 

To start, iPadOS is getting deeper customization options for your home screen including the ability to put app icons pretty much wherever you want. Apple's Control Center has also been expanded with support for creating multiple lists and views, resizing and rearranging icons and more. There's also a new floating tab bar that makes it easy to navigate between apps, which can be further tuned to remember your favorites. Next, SharePlay is getting the ability to draw diagrams on someone else's iPad or control someone else's device remotely (with permission) for times like when you need to help troubleshoot.

The Smart Script tool in the Notes app on iPadOS will make your handwriting less messy and easier to edit.
Apple

After years of requests, the iPad is also getting its own version of the Calculator app, which includes a new Math Notes feature that supports the Apple Pencil and the ability to input handwritten formulas. Math Notes will even update formulas in real time or you can save them in case you want to revisit things later. Alternatively, the Smart Script tool in the Notes app uses machine learning to make your notes less messy and easier to edit. 

General privacy is also being upgraded with a new feature that lets you lock an app. This allows a friend or family member to borrow your device without giving them full access to everything on your tablet. Alternatively, there’s also a new hidden apps folder so you can stash sensitive software in a more secretive way.

A general overview of new features coming to iPads in the next version of iPadOS.
Apple

In Messages, Tapbacks are now compatible with all your emoji. Furthermore, you'll be able to schedule messages or send texts via satellite in case you aren't currently connected to Wi-Fi or a cellular network. Apple even says messages sent using satellite will feature end-to-end encryption.

The Mail and Photos apps are also getting similarly big revamps. Mail will feature new categorizations meant to make it easier to find specific types of offers or info (like plane flights). Meanwhile, the Photos app will sport an updated UI that will help you view specific types of images while hiding things like screenshots. And to better surface older photos and memories, there will be new categories like Recent Days and People and Pets to put similar types of pics all in a single collection.

Audio controls on iPads is also getting a boost with a new ability for Siri to understand gestures for “Yes” and “No” by either shaking or nodding your head while wearing AirPods. This should make it easier to provide Apple's digital assistant with simple responses in areas like a crowded bus or quiet waiting room where you might be uncomfortable talking aloud.

Apple Intelligence is a collection of AI-powered features that can do things like teach you how to use specific apps or tools, find files or generate images based on your prompts.
Apple

However, the biggest addition this year is that alongside all the iPad-specific features, Apple’s tablet OS is also getting Apple Intelligence. This covers many of the company’s new AI-powered features like the ability to create summaries of websites, proofread or rewrite emails or even generate new art based on your prompts.

Apple says that to make its AI more useful, features will be more personalized and contextual. That said, to help protect your privacy and security, the company claims it won’t build profiles or sell data to outside parties. Generally, Apple says it will use on-device processing for most of its tools, though some features require help from the cloud.

As its iconic digital assistant, Siri is getting a big refresh via Apple Intelligence too. This includes better natural language recognition and the ability to understand and remember context from one query to another. Siri will also be able to help you use your device, allowing you to ask your tablet how to perform certain tasks, search for files or control apps and features using your voice.

An example of using Apple Intelligence to make a custom emoji (called a Genmoji) of a T-Rex wearing a tute on a surfboard.
Apple

Some examples of what Apple Intelligence can do is highlight priority emails and put them at the top of your inbox so you don't miss important messages or events. Or if you're feeling more creative, you can use AI to create unique emoji (called Genmoji). And in photos, Apple Intelligence can help you edit images with things like the Clean Up tool. And for those who want the freedom to use other AI models, Apple is adding the option to integrate other services, the first of which will be Chat GPT. 

Finally, other minor updates including a new Passwords app for stashing credentials across apps and websites, a new dedicated Game Mode with personalized spatial audio, expanded hiking results in Apple Maps and a new eye-tracking feature for improved accessibility. 

Catch up here for all the news out of Apple's WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/ipados-18s-smart-script-uses-machine-learning-to-make-your-handwriting-less-horrible-175306533.html?src=rss