The best smartphone cameras for 2024: How to choose the phone with the best photography chops

I remember begging my parents to get me a phone with a camera when the earliest ones were launched. The idea of taking photos wherever I went was new and appealing, but it’s since become less of a novelty and more of a daily habit. Yes, I’m one of those. I take pictures of everything — from beautiful meals and funny signs to gorgeous landscapes and plumes of smoke billowing in the distance.

If you grew up in the Nokia 3310 era like me, then you know how far we’ve come. Gone are the 2-megapixel embarrassments that we used to post to Friendster with glee. Now, many of us use the cameras on our phones to not only capture precious memories of our adventures and loved ones, but also to share our lives with the world.

I’m lucky enough that I have access to multiple phones thanks to my job, and at times would carry a second device with me on a day-trip just because I preferred its cameras. But most people don’t have that luxury. Chances are, if you’re reading this, a phone’s cameras may be of utmost importance to you. But you’ll still want to make sure the device you end up getting doesn’t fall flat in other ways. At Engadget, we test and review dozens of smartphones every year; our top picks below represent not only the best phone cameras available right now, but also the most well-rounded options out there.

What to look for when choosing a phone for its cameras

Before scrutinizing a phone’s camera array, you’ll want to take stock of your needs — what are you using it for? If your needs are fairly simple, like taking photos and videos of your new baby or pet, most modern smartphones will serve you well. Those who plan to shoot for audiences on TikTok, Instagram or YouTube should look for video-optimizing features like stabilization and high frame rate support (for slow-motion clips).

Most smartphones today have at least two cameras on the rear and one up front. Those that cost more than $700 usually come with three, including wide-angle, telephoto or macro lenses. We’ve also reached a point where the number of megapixels (MP) doesn’t really matter anymore — most flagship phones from Apple, Samsung and Google have sensors that are either 48MP or 50MP. You’ll even come across some touting resolutions of 108MP or 200MP, in pro-level devices like the Galaxy S24 Ultra.

Most people won’t need anything that sharp, and in general, smartphone makers combine the pixels to deliver pictures that are the equivalent of 12MP anyway. The benefits of pixel-binning are fairly minor in phone cameras, though, and you’ll usually need to blow up an image to fit a 27-inch monitor before you’ll see the slightest improvements.

In fact, smartphone cameras tend to be so limited in size that there’s often little room for variation across devices. They typically use sensors from the same manufacturers and have similar aperture sizes, lens lengths and fields of view. So while it might be worth considering the impact of sensor size on things like DSLRs or mirrorless cameras, on a smartphone those differences are minimal.

Sensor size and field of view

If you still want a bit of guidance on what to look for, here are some quick tips: By and large, the bigger the sensor the better, as this will allow more light and data to be captured. Not many phone makers will list the sensor size in spec lists, so you’ll have to dig around for this info. A larger aperture (usually indicated by a smaller number with an “f/” preceding a digit) is ideal for the same reason, and it also affects the level of depth of field (or background blur) that’s not added via software. Since portrait modes are available on most phones these days, though, a big aperture isn’t as necessary to achieve this effect.

When looking for a specific field of view on a wide-angle camera, know that the most common offering from companies like Samsung and Google is about 120 degrees. Finally, most premium phones like the iPhone 15 Pro Max and Galaxy S24 Ultra offer telephoto systems that go up to 5x optical zoom with software taking that to 20x or even 100x.

Processing and extra features

These features will likely perform at a similar quality across the board, and where you really see a difference is in the processing. Samsung traditionally renders pictures that are more saturated, while Google’s Pixel phones take photos that are more neutral and evenly exposed. iPhones have historically produced pictures with color profiles that seem more accurate, though in comparison to images from the other two, they can come off yellowish. However, that was mostly resolved after Apple introduced a feature in the iPhone 13 called Photographic Styles that lets you set a profile with customizable contrast levels and color temperature that would apply to every picture taken via the native camera app.

Pro users who want to manually edit their shots should see if the phone they’re considering can take images in RAW format. Those who want to shoot a lot of videos while on the move should look for stabilization features and a decent frame rate. Most of the phones we’ve tested at Engadget record at either 60 frames per second at 1080p or 30 fps at 4K. It’s worth checking to see what the front camera shoots at, too, since they’re not usually on par with their counterparts on the rear.

Finally, while the phone’s native editor is usually not a dealbreaker (since you can install a third-party app for better controls), it’s worth noting that the latest flagships from Samsung and Google all offer AI tools that make manipulating an image a lot easier. They also offer a lot of fun, useful extras, like erasing photobombers, moving objects around or making sure everyone in the shot has their eyes open.

How we test smartphone cameras

For the last few years, I’ve reviewed flagships from Google, Samsung and Apple, and each time, I do the same set of tests. I’m especially particular when testing their cameras, and usually take all the phones I’m comparing out on a day or weekend photo-taking trip. Any time I see a photo- or video-worthy moment, I whip out all the devices and record what I can, doing my best to keep all factors identical and maintain the same angle and framing across the board.

It isn’t always easy to perfectly replicate the shooting conditions for each camera, even if I have them out immediately after I put the last one away. Of course, having them on some sort of multi-mount rack would be the most scientific way, but that makes framing shots a lot harder and is not representative of most people’s real-world use. Also, just imagine me holding up a three-prong camera rack running after the poor panicked wildlife I’m trying to photograph. It’s just not practical.

For each device, I make sure to test all modes, like portrait, night and video, as well as all the lenses, including wide, telephoto and macro. When there are new or special features, I test them as well. Since different phone displays can affect how their pictures appear, I wanted to level the playing field: I upload all the material to Google Drive in full resolution so I can compare everything on the same large screen. Because the photos from today’s phones are of mostly the same quality, I usually have to zoom in very closely to see the differences. I also frequently get a coworker who’s a photo or video expert to look at the files and weigh in.

This article originally appeared on Engadget at https://www.engadget.com/best-camera-phone-130035025.html?src=rss

The Pirate Queen interview: How Singer Studios and Lucy Liu brought forgotten history to life

I had a favorite version of Mulan growing up (Anita Yuen in the 1998 Taiwanese TV series). I obsessed over Chinese period TV series like Legend of the Condor Heroes, My Fair Princess and The Book and the Sword. I consider myself fairly well-versed in Chinese historical figures, especially those represented in ‘90s and 2000s entertainment in Asia. So when I found out that a UK-based studio had made a VR game called The Pirate Queen based on a forgotten female leader who was prolific in the South China Sea, I was shocked. How had I never heard of her? How had the Asian film and TV industry never covered her?

I got to play a bit of the game this week, which was released on the Meta Quest store and Steam on March 7th. The titular character Cheng Shih is voiced by actor Lucy Liu, who also executive produced this version of the game with UK-based Singer Studios’ CEO and founder Eloise Singer. Liu and Singer sat with me for an interview discussing The Pirate Queen, Cheng Shih, VR’s strengths and the importance of cultural and historical accuracy in games and films.

Cheng Shih, which translates to “Madam Cheng” or “Mrs Cheng,” was born Shi Yang. After she married the pirate Cheng Yi (usually romanized as Zheng Yi), she became known as Cheng Yi Sao, which translates to “wife of Cheng Yi.” Together they led the Guangdong Pirate Confederation in the 1800s. Upon her husband’s death in 1807, she took over the reins and went on to become what South China Morning Post described as “history’s greatest pirate.”

A screenshot from The Pirate Queen, showing an ornate ship with a warm glow emanating from its windows. The ship is on a body of water that has some floating lanterns on it.
Singer Studios

How did Singer Studios learn about Cheng Shih and decide to build a game (and upcoming franchise including a film, podcast and graphic novels) around her? According to Singer, it was through word of mouth. “It was a friend of mine who first told me the story,” Singer said. “She said, ‘Did you know that the most famous pirate in history was a woman?’”

Cheng Shih had been loosely referenced in various films and games before this, like the character Mistress Ching in the 2007 film Pirates of the Caribbean: At World’s End and Jing Lang in Assassin’s Creed IV: Black Flag. As Singer pointed out, Cheng Shih had also appeared in a recent episode of Doctor Who.

Singer said that her team started developing the project as a film at the end of 2018. But the pandemic disrupted their plans, causing Singer to adapt it into a game. A short version of The Pirate Queen later debuted at Raindance Film Festival, and shortly after, Meta came onboard and provided funding to complete development of the game. Liu was then approached when the full version was ready and about to make its appearance at Tribeca Film Festival 2023.

“The rest is history,” Liu said, “But not forgotten history.” She said Cheng Shih was never really recognized for being the most powerful pirate. “It seems so crazy that in the 19th century, this woman who started as a courtesan would then rise to power and then have this fleet of pirates that she commanded,” Liu added. She went on to talk about how Cheng Shih was ahead of the time and also represented “a bit of an underdog story.” For the full 15-minute interview, you can watch the video in this article or listen to this week’s episode of The Engadget Podcast and learn more about Liu and Singer’s thoughts on VR and technology over the last 20 years.

Capturing the historical and cultural details of Cheng Shih’s life was paramount to Liu and Singer. They said the team had to create women’s hands from scratch to be represented from the player’s perspective in VR, and a dialect coach was hired to help Liu nail the pronunciation for the Cantonese words that Cheng Shih speaks in the game. Though I’m not completely certain if Cheng Shih spoke Mandarin or Cantonese, the latter seems like the more accurate choice given it’s the lingua franca in the Guangdong region.

A screenshot from The Pirate Queen, showing a scroll depicting a woman, with Chinese characters below it, as well as an English translation saying
Singer Studios

All that added to the immersiveness of The Pirate Queen, in which players find themselves in an atmospheric maritime environment. The Meta Quest 3’s controllers served as my hands in the game, and I rowed boats, climbed rope ladders and picked up items with relative ease. Some of the mechanics, especially the idea of “teleportation” as moving around, were a little clunky, but after about five minutes I got used to how things worked. You’ll have to point the left controller and push the joystick when you’ve chosen a spot, and the scene changes around you. This probably minimizes the possibility of nausea, since you’re not standing still while watching your surroundings move. It’s also pretty typical of VR games, so those who have experience playing in headsets will likely be familiar with the movement.

You can still walk around and explore, of course. I scrutinized the corners of rooms, inspected the insides of cabinets and more, while hunting for keys that would unlock boxes containing clues. A lot of this is pretty standard for a puzzle or room escape game, which is what I used to play the most in my teens. But I was particularly taken by sequences like rowing a boat across the sea and climbing up a rope ladder, both of which caused me to break a mild sweat. Inside Cheng Shih’s cabin, I lit a joss stick and placed it in an incense holder — an action I repeated every week at my grandfather’s altar when I was growing up. It felt so realistic that I tried to wave the joss stick to put out the flame and could almost smell the smoke.

It’s these types of activities that make VR games great vehicles for education and empathy. “We didn’t want to have these combat elements that traditional VR games do have,” Singer said, adding that it was one of the challenges in creating The Pirate Queen.

“It’s nice to see and to learn and be part of that, as opposed to ‘Let’s turn to page 48,’” Liu said. “That’s not as exciting as doing something and being actively part of something.” When you play as a historical character in a game, and one that’s as immersive as a VR game, “you’re living that person’s life or that moment in time,” Liu added.

While The Pirate Queen is currently only available on Quest devices, Singer said there are plans to bring it to “as many headsets as we possibly can.” Singer Studios also said it is “extending The Pirate Queen franchise beyond VR into a graphic novel, film and television series.”

This article originally appeared on Engadget at https://www.engadget.com/the-pirate-queen-interview-how-singer-studios-and-lucy-liu-brought-forgotten-history-to-life-160007029.html?src=rss

The Pirate Queen interview: How Singer Studios and Lucy Liu brought forgotten history to life

I had a favorite version of Mulan growing up (Anita Yuen in the 1998 Taiwanese TV series). I obsessed over Chinese period TV series like Legend of the Condor Heroes, My Fair Princess and The Book and the Sword. I consider myself fairly well-versed in Chinese historical figures, especially those represented in ‘90s and 2000s entertainment in Asia. So when I found out that a UK-based studio had made a VR game called The Pirate Queen based on a forgotten female leader who was prolific in the South China Sea, I was shocked. How had I never heard of her? How had the Asian film and TV industry never covered her?

I got to play a bit of the game this week, which was released on the Meta Quest store and Steam on March 7th. The titular character Cheng Shih is voiced by actor Lucy Liu, who also executive produced this version of the game with UK-based Singer Studios’ CEO and founder Eloise Singer. Liu and Singer sat with me for an interview discussing The Pirate Queen, Cheng Shih, VR’s strengths and the importance of cultural and historical accuracy in games and films.

Cheng Shih, which translates to “Madam Cheng” or “Mrs Cheng,” was born Shi Yang. After she married the pirate Cheng Yi (usually romanized as Zheng Yi), she became known as Cheng Yi Sao, which translates to “wife of Cheng Yi.” Together they led the Guangdong Pirate Confederation in the 1800s. Upon her husband’s death in 1807, she took over the reins and went on to become what South China Morning Post described as “history’s greatest pirate.”

A screenshot from The Pirate Queen, showing an ornate ship with a warm glow emanating from its windows. The ship is on a body of water that has some floating lanterns on it.
Singer Studios

How did Singer Studios learn about Cheng Shih and decide to build a game (and upcoming franchise including a film, podcast and graphic novels) around her? According to Singer, it was through word of mouth. “It was a friend of mine who first told me the story,” Singer said. “She said, ‘Did you know that the most famous pirate in history was a woman?’”

Cheng Shih had been loosely referenced in various films and games before this, like the character Mistress Ching in the 2007 film Pirates of the Caribbean: At World’s End and Jing Lang in Assassin’s Creed IV: Black Flag. As Singer pointed out, Cheng Shih had also appeared in a recent episode of Doctor Who.

Singer said that her team started developing the project as a film at the end of 2018. But the pandemic disrupted their plans, causing Singer to adapt it into a game. A short version of The Pirate Queen later debuted at Raindance Film Festival, and shortly after, Meta came onboard and provided funding to complete development of the game. Liu was then approached when the full version was ready and about to make its appearance at Tribeca Film Festival 2023.

“The rest is history,” Liu said, “But not forgotten history.” She said Cheng Shih was never really recognized for being the most powerful pirate. “It seems so crazy that in the 19th century, this woman who started as a courtesan would then rise to power and then have this fleet of pirates that she commanded,” Liu added. She went on to talk about how Cheng Shih was ahead of the time and also represented “a bit of an underdog story.” For the full 15-minute interview, you can watch the video in this article or listen to this week’s episode of The Engadget Podcast and learn more about Liu and Singer’s thoughts on VR and technology over the last 20 years.

Capturing the historical and cultural details of Cheng Shih’s life was paramount to Liu and Singer. They said the team had to create women’s hands from scratch to be represented from the player’s perspective in VR, and a dialect coach was hired to help Liu nail the pronunciation for the Cantonese words that Cheng Shih speaks in the game. Though I’m not completely certain if Cheng Shih spoke Mandarin or Cantonese, the latter seems like the more accurate choice given it’s the lingua franca in the Guangdong region.

A screenshot from The Pirate Queen, showing a scroll depicting a woman, with Chinese characters below it, as well as an English translation saying
Singer Studios

All that added to the immersiveness of The Pirate Queen, in which players find themselves in an atmospheric maritime environment. The Meta Quest 3’s controllers served as my hands in the game, and I rowed boats, climbed rope ladders and picked up items with relative ease. Some of the mechanics, especially the idea of “teleportation” as moving around, were a little clunky, but after about five minutes I got used to how things worked. You’ll have to point the left controller and push the joystick when you’ve chosen a spot, and the scene changes around you. This probably minimizes the possibility of nausea, since you’re not standing still while watching your surroundings move. It’s also pretty typical of VR games, so those who have experience playing in headsets will likely be familiar with the movement.

You can still walk around and explore, of course. I scrutinized the corners of rooms, inspected the insides of cabinets and more, while hunting for keys that would unlock boxes containing clues. A lot of this is pretty standard for a puzzle or room escape game, which is what I used to play the most in my teens. But I was particularly taken by sequences like rowing a boat across the sea and climbing up a rope ladder, both of which caused me to break a mild sweat. Inside Cheng Shih’s cabin, I lit a joss stick and placed it in an incense holder — an action I repeated every week at my grandfather’s altar when I was growing up. It felt so realistic that I tried to wave the joss stick to put out the flame and could almost smell the smoke.

It’s these types of activities that make VR games great vehicles for education and empathy. “We didn’t want to have these combat elements that traditional VR games do have,” Singer said, adding that it was one of the challenges in creating The Pirate Queen.

“It’s nice to see and to learn and be part of that, as opposed to ‘Let’s turn to page 48,’” Liu said. “That’s not as exciting as doing something and being actively part of something.” When you play as a historical character in a game, and one that’s as immersive as a VR game, “you’re living that person’s life or that moment in time,” Liu added.

While The Pirate Queen is currently only available on Quest devices, Singer said there are plans to bring it to “as many headsets as we possibly can.” Singer Studios also said it is “extending The Pirate Queen franchise beyond VR into a graphic novel, film and television series.”

This article originally appeared on Engadget at https://www.engadget.com/the-pirate-queen-interview-how-singer-studios-and-lucy-liu-brought-forgotten-history-to-life-160007029.html?src=rss

Microsoft’s neural voice tool for people with speech disabilities arrives later this year

At its 14th Ability summit, which kicks off today, Microsoft is highlighting developments and collaborations across its portfolio of assistive products. Much of that is around Azure AI, including features announced yesterday like AI-powered audio descriptions and the Azure AI studio that better enables developers with disabilities to create machine-learning applications. It also showed off new updates like more languages and richer AI-generated descriptions for its Seeing AI tool, as well as new playbooks offering guidelines for best practices in areas like building accessible campuses and greater mental health support.

The company is also previewing a feature called “Speak For Me,” which is coming later this year. Much like Apple’s Personal Voice, Speak For Me can help those with ALS and other speech disabilities to use custom neural voices to communicate. Work on this project has been ongoing “for some time” with partners like the non-profit ALS organization Team Gleason, and Microsoft said it’s “committed to making sure this technology is used for good and plan to launch later in the year.” The company also shared that it’s working with Answer ALS and ALS Therapy Development Institute (TDI) to “almost double the clinical and genomic data available for research.”

One of the most significant accessibility updates coming this month is that Copilot will have new accessibility skills that enable users to ask the assistant to launch Live Caption and Narrator, among other assistive tools. The Accessibility Assistant feature announced last year will be available today in the Insider preview for M365 apps like Word, with the company saying it will be coming “soon” to Outlook and PowerPoint. Microsoft is also publishing four new playbooks today, including a Mental Health toolkit, which covers “tips for product makers to build experiences that support mental health conditions, created in partnership [with] Mental Health America.”

Ahead of the summit, the company’s chief accessibility officer Jenny Lay-Flurrie spoke with Engadget to share greater insight around the news as well as her thoughts on generative AI’s role in building assistive products.

“In many ways, AI isn’t new,” she said, adding “this chapter is new.” Generative AI may be all the rage right now, but Lay-Flurrie believes that the core principle her team relies on hasn’t changed. “Responsible AI is accessible AI,” she said.

Still, generative AI could bring many benefits. “This chapter, though, does unlock some potential opportunities for the accessibility industry and people with disabilities to be able to be more productive and to use technology to power their day,” she said. She highlighted a survey the company did with the neurodiverse community around Microsoft 365 Copilot, and the response of the few hundred people who responded was “this is reducing time for me to create content and it’s shortening that gap between thought and action,” Lay-Flurrie said.

The idea of being responsible in embracing new technology trends when designing for accessibility isn’t far from Lay-Flurrie’s mind. “We still need to be very principled, thoughtful and if we hold back, it’s to make sure that we are protecting those fundamental rights of accessibility.”

Elsewhere at the summit, Microsoft is featuring guest speakers like actor Michelle Williams and its own employee Katy Jo Wright, discussing mental health and their experience living with chronic Lyme disease respectively. We will also see Amsterdam’s Rijksmusem share how it used Azure AI’s computer vision and generative AI to provide image descriptions for over a million pieces of art for visitors who are blind or have low vision.

This article originally appeared on Engadget at https://www.engadget.com/microsofts-neural-voice-tool-for-people-with-speech-disabilities-arrives-later-this-year-161550277.html?src=rss

Microsoft’s neural voice tool for people with speech disabilities arrives later this year

At its 14th Ability summit, which kicks off today, Microsoft is highlighting developments and collaborations across its portfolio of assistive products. Much of that is around Azure AI, including features announced yesterday like AI-powered audio descriptions and the Azure AI studio that better enables developers with disabilities to create machine-learning applications. It also showed off new updates like more languages and richer AI-generated descriptions for its Seeing AI tool, as well as new playbooks offering guidelines for best practices in areas like building accessible campuses and greater mental health support.

The company is also previewing a feature called “Speak For Me,” which is coming later this year. Much like Apple’s Personal Voice, Speak For Me can help those with ALS and other speech disabilities to use custom neural voices to communicate. Work on this project has been ongoing “for some time” with partners like the non-profit ALS organization Team Gleason, and Microsoft said it’s “committed to making sure this technology is used for good and plan to launch later in the year.” The company also shared that it’s working with Answer ALS and ALS Therapy Development Institute (TDI) to “almost double the clinical and genomic data available for research.”

One of the most significant accessibility updates coming this month is that Copilot will have new accessibility skills that enable users to ask the assistant to launch Live Caption and Narrator, among other assistive tools. The Accessibility Assistant feature announced last year will be available today in the Insider preview for M365 apps like Word, with the company saying it will be coming “soon” to Outlook and PowerPoint. Microsoft is also publishing four new playbooks today, including a Mental Health toolkit, which covers “tips for product makers to build experiences that support mental health conditions, created in partnership [with] Mental Health America.”

Ahead of the summit, the company’s chief accessibility officer Jenny Lay-Flurrie spoke with Engadget to share greater insight around the news as well as her thoughts on generative AI’s role in building assistive products.

“In many ways, AI isn’t new,” she said, adding “this chapter is new.” Generative AI may be all the rage right now, but Lay-Flurrie believes that the core principle her team relies on hasn’t changed. “Responsible AI is accessible AI,” she said.

Still, generative AI could bring many benefits. “This chapter, though, does unlock some potential opportunities for the accessibility industry and people with disabilities to be able to be more productive and to use technology to power their day,” she said. She highlighted a survey the company did with the neurodiverse community around Microsoft 365 Copilot, and the response of the few hundred people who responded was “this is reducing time for me to create content and it’s shortening that gap between thought and action,” Lay-Flurrie said.

The idea of being responsible in embracing new technology trends when designing for accessibility isn’t far from Lay-Flurrie’s mind. “We still need to be very principled, thoughtful and if we hold back, it’s to make sure that we are protecting those fundamental rights of accessibility.”

Elsewhere at the summit, Microsoft is featuring guest speakers like actor Michelle Williams and its own employee Katy Jo Wright, discussing mental health and their experience living with chronic Lyme disease respectively. We will also see Amsterdam’s Rijksmusem share how it used Azure AI’s computer vision and generative AI to provide image descriptions for over a million pieces of art for visitors who are blind or have low vision.

This article originally appeared on Engadget at https://www.engadget.com/microsofts-neural-voice-tool-for-people-with-speech-disabilities-arrives-later-this-year-161550277.html?src=rss

Apple sold enough iPhones and services last quarter to reverse a downward revenue trend

After four consecutive quarters of revenue decline, Apple broke the trend and reported its first period of revenue growth today. In its earnings report for the first quarter of the financial year of 2024, the company announced a quarterly revenue of $119.6 billion, which is an increase of 2 percent from the same period last year. 

In addition, Apple CEO Tim Cook said its "installed base of active devices has now surpassed 2.2 billion, reaching an all-time high across all products and geographic segments." This quarter includes money brought in from the sales of the iPhone 15 line introduced in September 2023, which had an obvious impact on performance. 

"Today Apple is reporting revenue growth for the December quarter fueled by iPhone sales, and an all-time revenue record in Services,” Cook said. He noted the company hitting "all-time revenue records across advertising, Cloud services, payment services and video as well as December quarter records in App Store and Apple Care." Cook recapped some updates made to the Apple TV app, as well as TV+ content earning nominations and awards. 

Cook went on to remind us during the company's earnings call that tomorrow is the launch day for the Vision Pro headset, calling it historic. After saying that Apple is dedicated to investing in new technologies, Cook added that the company will be sharing more about its developments in AI later this year. 

Products in the wearables, home and accessories categories didn't fare well in this quarter, though sales in the Mac department did increase year over year. iPad sales in particular dropped 25 percent over the same period last year, though Cook attributed that to a "difficult compare" to the big numbers recorded in the first quarter of 2023 due to new models with refreshed Apple Silicon. Considering the company did not release a new iPad model in 2023 at all, this is not surprising. 

Cook continued by highlighting developments like Apple opening its 100th retail location in Asia Pacific and updates on its sustainability efforts. He wrapped up by saying "Apple is a company that has never shied away from big challenges," adding "so we're optimistic about the future, confident in the long term and as excited as we've ever been to deliver for our users."

This article originally appeared on Engadget at https://www.engadget.com/apple-sold-enough-iphones-and-services-last-quarter-to-reverse-a-downward-revenue-trend-223109289.html?src=rss

Galaxy S24 and S24 Plus hands-on: Samsung’s AI phones are here, but with mixed results

I’ve never thought of Samsung as a software company, let alone as a name to pay attention to in the AI race. But with the launch of the Galaxy S24 series today, the company is eager to have us associate it with the year’s hottest tech trend. The new flagship phones look largely the same as last year’s models, but on the inside, change is afoot. At a hands-on session during CES 2024 in Las Vegas last week, I was more focused on checking out the new software on the Galaxy S24 and S24 Plus.

Thanks to a new Snapdragon 8 Gen 3 processor (in the US) customized “for Galaxy,” the S24 series are capable of a handful of new AI-powered tasks that seem very familiar. In fact, if you’ve used Microsoft’s CoPilot, Google’s Bard AI or ChatGPT, a lot of these tools won’t feel new. What is new is the fact that they’re showing up on the S24s, and are mostly processed on-device by Samsung’s recently announced Gauss generative AI model, which it has been quietly building out.

Samsung’s Galaxy AI features on the S24

There are five main areas where generative AI Is making a big difference in the Galaxy S24 lineup — search, translations, note creation, message composition and photo editing and processing. Aside from the notes and composition features, most of these updates seem like versions of existing Google products. In fact, the new Circle to Search feature is a Google service that is debuting on the S24 series, in addition to the Pixel 8 and Pixel 8 Pro.

Circle to Search

With Circle to Search, you basically press the middle of the screen’s bottom edge, the Google logo and a search bar pop up, and you can draw a ring around anything on the display. Well, almost anything. DRMed content or things protected from screenshots, like your banking app, are off limits. Once you’ve made your selection, a panel slides up showing your selection, along with results from Google’s Search Generative Experience (SGE).

You can scroll down to see image matches, followed by shopping, text, website and other types of listings that SGE thought were relevant. I circled the Samsung clock widget, a picture of beef wellington and a lemon, and each time I was given pretty accurate results. I was also impressed by how quickly Google correctly identified a grill that I circled on an Engadget article featuring a Weber Searwood, especially since the picture I drew around was at an off angle.

This is basically image search via Google or Lens, except it saves you from having to open another app (and take screenshots). You’ll be able to circle items in YouTube videos, your friend’s Instagram Stories (or, let’s be honest, ads). Though I was intrigued by the feature and its accuracy, I’m not sure how often I’d use it in the real world. The long-press gesture to launch Circle to Search works whether you use a gesture-based navigation or if you have the three-button layout. The latter might be slightly confusing, since you pretty much hold your finger down on the home button, but not exactly.

Circle to Search is launching on January 31st, and though it’s reserved for the Galaxy S24s and Pixel 8s for now, it’s not clear whether older devices might get the feature.

Chat Assist to tweak the tone of your messages

The rest of Samsung’s AI features are actually powered by the company’s own language models, not Google’s. This part is worth making clear, because when you use the S24 to translate a message from, say, Portuguese to Mandarin, you’ll be using Samsung’s database, not Google’s. I really just want you to direct your anger at the right target when something inevitably goes wrong.

I will say, I was a little worried when I first heard about Samsung’s new Chat Assist feature. It uses generative AI to help reword a message you’ve composed to change up the tone. Say you’re in a hurry, firing off a reply to a friend whom you know can get anxious and misinterpret texts. The S24 can take your sentences, like “On my way back now what do you need” and make it less curt. The options I saw were “casual,” “emojify,” “polite,” “professional” and “social,” which is a hashtag-filled caption presumably for your social media posts.

I typed “Hey there. Where can I get some delicious barbecue? Also, how are you?” Then I tapped the AI icon above the keyboard and selected the “Writing Style” option. After about one or two seconds, the system returned variations of what I wrote.

At the top of the results was my original, followed by the Professional version, which I honestly found hilarious. It said “Hello, I would like to inquire about the availability of delectable barbecue options in the vicinity. Additionally, I hope this message finds you well. Thank you for your attention to this matter.”

It reminded me of an episode of Friends where Joey uses a thesaurus to sound smarter. Samsung’s AI seems to have simply replaced every word with a slightly bigger word, while also adding some formal greetings. I don’t think “inquire about the availability of delectable barbecue options in the vicinity” is anything a human would write.

That said, the casual option was a fairly competent rewording of what I’d written, as was the polite version. I cannot imagine a scenario where I’d pick the “emojify” option, except for the sake of novelty. And while the social option pained me to read, at least the hashtags of #Foodie and #BBQLover seemed appropriate.

Samsung Translate

You can also use Samsung’s AI to translate messages into one of 13 languages in real-time, which is fairly similar to a feature Google launched on the Pixel 6 in 2021. The S24’s interface looks reminiscent of the Pixel’s, too, with both offering two text input fields. Like Google, Samsung also has a field at the top for you to select your target language, though the system is capable of automatically recognizing the language being used. I never got this to work correctly in a foreign language that I understand, and have no real way of confirming how accurate the S24 was in Portuguese.

Samsung’s translation engine is also used for a new feature called Live Translate, which basically acts as an interpreter for you during phone calls made via the native dialer app. I tried this by calling one of a few actors Samsung had on standby, masquerading as managers of foreign-language hotels or restaurants. After I dialed the number and turned on the Live Translate option, Samsung’s AI read out a brief disclaimer explaining to the “manager at a Spanish restaurant” that I was using a computerized system for translation. Then, when I said “Hello,” I heard a disembodied voice say “Hola” a few seconds later.

The lag was pretty bad and it threw off the cadence of my demo, as the person on the other end of the call clearly understood English and would answer in Spanish before my translated request was even sent over. So instead of:

Me: Can I make a reservation please?

S24: … ¿Puedo hacer una reserva por favor?

Restaurant: Si, cuantas personas y a que hora?

S24 (to me): … Yes, for how many people and at what time?

My demo actually went:

Me: Can I make a reservation please?

pause

Restaurant: Si, cuantas personas y a que hora?

S24: ¿Puedo hacer una reserva por favor?

pause

S24 (to me): Yes, for how many people and at what time?

It was slightly confusing. Do I think this is representative of all Live Translate calls in the real world? No, but Samsung will need to work on cutting down lag if it wants to be helpful and not confusing.

Galaxy AI reorganizing your notes

I was most taken by what Samsung’s AI can do in its Notes app, which historically has had some pretty impressive handwriting recognition and indexing. With the AI’s assistance, you can quickly reformat your large blocks of text into easy-to-read headers, paragraphs and bullets. You can also swipe sideways to see different themes, with various colors and font styles.

Notes can also generate summaries for you, though most of the summaries on the demo units didn’t appear very astute or coherent. After it auto-formatted a note titled “An Exploration of the Celestial Bodies in Our Solar System,” the first section was aptly titled “Introduction,” but the first bullet point under that was, confusingly, “The Solar System.” The second bullet point was two sentences, starting with “The Solar System is filled with an array of celestial bodies.”

Samsung also borrowed another feature from the Pixel ecosystem, using its speech-to-text software to transcribe, summarize and translate recordings. The transcription of my short monologue was accurate enough, but the speaker labels weren’t. Summaries of the transcriptions were similar to those in Notes, in that they’re not quite what I’d personally highlight.

The Galaxy S24 held in mid-air, with the viewfinder of its camera app showing on the screen.
Photo by Sam Rutherford / Engadget

That’s already a lot to cover, and I haven’t even gotten to the photo editing updates yet. My colleague Sam Rutherford goes into a lot more detail on those in his hands-on with the Galaxy S24 Ultra, which has the more-sophisticated camera system. In short though, Samsung offers edit suggestions, generative background filling and an instant slow-mo tool that fills in frames when you choose to slow down a video.

Samsung Galaxy S24 and S24 Plus hardware updates

That brings me to the hardware. On the regular Galaxy S24 and S24 Plus, you’ll be getting a 50-megapixel main sensor, 12MP wide camera and 10MP telephoto lens with 3x optical zoom. Up front is a 12MP selfie camera. So, basically, the same setup as last year. The S24 has a 6.2-inch Full HD+ screen, while the S24 Plus sports a 6.7-inch Quad HD+ panel and both offer adaptive refresh rates that can go between 1 and 120Hz. In the US, all three S24 models use a Snapdragon 8 Gen 3 for Galaxy processor, with the base S24 starting out with 8GB of RAM and 128GB of storage. Both the S24 and S24 Plus have slightly larger batteries than their predecessors, with their respective 4,000mAh and 4,900mAh cells coming in at 100mAh and 200mAh bigger than before.

Though the S24s look very similar to last year’s S23s, my first thought on seeing them was how much they looked like iPhones. That’s neither a compliment nor an indictment. And to be clear, I’m only talking about the S24 and S24 Plus, not the Ultra, which still has the distinctive look of a Note.

Four Galaxy S24 handsets in white, cream, black and purple, laid down on a table with their rear cameras facing up.
Photo by Sam Rutherford / Engadget

It feels like Samsung spent so much time upgrading the software and focusing on joining the AI race this year that it completely overlooked the S24’s design. Plus, unlike the latest iPhones, the S24s are also missing support for the newer Qi 2 wireless charging standard, which includes magnetic support, a la Apple’s MagSafe.

Wrap-up

I know it’s just marketing-speak and empty catchphrases, but I’m very much over Samsung’s use of what it thinks is trendy to appeal to people. Don’t forget, this is the company that had an “Awesome Unpacked” event in 2021 filled to the brim with cringeworthy moments and an embarrassingly large number of utterances of the words “squad” and “iconic”.

That doesn’t mean what Samsung’s done with the Galaxy S24 series is completely meaningless. Some of these features could genuinely be useful, like summarizing transcriptions or translating messages in foreign languages. But after watching the company follow trend after trend (like introducing Bixby after the rise of digital assistants, or bringing scene optimizers to its camera app after Chinese phone makers did), launching generative AI features feels hauntingly familiar. My annoyance at Samsung’s penchant for #trendy #hashtags aside, the bigger issue here is that if the company is simply jumping on a fad instead of actually thoughtfully developing meaningful features, then consumers run the risk of losing support for tools in the future. Just look at what happened to Bixby.

This article originally appeared on Engadget at https://www.engadget.com/galaxy-s24-and-s24-plus-hands-on-samsungs-ai-phones-are-here-but-with-mixed-results-180008236.html?src=rss

Audio Radar helps gamers with hearing loss ‘see’ sound effects instead

Audio cues can sometimes be crucial for success in games. Developers frequently design the sound environment for their experiences to be not only rich and immersive, but to also contain hints about approaching enemies or danger. Players who are hard of hearing can miss out on this, and it's not fair for them to be disadvantaged due to a disability. A product called Audio Radar launched at CES 2024 and it can help turn sound signals into visual cues, so that gamers with hearing loss can "see the sound," according to the company AirDrop Gaming LLC. 

The setup is fairly simple. A box plugs into a gaming console to interpret audio output and converts that data into lights. A series of RGB light bars surround the screen, and display different colors depending on the type of sound coming from the respective direction they represent. Put simply, it means that if you're walking around a Minecraft world, like I did at the company's booth on the show floor, you'll see lights of different colors appear on the different bars.

Red lights mean sounds from enemies are in the area adjacent to the corresponding light, while green is for neutral sounds. An onscreen legend also explains what the sounds mean, though that might just be for the modded Minecraft scenario on display at CES. 

A close-up of the bottom right corner of a monitor, with an onscreen legend showing the words
Photo by Cherlynn Low / Engadget

I walked around the scene briefly, and could see green lights hovering above a pen of farm animals, while purple lights fluttered in tandem with a dragon flying overhead. I did find it a little confusing, but that is probably due more to the fact that I know very little about Minecraft, and as someone with hearing I might not appreciate the added information as much as someone without.

With an SDK that the company launched at the show, developers will be able to customize the lights and visual feedback to elements in their game so that they have control over what their hard-of-hearing gamers see. In the meantime, Audio Radar is using its own software to detect stereo or surround sound signals to convert to feedback in lights and colors. 

Though the product may seem in its early stages, various major gaming companies have appeared to indicate interest in Audio Radar. AirDrop Gaming's CEO Tim Murphy told me that Logitech is "providing support as we further develop our product and design our go-to-market strategy." Also, Microsoft CEO Satya Nadella was spotted at the booth on opening day.

Audio Radar is beginning to ship on a wider level this year, and the company continues to develop products for gamers who are deaf and hard of hearing, among other things. The system works with Xbox, PlayStation and PC.

We're reporting live from CES 2024 in Las Vegas from January 6-12. Keep up with all the latest news from the show here.

This article originally appeared on Engadget at https://www.engadget.com/audio-radar-helps-gamers-with-hearing-loss-see-sound-effects-instead-195001226.html?src=rss

Our favorite accessibility innovations at CES 2024

So much of what we see at CES tends to be focused on technological innovation for the sake of innovation, or obvious attempts to tap into whatever trend is gripping the internet's attention that year. In the last few shows, though, there has been a heartening increase in attention to assistive products that are designed to help improve the lives of people with disabilities and other different needs. At CES 2024, I was glad to see more development in the accessibility category, with many offerings appearing to be more thoughtfully designed in addition to being clever. It's so easy to get distracted by the shiny, eye-catching, glamorous and weird tech at CES, but I wanted to take the time to give due attention to some of my favorite accessibility products here in Las Vegas.

GyroGlove

Before I even packed my bags, numerous coworkers had sent me the link to GyroGlove's website after it had been recognized as an honoree for several CES Innovation awards. The device is a hand-stabilizing glove that uses gyroscopic force to help those with hand tremors minimize the shakes. Because the demo unit at the show floor was too large for me, and, more importantly, I don't have hand tremors, I couldn't accurately assess the glove's effectiveness. 

But I spoke with a person with Parkinson's Disease at the booth, who had been wearing one for a few days. She said the GyroGlove helped her perform tasks like buttoning up a shirt more easily, and that she intended to buy one for herself. At $5,899, the device is quite expensive, which is the sad state of assistive products these days. But GyroGlove's makers said they're in talks with some insurance providers in the US, which could lead to it being covered for those in America who could benefit from it. That's one of the biggest reasons that led us to name GyroGlove one of our winners for CES 2024

A down-up look at the MouthPad inside a person's mouth.
Photo by Cherlynn Low / Engadget

MouthPad

I did not think I'd be looking deep into a person's mouth and up their nose at CES 2024, but here we are. Sometimes you have to do strange things to check out unconventional gadgets. The MouthPad is as unusual as it gets. It's a tongue-operated controller for phones, tablets and laptops, and basically anything that will accept a Bluetooth mouse input. The components include a touchpad mounted onto the palette of what's essentially a retainer, as well as a battery and Bluetooth radio. 

As odd as the concept sounds, it actually could be a boon for people who aren't able to use their limbs, since your tongue, as a muscle, can offer more precise movement and control than, say, your eyes. If you're feeling apprehensive about sticking a device inside your mouth, it might be helpful to know that the battery is from the same company that's made them for medical-grade implants, while the rest of the dental tray is made from a resin that's commonly used in aligners and bite guards. The product is currently available as an early access package that includes setup and calibration assistance, with a new version (with longer battery life) slated for launch later this year.

OrCam Hear

Assistive tech company OrCam won our Best of CES award for accessibility in 2022, so I was eager to check out what it had in store this year. I wasn't disappointed. The company had a few updated products to show off, but the most intriguing was a new offering for people with hearing loss. The OrCam Hear system is a three-part package consisting of a pair of earbuds, a dongle for your phone and an app. Together, the different parts work to filter out background noise while identifying and isolating specific speakers in a multi-party conversation.

At a demo during a noisy event at CES 2024, I watched and listened as the voices of selected people around me became clear or muffled as company reps dragged their icons in or out of my field of hearing. I was especially impressed when the system was able to identify my editor next to me and let me choose to focus on or filter out his voice. 

Audio Radar

If you're a gamer, you'll know how important audio cues can sometimes be for a successful run. Developers frequently design the sound environment for their games to be not only rich and immersive, but to also contain hints about approaching enemies or danger. Players who are hard of hearing can miss out on this, and it's not fair for them to be disadvantaged due to a disability. 

A product called Audio Radar can help turn sound signals into visual cues, so that gamers with hearing loss can "see the sound," according to the company. The setup is fairly simple. A box plugs into a gaming console to interpret the audio output and convert it into lights. A series of RGB light bars surround the screen, and display different colors depending on the type of sound coming from the respective direction they represent.

CES 2024 saw not just Audio Radar's official launch, but was also where the company introduced its SDK for game developers to create custom visual cues for players who are hard of hearing. The company's founder and CEO Tim Murphy told Engadget that it's partnering with Logitech, with the gaming accessory maker "providing support as we further develop our product and design our go-to-market strategy." 

A person wearing the TranscribeGlass on the right side of a pair of black-framed glasses.
Photo by Cherlynn Low / Engadget

Transcribe Glass

Google Glass was resurrected at CES 2024. Sort of. A new product called Transcribe Glass is a small heads up display you can attach to any frames, and the result looks a lot like the long-dead Google device. It connects to your phone and uses that device's onboard processing to transcribe what it hears, then projects the text onto the tiny transparent display hovering above the eye. You'll be able to resize the font, adjust the scrolling speed and choose your language model of choice, since TranscribeGlass uses third-party APIs for translation. Yes, it converts foreign languages into one you understand, too. 

The company is targeting year's end for launch, and hoping to offer the device at $199 to start. When I tried it on at the show floor, I was surprised by how light and adjustable the hardware was. I had to squint slightly to see the captions, and was encountering some Bluetooth lag, but otherwise the transcriptions took place fairly quickly and appeared to be accurate. The TranscribeGlass should last about eight hours on a charge, which seems reasonable given all that it's doing. 

Samsung's subtitle accessibility features

Though we didn't catch a demo of this in person, Samsung did briefly mention a "sign language feature in Samsung Neo QLED" that "can be easily controlled with gestures for the hearing impaired, and an Audio Subtitle feature [that] turns text subtitles into spoken words in real-time for those with low vision." We weren't able to find this at the show, but the concept is certainly meaningful. Plus, the fact that Samsung TVs have mainstream appeal means these features could be more widely available that most of the niche products we've covered in this roundup.

We're reporting live from CES 2024 in Las Vegas from January 6-12. Keep up with all the latest news from the show here.

This article originally appeared on Engadget at https://www.engadget.com/our-favorite-accessibility-products-at-ces-2024-170009710.html?src=rss

MouthPad turns your tongue into a mouse for your phone

You can one day use your tongue as a mouse for your laptop, tablet or phone, thanks to a new product that made its first public appearance at CES 2024 in Las Vegas. The MouthPad (an obvious spin on the word "mousepad") is what its makers call a tongue-operated touchpad that "sits at the roof of your mouth" and can be connected to your devices just like a standard Bluetooth mouse. I got to see the MouthPad here in Las Vegas, where it's making its first public appearance since its announcement last year, though, to be clear, I did not put it in my mouth to try out for myself. Instead, I watched as the company's co-founder Tomás Vega used the device to navigate an iPhone and open the camera as we took a selfie together. 

The MouthPad is basically like a retainer with a touchpad, battery and Bluetooth radio built in. It's made of a resin that the company says is the same "dental-grade material that is commonly used in dental aligners, bite guards and other oral appliances." The device's battery was made by a company called Varta, which MouthPad's makers also said has "a long track record of producing safe, medical implant-grade batteries." All this is to say that while it can feel strange to put a battery-powered electrical device in your mouth, at least it might be reassuring to know that this uses technology that has existed in the oral health industry for a long time.

I watched Vega place the 7.5-gram mouthpiece right on his palette, where it sat surrounded by his upper teeth. He closed his mouth and the iPhone he held up showed a cursor moving around as he opened apps and menus. I asked him to open up the camera and he obliged, and we took a selfie. This was evidently not a pre-recorded demo paired with good acting. 

The MouthPad, a tongue-operate controller, held up in mid-air. It's a clear dental tray with an orange touchpad in the middle and some circuitry throughout.
Photo by Cherlynn Low / Engadget

Now, because I didn't try it myself, I can't tell you if it's comfortable or easy to use. But the specs sheet states that the MouthPad is about 0.7mm (0.027 inches) thick, apart from where there are capsules, while the touchpad itself on the roof of the mouth is 5mm (0.19 inches) thick. From what I saw, it didn't look much bulkier than my own retainers, and when Vegas smiled after putting the MouthPad on, I could only really see one small black piece on top of one of his teeth. 

You'll have to take out the MouthPad when you're eating, but you can speak while it's in your mouth. You might have a slight lisp the way you would with regular retainers, but I could understand Vega perfectly. The company said that the device currently lasts about five hours on a charge, though the team is working on improving that to eight hours by March. Recharging the device takes about an hour and a half, though Vega and his team said that, of the 30ish people that currently have a MouthPad, most users tend to charge theirs when they're eating and rarely seem to run out of juice.

The company explained that the MouthPad uses Apple's Assistive Touch feature to navigate iOS, but it can be recognized by other devices as a Bluetooth mouse. It's already on sale for those who sign up for early access, but general availability is coming later this year. Each MouthPad is individually 3D-printed, based on dental impressions sent in by customers as part of the ordering process. Early access users will also receive assistance from the company during setup and calibration, as well as throughout their use of the device.

Close up on the smile of a person wearing the MouthPad 2024. Some lines indicate the person has a clear tray over their teeth, while a small piece of equipment is on top of a tooth on the right side of their mouth.
Photo by Cherlynn Low / Engadget

Tongue-operated controllers are not new, but MouthPad is one of the more elegant and sophisticated options to date. It also works with a wide variety of devices and seems far enough along in the production process to be ready for sale. Whether the human tongue is a suitable organ for computer interactions, however, is something we can only determine after longterm use in the real world. 

We're reporting live from CES 2024 in Las Vegas from January 6-12. Keep up with all the latest news from the show here.

This article originally appeared on Engadget at https://www.engadget.com/the-mouthpad-turns-your-tongue-into-a-mouse-for-your-phone-184541021.html?src=rss