Google DeepMind’s new AI can follow commands inside 3D games it hasn’t seen before

Google DeepMind has unveiled new research highlighting an AI agent that's able to carry out a swath of tasks in 3D games it hasn't seen before. The team has long been experimenting with AI models that can win in the likes of Go and chess, and even learn games without being told their rules. Now, for the first time, according to DeepMind, an AI agent has shown it's able to understand a wide range of gaming worlds and carry out tasks within them based on natural-language instructions.

The researchers teamed up with studios and publishers such as Hello Games (No Man's Sky), Tuxedo Labs (Teardown) and Coffee Stain (Valheim and Goat Simulator 3) to train the Scalable Instructable Multiworld Agent (SIMA) on nine games. The team also used four research environments, including one built in Unity in which agents are instructed to form sculptures using building blocks. This gave SIMA, described as "a generalist AI agent for 3D virtual settings," a range of environments and settings to learn from, with a variety of graphics styles and perspectives (first- and third-person). 

"Each game in SIMA’s portfolio opens up a new interactive world, including a range of skills to learn, from simple navigation and menu use, to mining resources, flying a spaceship or crafting a helmet," the researchers wrote in a blog post. Learning to follow directions for such tasks in video game worlds could lead to more useful AI agents in any environment, they noted.

A flowchart detailing how Google DeepMind trained its SIMA AI agent. The team used gameplay video and matched that to keyboard and mouse inputs for the AI to learn from.
Google DeepMind

The researchers recorded humans playing the games and noted the keyboard and mouse inputs used to carry out actions. They used this information to train SIMA, which has "precise image-language mapping and a video model that predicts what will happen next on-screen." The AI is able to comprehend a range of environments and carry out tasks to accomplish a certain goal.

The researchers say SIMA doesn't need a game's source code or API access — it works on commercial versions of a game. It also needs just two inputs: what's shown on screen and directions from the user. Since it uses the same keyboard and mouse input method as a human, DeepMind claims SIMA can operate in nearly any virtual environment.

The agent is evaluated on hundreds of basic skills that can be carried out within 10 seconds or so across several categories, including navigation ("turn right"), object interaction ("pick up mushrooms") and menu-based tasks, such as opening a map or crafting an item. Eventually, DeepMind hopes to be able to order agents to carry out more complex and multi-stage tasks based on natural-language prompts, such as "find resources and build a camp."

In terms of performance, SIMA fared well based on a number of training criteria. The researchers trained the agent in one game (let's say Goat Simulator 3, for the sake of clarity) and got it to play that same title, using that as a baseline for performance. A SIMA agent that was trained on all nine games performed far better than an agent that trained on just Goat Simulator 3.

Chart showing hte relative performance of Google DeepMind's SIMA AI agent based on varying training data.
Google DeepMind

What's especially interesting is that a version of SIMA that was trained in the eight other games then played the other one performed nearly as well on average as an agent that trained just on the latter. "This ability to function in brand new environments highlights SIMA’s ability to generalize beyond its training," DeepMind said. "This is a promising initial result, however more research is required for SIMA to perform at human levels in both seen and unseen games."

For SIMA to be truly successful, though, language input is required. In tests where an agent wasn't provided with language training or instructions, it (for instance) carried out the common action of gathering resources instead of walking where it was told to. In such cases, SIMA "behaves in an appropriate but aimless manner," the researchers said. So, it's not just us mere mortals. Artificial intelligence models sometimes need a little nudge to get a job done properly too.

DeepMind notes that this is early-stage research and that the results "show the potential to develop a new wave of generalist, language-driven AI agents." The team expects the AI to become more versatile and generalizable as it's exposed to more training environments. The researchers hope future versions of the agent will improve on SIMA's understanding and its ability to carry out more complex tasks. "Ultimately, our research is building towards more general AI systems and agents that can understand and safely carry out a wide range of tasks in a way that is helpful to people online and in the real world," DeepMind said.

This article originally appeared on Engadget at https://www.engadget.com/google-deepminds-new-ai-can-follow-commands-inside-3d-games-it-hasnt-seen-before-140341369.html?src=rss

Ayaneo’s NES-inspired mini PC is more than a retro tribute

The mini PC is misunderstood. Easily dismissed as underpowered, over-priced or just plain ugly; we intuit that a computer with a tiny footprint has to mean a compromise. Ayaneo, best known for its Windows gaming handhelds, has branched out into tiny desktops with retro-inspired designs. Thankfully Ayaneo’s AM01 and AM02 mini PCs have more to offer, but their initial draw over rivals, I won’t lie, is nostalgic appeal.

Sadly, I’m old enough to remember using the original Macintosh that inspired the AM01 and if Nintendo ever reimagined a real NES, I hope it looks like the AM02. Both PCs come in various specifications, but to save typing out the numerous configurations the AM01 starts at $200 and comes in low-to-modest specifications, good for retro gaming and general office tasks. The AM02 is priced between $440 and $630, and all variants come with an AMD 7840HS APU, better suited for PC gaming and heavier tasks like video editing or even music production.

Ayaneo AM02 NES-inspired mini PC.
Photo by James Trew / Engadget

As someone that plays a lot of retro games and doesn’t mind playing PC games on low or medium settings, the AM02 is fast becoming my primary gaming system. Partly because the AM02 strikes a good balance between retro and contemporary design so it fits well in my adult living room. It’s also really well built. I’m not so sure about the four-inch touch screen (more on this later) but the overall design blends in nicely with a contemporary decor without calling too much attention to itself.

The AM02 I’ve been testing is fully loaded with 32GB or RAM and 1TB of storage, but there are enough ports here that even with a lower-spec model you can add more storage or even an eGPU (thanks to a USB 4.0 port) later down the line. There are also two RJ45 ports, one of which is 2.5Gbps, future-proofing the AM02 somewhat and making it well-suited to pulling media from networked storage. This model is also powered by USB-C which makes it more “portable” than its Mac-inspired sibling that uses a laptop-style power brick. Theoretically you could power a display from the AM02’s USB 4 port and have a PC that can easily be moved around. Yes, they invented laptops for exactly this but a perk of mini PCs is that they aren’t a pain to relocate.

I’ve suggested that the AM02 works great in a living room, and it does, but the placement of the built-in display suggests this was designed to live on a desk. When Ayaneo announced these mini PCs, marketing shots showed them in horizontal and vertical configurations. Sadly, neither model makes sense in a vertical orientation. Not least because both have ports on the side that would be facing the desk. Worse, the AM02 has a delightful NES-inspired front flap covering the USB and 3.5mm ports. Press the red button and it satisfyingly clicks open, but that would be the side facing down in a vertical set-up. Not to mention all the cables would then be coming out of the top.

It’s kind of a bummer as I was hoping the built-in display could be visible from across the room, but you can only see it if you’re near enough to peer over from above. What’s more, at least right now, the display is more of a novelty. By default it shows performance statistics such as FPS, CPU usage / temperature and fan speed which is useful for some folk. You can even change the TDP/power draw right from the display, but honestly, given that this thing is plugged in I’ve just been leaving it on the max 45W setting.

Swipe left on the screen, and the view changes to a date and time widget. Swipe one more time and there’s a virtual volume control along with the option to turn the display off. Fun fact, right now there’s no option to turn it back on again. I restarted the PC via Windows and it still didn’t come back to life. I tried once more via the physical power button and that worked, there’s a neater solution coming in the final software. Relatedly, Ayaneo is hoping users will create their own widgets for this display, so there’s definitely potential here. I’m sure it won’t be long before Doom is running entirely on the linux that runs that display.

Ayaneo AM02 NES-inspired mini PC
Photo by James Trew / Engadget

If you do want to use this just for gaming, then you’ll have to decide whether you want to use the company’s own launcher or not. On Ayaneo’s handhelds it’s useful for changing power settings on the fly and other tasks that would otherwise be a pain for a handheld. On a PC like this, the launcher is adequate, but you might want to find your own or just ditch it for the most part. I set the AM02 up to load right into Launchbox/Big Box which handles all my retro/Steam/Epic games just fine and gives a much more console-like experience. But that’s the joy of Windows for gaming I guess, you can do what you want with it.

Despite their diminutive size, mini PCs aren’t always cheap. Like their full-size counterparts, prices range wildly depending on their performance, storage and components. Ayaneo’s handhelds almost universally fell into the “premium” pricing category with nearly all its Windows models costing more than the Steam Deck they try to rival. The two mini PCs break that trend with both models offering, at worst, fair market prices and, at best, beating the competition.

Most direct rivals to the AM02 don’t have a built-in screen (though some do) or have quite as good a selection of inputs and outputs. That’s to say, overall the AM01 and AM02 are reasonably priced for their spec and even more so if you can scoop them up during the early-bird window, which at time of publication is still active for the AM02.

Ayaneo AM02 NES-inspired mini PC
Photo by James Trew / Engadget

There’s a small elephant in the room though. That is, if you’re looking for a true gaming PC, there are likely better ways to spend your money. The lowest spec AM02 costs more than a PS5. Or about the same as an LCD Steam Deck with a dock. Then there’s the Mac Mini which starts at $600 (with less memory and RAM but that M2 processor is no joke). So if gaming is your sole goal, then there’s a slim niche that the AM02 serves best — those looking for a mix of retro and PC titles that also want the flexibility of other media tasks (an easier way to watch Netflix with a VPN, for example) in a package that only draws the right kind of attention. Or maybe you just love it for its design and the capabilities work for you.

Mostly, it’s a promising new direction for a company that made a name for itself trying to take the Steam Deck head on. It might not have been truly successful in that specific mission, but it earned itself plenty of fans along the way for its high-spec handhelds that help re-establish portable gaming as an exciting category. As Ayaneo enters the more general PC market, it might well have found a space where it can excel against a very different type of competition.

This article originally appeared on Engadget at https://www.engadget.com/ayaneo-nes-inspired-am02-mini-pc-review-170029368.html?src=rss

Ayaneo’s NES-inspired mini PC is more than a retro tribute

The mini PC is misunderstood. Easily dismissed as underpowered, over-priced or just plain ugly; we intuit that a computer with a tiny footprint has to mean a compromise. Ayaneo, best known for its Windows gaming handhelds, has branched out into tiny desktops with retro-inspired designs. Thankfully Ayaneo’s AM01 and AM02 mini PCs have more to offer, but their initial draw over rivals, I won’t lie, is nostalgic appeal.

Sadly, I’m old enough to remember using the original Macintosh that inspired the AM01 and if Nintendo ever reimagined a real NES, I hope it looks like the AM02. Both PCs come in various specifications, but to save typing out the numerous configurations the AM01 starts at $200 and comes in low-to-modest specifications, good for retro gaming and general office tasks. The AM02 is priced between $440 and $630, and all variants come with an AMD 7840HS APU, better suited for PC gaming and heavier tasks like video editing or even music production.

Ayaneo AM02 NES-inspired mini PC.
Photo by James Trew / Engadget

As someone that plays a lot of retro games and doesn’t mind playing PC games on low or medium settings, the AM02 is fast becoming my primary gaming system. Partly because the AM02 strikes a good balance between retro and contemporary design so it fits well in my adult living room. It’s also really well built. I’m not so sure about the four-inch touch screen (more on this later) but the overall design blends in nicely with a contemporary decor without calling too much attention to itself.

The AM02 I’ve been testing is fully loaded with 32GB or RAM and 1TB of storage, but there are enough ports here that even with a lower-spec model you can add more storage or even an eGPU (thanks to a USB 4.0 port) later down the line. There are also two RJ45 ports, one of which is 2.5Gbps, future-proofing the AM02 somewhat and making it well-suited to pulling media from networked storage. This model is also powered by USB-C which makes it more “portable” than its Mac-inspired sibling that uses a laptop-style power brick. Theoretically you could power a display from the AM02’s USB 4 port and have a PC that can easily be moved around. Yes, they invented laptops for exactly this but a perk of mini PCs is that they aren’t a pain to relocate.

I’ve suggested that the AM02 works great in a living room, and it does, but the placement of the built-in display suggests this was designed to live on a desk. When Ayaneo announced these mini PCs, marketing shots showed them in horizontal and vertical configurations. Sadly, neither model makes sense in a vertical orientation. Not least because both have ports on the side that would be facing the desk. Worse, the AM02 has a delightful NES-inspired front flap covering the USB and 3.5mm ports. Press the red button and it satisfyingly clicks open, but that would be the side facing down in a vertical set-up. Not to mention all the cables would then be coming out of the top.

It’s kind of a bummer as I was hoping the built-in display could be visible from across the room, but you can only see it if you’re near enough to peer over from above. What’s more, at least right now, the display is more of a novelty. By default it shows performance statistics such as FPS, CPU usage / temperature and fan speed which is useful for some folk. You can even change the TDP/power draw right from the display, but honestly, given that this thing is plugged in I’ve just been leaving it on the max 45W setting.

Swipe left on the screen, and the view changes to a date and time widget. Swipe one more time and there’s a virtual volume control along with the option to turn the display off. Fun fact, right now there’s no option to turn it back on again. I restarted the PC via Windows and it still didn’t come back to life. I tried once more via the physical power button and that worked, there’s a neater solution coming in the final software. Relatedly, Ayaneo is hoping users will create their own widgets for this display, so there’s definitely potential here. I’m sure it won’t be long before Doom is running entirely on the linux that runs that display.

Ayaneo AM02 NES-inspired mini PC
Photo by James Trew / Engadget

If you do want to use this just for gaming, then you’ll have to decide whether you want to use the company’s own launcher or not. On Ayaneo’s handhelds it’s useful for changing power settings on the fly and other tasks that would otherwise be a pain for a handheld. On a PC like this, the launcher is adequate, but you might want to find your own or just ditch it for the most part. I set the AM02 up to load right into Launchbox/Big Box which handles all my retro/Steam/Epic games just fine and gives a much more console-like experience. But that’s the joy of Windows for gaming I guess, you can do what you want with it.

Despite their diminutive size, mini PCs aren’t always cheap. Like their full-size counterparts, prices range wildly depending on their performance, storage and components. Ayaneo’s handhelds almost universally fell into the “premium” pricing category with nearly all its Windows models costing more than the Steam Deck they try to rival. The two mini PCs break that trend with both models offering, at worst, fair market prices and, at best, beating the competition.

Most direct rivals to the AM02 don’t have a built-in screen (though some do) or have quite as good a selection of inputs and outputs. That’s to say, overall the AM01 and AM02 are reasonably priced for their spec and even more so if you can scoop them up during the early-bird window, which at time of publication is still active for the AM02.

Ayaneo AM02 NES-inspired mini PC
Photo by James Trew / Engadget

There’s a small elephant in the room though. That is, if you’re looking for a true gaming PC, there are likely better ways to spend your money. The lowest spec AM02 costs more than a PS5. Or about the same as an LCD Steam Deck with a dock. Then there’s the Mac Mini which starts at $600 (with less memory and RAM but that M2 processor is no joke). So if gaming is your sole goal, then there’s a slim niche that the AM02 serves best — those looking for a mix of retro and PC titles that also want the flexibility of other media tasks (an easier way to watch Netflix with a VPN, for example) in a package that only draws the right kind of attention. Or maybe you just love it for its design and the capabilities work for you.

Mostly, it’s a promising new direction for a company that made a name for itself trying to take the Steam Deck head on. It might not have been truly successful in that specific mission, but it earned itself plenty of fans along the way for its high-spec handhelds that help re-establish portable gaming as an exciting category. As Ayaneo enters the more general PC market, it might well have found a space where it can excel against a very different type of competition.

This article originally appeared on Engadget at https://www.engadget.com/ayaneo-nes-inspired-am02-mini-pc-review-170029368.html?src=rss

An Elden Ring mobile game is reportedly in the works at Tencent

Tencent is in the midst of developing an Elden Ring game for mobile phones, according to Reuters. Apparently, if the Shenzhen-based tech company's plan pushes through, fans are getting a free-to-play title with in-app purchases, similar to the gacha game Genshin Impact. That's a complete departure from the original Elden Ring action RPG, which sells for $60 from the get-go and isn't loaded up with microtransactions. 

That's pretty much all the details Reuters has reported — according to the news organization's sources, progress on the project has been slow, so it may take a while before we see the game. That is, if the game even gets released: Tencent recently shut down the development of much-awaited Nier mobile game that had been in the works for two years. Tencent reportedly couldn't find a monetization model that would allow it to recoup what it cost the company to license the franchise from Square Enix, along with what it's going to spend to bring the project to completion. 

Tencent and Sony purchased a 30 percent share of FromSoftware, the Japanese developer behind Elden Ring, back in 2022. The Chinese company also acquired the licensing rights to develop the game back then and put together a team with a "few dozen people" to work on a prototype. Reuters says Tencent is hoping to give its aging library of games a boost with a new title, and one based on a wildly successful game like Elden Ring has the potential to become a hit. 

This article originally appeared on Engadget at https://www.engadget.com/an-elden-ring-mobile-game-is-reportedly-in-the-works-at-tencent-131229933.html?src=rss

Instagram will start telling night owl teens to close the app and go to sleep

Instagram has revealed its latest mindfulness feature targeted at teens. When a younger user scrolls for more than 10 minutes in the likes of Reels or their direct messages, the app will suggest that they close the app and get to bed.

These "Nighttime Nudges" will automatically appear on teens' accounts and it won't be possible to switch them off. Instagram didn't specify whether the feature will be enabled for all teenagers or only under-18s. 

The idea, according to Instagram, is to give teens who aren't already using features such as Take a Break reminders to close the app for the night. "We want teens to leave Instagram feeling like the time they spend on the app is meaningful and intentional, and we know sleep is particularly important for young people," Instagram said.

The new tool follows other features Instagram has rolled out to help teens and their parents manage time spent on the app. Along with Take a Break and parental supervision features, this includes the likes of Quiet Mode. The latter enables teens to mute notifications, automatically reply to messages and let their friends and followers know that they're unavailable and doing something else, such as studying or sleeping.

This article originally appeared on Engadget at https://www.engadget.com/instagram-will-start-telling-night-owl-teens-to-close-the-app-and-go-to-sleep-152600078.html?src=rss

Scientists extract the sharpest image of a black hole yet

Black holes are one of the most powerful forces in the universe, but we had never seen one until the Event Horizon Telescope (EHT) team released the first image back in 2019. Now, the EHT Collaboration has released the most detailed image yet of the same M87 black hole, created with the aid of an additional telescope and independent data from 2018, that better displays the insane physics behind these supermassive objects. 

The first image was captured in 2017 (it takes a long time to process the data) using eight high-altitude telescopes from locations including Chile and Antarctica. The complex technique required the synchronization of atomic clocks, use of the Earth's rotation and processing of petabytes of RAW telescope data. The result was slightly fuzzy, but clearly showed the expected "donut" with the black hole at the center and accretion disk made of matter inhaled from nearby stars. 

However, the EHT collaboration captured another image a year later using an additional telescope in Greenland. That "significantly" improved the image fidelity, particularly in the north-south direction, according to the EHT. One of the original platforms, The Large Millimeter Telescope, also gained sensitivity by using its full 50 meter surface for the first time. The teams also introduced new data analysis techniques that boosted accuracy.

The result is a sharper and brighter image that also clearly shows the Doppler/Einstein effects that cause a black hole to appear to be brighter on one side. That bright spot actually shifted to the right between the capture of the two images. 

"The biggest change, that the brightness peak shifted around the ring, is actually something we predicted when we published the first results in 2019," said Dr. Britt Jeter from Taiwan's ASIAA. "While general relativity says the ring size should stay pretty fixed, the emission from the turbulent, messy accretion disk around the black hole will cause the brightest part of the ring to wobble around a common center. The amount of wobble we see over time is something we can use to test our theories for the magnetic field and plasma environment around the black hole."

The new image also shows that the science behind the image technique is sound and reproduceable. "Confirmation of the ring in a completely new data set is a huge milestone for our collaboration and a strong indication that we are looking at a black hole shadow and the material orbiting around it," said Dr. Keiichi Asada from ASIAA. 

The EHT Collaboration will continue to advance the science with new observations set for the first half of 2024. At that time, scientists hope to capture multiple images to create the first "video" of a black hole to show its chaotic movements. As before, it could take several years (and the participation of many scientists) to get the final result. 

This article originally appeared on Engadget at https://www.engadget.com/scientists-extract-the-sharpest-image-of-a-black-hole-yet-131003088.html?src=rss

Samsung’s Galaxy S24 lineup puts generative AI front and center

Samsung unveiled its Galaxy S24 devices at its first Unpacked of the year. As expected, the three smartphones have a heavy focus on artificial intelligence-powered features, from the likes of live translations to image editing.

Galaxy AI, as Samsung is calling the devices’ overarching AI system, is behind a number of communication-focused functions. For one thing, Galaxy S24 devices will natively support live, two-way translations on phone calls without the need for a third-party app, Samsung says. Since processing for most AI features is handled on-device with the help of the Snapdragon 8 Gen 3 Chipset and its neural processing unit, the conversations will stay private (well, aside from eavesdroppers who might catch one half of the chat). You'll have the option to entirely disable online processing of data for any AI features.

A demo of Samsung's Live Translate feature on a Galaxy S24 device.
Photo by Sam Rutherford/Engadget

On a similar note, on-device processing also means that you won’t need cellular data or Wi-Fi connections to use AI features such as Interpreter. This enables you to display split-screen translations of an in-person conversation. Your device will also be able to generate transcripts of recordings — these can be summarized or translated as needed.

When it comes to dashing off text-based messages, Samsung says its Chat Assist feature can help you find the right tone. Samsung Keyboard can translate messages between 13 languages too. A Note Assist function in Samsung Notes can summarize texts, generate templates and create covers to help you identify the note you’re looking for.

Meanwhile, as you’re driving, Android Auto can summarize incoming messages and suggest relevant responses and actions for you to approve via voice command. These could include things like telling someone your estimated time of arrival.

A new search experience means that you'll be able to draw a circle around something on your screen and see related results from Google. Depending on your location and the search query, you may see an AI-generated overview that pulls information from the web to offer context and more details.

A demo of the digital zoom feature on a Samsung Galaxy S24 device.
Photo by Sam Rutherford/Engadget

AI will be a driving force behind the Galaxy S24 lineup's camera systems too. Samsung suggests it will help with digital zoom, image stabilization and when capturing photos and videos in low-light. A Super HDR feature is designed to help you see a lifelike preview of an image before pressing the shutter button.

When it comes to image editing, the suite of AI tools might come in useful. Galaxy AI will offer suggested tweaks to improve a photo, while the Generative Edit function can fill in parts of an image's background. This may prove handy if a shot is crooked and you want to straighten it, as the feature should let you move the subject and fix the background. Of note, you will need a network connection to use Generative Fill. Also, whenever you use generative AI to modify a photo, your phone will apply a watermark to the image and its metadata.

If you want to slow down a video that has a lot of activity, the Instant Slow-mo feature might help out. Samsung says this can generate extra frames based on movements in the original video to slow down the action smoothly. Last but not least, the camera systems in certain Galaxy S models feature HDR integration with third-party social apps. This means that when you look up an image in Gallery or your Instagram feed or reels, you'll see photos and videos in Super HDR.

It's little surprise that Samsung is going all in on AI with its latest Galaxy phones. The company previewed its AI models at the tail end of 2023, and word at the time suggested Samsung would deploy those functions broadly in the following months. Moreover, Samsung needs to keep pace with Google, which has been focusing more on AI features on Pixel phones for the last few years. Recent Pixel models are able to handle AI processing on-device too.

This article originally appeared on Engadget at https://www.engadget.com/samsungs-galaxy-s24-lineup-puts-generative-ai-front-and-center-180034530.html?src=rss

The ASUS AirVision M1 glasses give you big virtual screens in a travel-friendly package

At CES 2024, ASUS seems to have taken people by surprise with the announcement of its AirVision M1 glasses, with some viewing it as an alternative to Apple’s Vision Pro headset. But I discovered that ASUS’ glasses are much more of a novel alternative to portable monitors than something meant for spatial computing. 


The big difference between the AirVision M1 glasses and something like the Vision Pro or even Xreal’s Air 2 Ultras is that it doesn’t really support anything in the way of interactive AR. Sure, the glasses are able to project your desktop or multiple windows into space, but it needs to be tethered to a nearby device and doesn’t recognize hand gestures or other virtual objects. 

A (somewhat blurry) look at the MicroLED displays inside the ASUS AirVision M1 glasses
Photo by Sam Rutherford/Engadget

Instead, I found that its primary purpose is to give you extra screen space, but without the need to carry around big and bulky portable monitors. Featuring built-in microLED displays with a full HD resolution, the AirVisions can display up to six or seven virtual windows or desktops. You can also choose betwe

en a handful of aspect ratios (16:9, 21:9, 32:9 and more), with the glasses three degrees of freedom allowing you to either pin those screens in virtual space or track your head as you move around. 

Instead, I found that its primary purpose is to give you extra screen space, but without the need to carry around big and bulky portable monitors. Featuring built-in microLED displays with a full HD resolution, the AirVisions can display up to six or seven virtual windows or desktops. You can also choose between a handful of aspect ratios (16:9, 21:9, 32:9 and more), with the glasses three degrees of freedom allowing you to either pin those screens in virtual space or track your head as you move around. 

Instead, I found that its primary purpose is to give you extra screen space, but without the need to carry around big and bulky portable monitors. Featuring built-in microLED displays with a full HD resolution, the AirVisions can display up to six or seven virtual windows or desktops. You can also choose between a handful of aspect ratios (16:9, 21:9, 32:9 and more), with the glasses three degrees of freedom allowing you to either pin those screens in virtual space or track your head as you move around. Instead, I found that its primary purpose is to give you extra screen space, but without the need to carry around big and bulky portable monitors. Featuring built-in microLED displays with a full HD resolution, the AirVisions can display up to six or seven virtual windows or desktops. You can also choose between a handful of aspect ratios (16:9, 21:9, 32:9 and more), with the glasses three degrees of freedom allowing you to either pin those screens in virtual space or track your head as you move around. 

During my first demo, I used the AirVision M1s while tethered to a laptop, in which it behaved almost exactly like having a bit floating desktop that appeared to be hovering six feet in front of me. At first, the virtual displays were a little blurry, but after a short adjustment period and some time dialing in my IPD (interpupillary distance), I was pleasantly surprised by how sharp everything looked. When compared to something like Sightful Spacetop, which is billed as the world’s first AR laptop, not only did it have a much larger vertical field of view (up to 57 degrees), it also didn’t require any additional special equipment, as the glasses are essentially plug and play. While I didn’t need them, it’s important to note that the glasses come with a pair of nose pads to help ensure you can get a good fit, plus a prescription insert for people with glasses.

Once set up, it was pretty easy to create additional virtual workspaces. All I had to do was pull up a small command menu, press a plus sign where I wanted a new window to appear and that’s it. You can also freely adjust the overall size of the virtual display by zooming in or out. And one of the best things about the AirVisions is that using the laptop’s touchpad or typing wasn’t difficult at all. Because you can see through the virtual displays, I simply looked down and focused my eyes where they needed to go. That said, if you become distracted by something in the background, ASUS’ glasses also come with magnetic blinders that clip onto the front and provide a clean black backdrop.

However my favorite use case was when I tried a different pair of the AirVisions that were connected to an ROG Ally, where the glasses provided me with a massive virtual screen for gaming. In this way, it’s a lot like wearing a headset such as the Meta Quest 3, but for non-VR games. This is the kind of device I would love to have on a plane, where space is at a premium, especially for something like a portable monitor. That said, I’m not sure I could handle the embarrassment of being a modern day glasshole, at least not until devices like these become a bit more popular.

But perhaps the biggest difference between the AirVision M1s and Apple’s Vision Pro is price. While ASUS has yet to provide an official figure, a company spokesperson told me that ASUS is targeting around $700, versus $3,000 for Apple’s headset. And when you compare that to the price of a portable monitor, which often goes for between $250 and $400, and offers a lot less screen space, suddenly that price doesn’t seem too ridiculous.

So if you’re on the lookout for an alternative to the travel monitor, keep an eye for ASUS’ AirVision M1 glasses when they become available sometime in Q3 2024. 

We're reporting live from CES 2024 in Las Vegas from January 6-12. Keep up with all the latest news from the show here.

This article originally appeared on Engadget at https://www.engadget.com/the-asus-airvision-m1-glasses-give-you-big-virtual-screens-in-a-travel-friendly-package-234412478.html?src=rss

The ASUS AirVision M1 glasses give you big virtual screens in a travel-friendly package

At CES 2024, ASUS seems to have taken people by surprise with the announcement of its AirVision M1 glasses, with some viewing it as an alternative to Apple’s Vision Pro headset. But I discovered that ASUS’ glasses are much more of a novel alternative to portable monitors than something meant for spatial computing. 


The big difference between the AirVision M1 glasses and something like the Vision Pro or even Xreal’s Air 2 Ultras is that it doesn’t really support anything in the way of interactive AR. Sure, the glasses are able to project your desktop or multiple windows into space, but it needs to be tethered to a nearby device and doesn’t recognize hand gestures or other virtual objects. 

A (somewhat blurry) look at the MicroLED displays inside the ASUS AirVision M1 glasses
Photo by Sam Rutherford/Engadget

Instead, I found that its primary purpose is to give you extra screen space, but without the need to carry around big and bulky portable monitors. Featuring built-in microLED displays with a full HD resolution, the AirVisions can display up to six or seven virtual windows or desktops. You can also choose betwe

en a handful of aspect ratios (16:9, 21:9, 32:9 and more), with the glasses three degrees of freedom allowing you to either pin those screens in virtual space or track your head as you move around. 

Instead, I found that its primary purpose is to give you extra screen space, but without the need to carry around big and bulky portable monitors. Featuring built-in microLED displays with a full HD resolution, the AirVisions can display up to six or seven virtual windows or desktops. You can also choose between a handful of aspect ratios (16:9, 21:9, 32:9 and more), with the glasses three degrees of freedom allowing you to either pin those screens in virtual space or track your head as you move around. 

Instead, I found that its primary purpose is to give you extra screen space, but without the need to carry around big and bulky portable monitors. Featuring built-in microLED displays with a full HD resolution, the AirVisions can display up to six or seven virtual windows or desktops. You can also choose between a handful of aspect ratios (16:9, 21:9, 32:9 and more), with the glasses three degrees of freedom allowing you to either pin those screens in virtual space or track your head as you move around. Instead, I found that its primary purpose is to give you extra screen space, but without the need to carry around big and bulky portable monitors. Featuring built-in microLED displays with a full HD resolution, the AirVisions can display up to six or seven virtual windows or desktops. You can also choose between a handful of aspect ratios (16:9, 21:9, 32:9 and more), with the glasses three degrees of freedom allowing you to either pin those screens in virtual space or track your head as you move around. 

During my first demo, I used the AirVision M1s while tethered to a laptop, in which it behaved almost exactly like having a bit floating desktop that appeared to be hovering six feet in front of me. At first, the virtual displays were a little blurry, but after a short adjustment period and some time dialing in my IPD (interpupillary distance), I was pleasantly surprised by how sharp everything looked. When compared to something like Sightful Spacetop, which is billed as the world’s first AR laptop, not only did it have a much larger vertical field of view (up to 57 degrees), it also didn’t require any additional special equipment, as the glasses are essentially plug and play. While I didn’t need them, it’s important to note that the glasses come with a pair of nose pads to help ensure you can get a good fit, plus a prescription insert for people with glasses.

Once set up, it was pretty easy to create additional virtual workspaces. All I had to do was pull up a small command menu, press a plus sign where I wanted a new window to appear and that’s it. You can also freely adjust the overall size of the virtual display by zooming in or out. And one of the best things about the AirVisions is that using the laptop’s touchpad or typing wasn’t difficult at all. Because you can see through the virtual displays, I simply looked down and focused my eyes where they needed to go. That said, if you become distracted by something in the background, ASUS’ glasses also come with magnetic blinders that clip onto the front and provide a clean black backdrop.

However my favorite use case was when I tried a different pair of the AirVisions that were connected to an ROG Ally, where the glasses provided me with a massive virtual screen for gaming. In this way, it’s a lot like wearing a headset such as the Meta Quest 3, but for non-VR games. This is the kind of device I would love to have on a plane, where space is at a premium, especially for something like a portable monitor. That said, I’m not sure I could handle the embarrassment of being a modern day glasshole, at least not until devices like these become a bit more popular.

But perhaps the biggest difference between the AirVision M1s and Apple’s Vision Pro is price. While ASUS has yet to provide an official figure, a company spokesperson told me that ASUS is targeting around $700, versus $3,000 for Apple’s headset. And when you compare that to the price of a portable monitor, which often goes for between $250 and $400, and offers a lot less screen space, suddenly that price doesn’t seem too ridiculous.

So if you’re on the lookout for an alternative to the travel monitor, keep an eye for ASUS’ AirVision M1 glasses when they become available sometime in Q3 2024. 

We're reporting live from CES 2024 in Las Vegas from January 6-12. Keep up with all the latest news from the show here.

This article originally appeared on Engadget at https://www.engadget.com/the-asus-airvision-m1-glasses-give-you-big-virtual-screens-in-a-travel-friendly-package-234412478.html?src=rss

Our favorite accessibility innovations at CES 2024

So much of what we see at CES tends to be focused on technological innovation for the sake of innovation, or obvious attempts to tap into whatever trend is gripping the internet's attention that year. In the last few shows, though, there has been a heartening increase in attention to assistive products that are designed to help improve the lives of people with disabilities and other different needs. At CES 2024, I was glad to see more development in the accessibility category, with many offerings appearing to be more thoughtfully designed in addition to being clever. It's so easy to get distracted by the shiny, eye-catching, glamorous and weird tech at CES, but I wanted to take the time to give due attention to some of my favorite accessibility products here in Las Vegas.

GyroGlove

Before I even packed my bags, numerous coworkers had sent me the link to GyroGlove's website after it had been recognized as an honoree for several CES Innovation awards. The device is a hand-stabilizing glove that uses gyroscopic force to help those with hand tremors minimize the shakes. Because the demo unit at the show floor was too large for me, and, more importantly, I don't have hand tremors, I couldn't accurately assess the glove's effectiveness. 

But I spoke with a person with Parkinson's Disease at the booth, who had been wearing one for a few days. She said the GyroGlove helped her perform tasks like buttoning up a shirt more easily, and that she intended to buy one for herself. At $5,899, the device is quite expensive, which is the sad state of assistive products these days. But GyroGlove's makers said they're in talks with some insurance providers in the US, which could lead to it being covered for those in America who could benefit from it. That's one of the biggest reasons that led us to name GyroGlove one of our winners for CES 2024

A down-up look at the MouthPad inside a person's mouth.
Photo by Cherlynn Low / Engadget

MouthPad

I did not think I'd be looking deep into a person's mouth and up their nose at CES 2024, but here we are. Sometimes you have to do strange things to check out unconventional gadgets. The MouthPad is as unusual as it gets. It's a tongue-operated controller for phones, tablets and laptops, and basically anything that will accept a Bluetooth mouse input. The components include a touchpad mounted onto the palette of what's essentially a retainer, as well as a battery and Bluetooth radio. 

As odd as the concept sounds, it actually could be a boon for people who aren't able to use their limbs, since your tongue, as a muscle, can offer more precise movement and control than, say, your eyes. If you're feeling apprehensive about sticking a device inside your mouth, it might be helpful to know that the battery is from the same company that's made them for medical-grade implants, while the rest of the dental tray is made from a resin that's commonly used in aligners and bite guards. The product is currently available as an early access package that includes setup and calibration assistance, with a new version (with longer battery life) slated for launch later this year.

OrCam Hear

Assistive tech company OrCam won our Best of CES award for accessibility in 2022, so I was eager to check out what it had in store this year. I wasn't disappointed. The company had a few updated products to show off, but the most intriguing was a new offering for people with hearing loss. The OrCam Hear system is a three-part package consisting of a pair of earbuds, a dongle for your phone and an app. Together, the different parts work to filter out background noise while identifying and isolating specific speakers in a multi-party conversation.

At a demo during a noisy event at CES 2024, I watched and listened as the voices of selected people around me became clear or muffled as company reps dragged their icons in or out of my field of hearing. I was especially impressed when the system was able to identify my editor next to me and let me choose to focus on or filter out his voice. 

Audio Radar

If you're a gamer, you'll know how important audio cues can sometimes be for a successful run. Developers frequently design the sound environment for their games to be not only rich and immersive, but to also contain hints about approaching enemies or danger. Players who are hard of hearing can miss out on this, and it's not fair for them to be disadvantaged due to a disability. 

A product called Audio Radar can help turn sound signals into visual cues, so that gamers with hearing loss can "see the sound," according to the company. The setup is fairly simple. A box plugs into a gaming console to interpret the audio output and convert it into lights. A series of RGB light bars surround the screen, and display different colors depending on the type of sound coming from the respective direction they represent.

CES 2024 saw not just Audio Radar's official launch, but was also where the company introduced its SDK for game developers to create custom visual cues for players who are hard of hearing. The company's founder and CEO Tim Murphy told Engadget that it's partnering with Logitech, with the gaming accessory maker "providing support as we further develop our product and design our go-to-market strategy." 

A person wearing the TranscribeGlass on the right side of a pair of black-framed glasses.
Photo by Cherlynn Low / Engadget

Transcribe Glass

Google Glass was resurrected at CES 2024. Sort of. A new product called Transcribe Glass is a small heads up display you can attach to any frames, and the result looks a lot like the long-dead Google device. It connects to your phone and uses that device's onboard processing to transcribe what it hears, then projects the text onto the tiny transparent display hovering above the eye. You'll be able to resize the font, adjust the scrolling speed and choose your language model of choice, since TranscribeGlass uses third-party APIs for translation. Yes, it converts foreign languages into one you understand, too. 

The company is targeting year's end for launch, and hoping to offer the device at $199 to start. When I tried it on at the show floor, I was surprised by how light and adjustable the hardware was. I had to squint slightly to see the captions, and was encountering some Bluetooth lag, but otherwise the transcriptions took place fairly quickly and appeared to be accurate. The TranscribeGlass should last about eight hours on a charge, which seems reasonable given all that it's doing. 

Samsung's subtitle accessibility features

Though we didn't catch a demo of this in person, Samsung did briefly mention a "sign language feature in Samsung Neo QLED" that "can be easily controlled with gestures for the hearing impaired, and an Audio Subtitle feature [that] turns text subtitles into spoken words in real-time for those with low vision." We weren't able to find this at the show, but the concept is certainly meaningful. Plus, the fact that Samsung TVs have mainstream appeal means these features could be more widely available that most of the niche products we've covered in this roundup.

We're reporting live from CES 2024 in Las Vegas from January 6-12. Keep up with all the latest news from the show here.

This article originally appeared on Engadget at https://www.engadget.com/our-favorite-accessibility-products-at-ces-2024-170009710.html?src=rss