Tag Archives: ar glasses

Meta’s futuristic Orion AR Glasses have Holographic Displays and Neural Control. Apple should take notes

Posted on by

At the Meta Connect 2024 keynote, not only did Mark Zuckerberg debut actual Augmented Reality with holographic displays and neural control, it did so in a device that’s smaller, lighter, and one could argue, more socially acceptable (aka stylish) than Apple’s Vision Pro. Dubbed the Orion, it’s simply a developer prototype for now, but Meta hopes to refine the design, improve the displays, and actually sell it at an affordable price to consumers.

Designer: Meta

Orion is not a bulky headset—it’s a sleek, spectacle-like device that weighs under 100 grams, making it comfortable for extended use. This is an impressive feat considering the amount of technology packed into such a small form factor. While Meta Quest Pro and Apple’s Vision Pro are capable of mixed reality, Orion’s fully transparent, holographic display takes things to a different level. Instead of the passthrough experiences that blend digital elements on top of a live camera feed, Orion projects 3D objects directly into the real world using innovative waveguide technology. The frames are made from magnesium, a super-light metal known for its strength and ability to dissipate heat (something even NASA’s relied on for its space hardware).

The core of this magic is a set of tiny projectors embedded within the arms of the glasses. These projectors beam light into lenses that have nanoscale 3D structures, creating stunningly sharp holographic displays. Zuckerberg emphasized that you could go about your day—whether you’re working in a coffee shop or flying on a plane—while interacting with immersive AR elements like a cinema-sized virtual screen or multiple work monitors.

But it’s not just about visuals. The glasses also facilitate natural social interaction: you can maintain eye contact with others through the transparent lenses, and digital elements seamlessly overlay onto the real world. Need to send a message? Instead of fumbling for your phone, a hologram will appear before your eyes, letting you reply with a quick, subtle gesture. This fluid integration of the digital and physical worlds could set Orion apart from its competitors.

When it comes to control, the Orion glasses offer several interaction modes—voice, hand, and eye tracking—but the star of the show is the neural wristband. In contrast to the Vision Pro, which relies on hand gestures, eye-tracking, and voice commands, Orion takes the next step by reading neural signals from your wrist to control the device. This neural interface allows for discreet control. Imagine being in a meeting or walking down the street—gesturing in mid-air or speaking aloud commands isn’t always convenient. The wristband can pick up subtle electrical signals from your brain and translate them into actions, like tapping your fingers to summon a holographic card game or message a friend. This introduces a new level of human-computer interaction, far more intimate and nuanced than what’s currently available on the market.

While Apple’s Vision Pro and Meta’s previous Quest Pro have been praised for their intuitive interaction systems, Orion’s neural control represents a massive leap forward. It reduces the friction of interacting with digital elements by cutting down on the physical and vocal gestures required, creating a more seamless experience.

One of the key differentiators for Orion is its display technology. Unlike the Vision Pro or Meta Quest Pro, which rely on cameras to pass a live feed of the outside world onto a screen, Orion offers true augmented reality. The glasses project digital holograms directly into your field of view, blending with your surroundings. This isn’t just a camera feed of your environment with digital elements superimposed—it’s real-world AR with transparent lenses that you can see through as you would normal glasses. The holograms are bright enough to stand out even in varied lighting conditions and sharp enough to allow users to perceive fine details in their digital overlays.

Zuckerberg illustrated this with examples: receiving a message as a floating hologram or “teleporting” a distant friend’s avatar into your living room. The display architecture is entirely new, made possible by custom silicon chips and sensors integrated into the glasses, offering a level of immersion that’s more subtle yet more profound than the pass-through systems we’ve seen so far. In a private demo, he even played a metaverse version of Pong with key industry experts like Nvidia CEO Jensen Huang, and investors like Gary Vaynerchuck and Daymond John of Shark Tank.

For all its innovation, Orion is still in the development phase. Zuckerberg was candid that Orion is not yet ready for consumers. Instead, it will serve as a development kit for Meta’s internal teams and a select group of external partners. This will help refine both the hardware and software, as well as grow the ecosystem of apps and experiences that will make Orion valuable when it eventually hits the consumer market. There’s also the matter of affordability—Zuckerberg mentioned the team is working to improve manufacturing processes to bring the cost down. As it stands, this isn’t a device you’ll see in stores next week, but it’s a crucial step in realizing Meta’s vision for the future of AR.

The potential for Orion is vast. Zuckerberg envisions it as the next major computing platform, capable of reshaping how we work, play, and interact with others. By leveraging the power of true augmented reality with a groundbreaking neural interface, Orion positions itself as more than just a wearable gadget—it’s an entirely new way of interfacing with the digital and physical worlds. For now, it’s an exciting glimpse into what the future might hold. The Orion glasses may not be in your hands today, but their arrival could redefine the entire AR landscape in the years to come.

The post Meta’s futuristic Orion AR Glasses have Holographic Displays and Neural Control. Apple should take notes first appeared on Yanko Design.

Ergonomic controller suggests a more comfortable way to use XR glasses

Posted on by

The launch of the Apple Vision Pro sparked renewed interest in extended reality experiences, both those offered by full-blown and heavy headsets as well as those pushed by more straightforward glasses. The latter often rely on your smartphone or a dedicated remote control to navigate through apps projected in front of you, an indirect interaction method made more awkward by the standard design of these devices. Remote controls might be fine for TVs and appliances, but not when you can barely see your own hand. This concept design tries to challenge convention by redesigning the face of a remote, offering a more ergonomic and simpler way to move around mixed reality while wearing those XR glasses.

Designer: Yiqiao Liu

XR or eXtended Reality glasses like the Xreal Air and TCL RayNeo can probably be called the poor man’s Vision Pro. They practically display a virtual monitor in front of you, which may or may not be pinned in an arbitrary location or follow your head around. This allows the glasses to be lighter, cheaper, and less conspicuous, though they do look like overgrown sunglasses. This also makes using the XR platform feel a bit more familiar because they more or less correspond to familiar operating systems like Windows or Android.

Moving around and interacting with objects in this XR space is then a simpler matter as well, and some even use the phone itself as a pointer and remote control, which is difficult to use when your vision is partially obscured by the glasses and all your fingers can feel is a flat and featureless surface. On the other hand, conventional remotes with their numerous buttons and straightforward layout can also be cumbersome to use as well.

The XR Glasses Controller concept takes the minimalist design of something like an Apple TV remote and tilts it at an angle. Visually, this soap-shaped device looks like an unbalanced remote, with the top buttons leaning to the right and the bottom touch dial sliding to the left. It’s not a design that was made just to look different, though it definitely gives it a distinctive appearance.

The theory behind this design is the mobility and limited range of our thumbs when holding a remote. As many smartphone designers already know by now, the thumb holding the remote moves naturally in an arc, and that up-and-down movement can cause more strain. The controls are thus aligned with this arc, making it easy for the user to switch between buttons and touchpad without having to overextend or bend their thumb. Along with the significantly reduced number of buttons, the remote is easier to use as well, though it does limit itself to Android-based XR platforms since those buttons perfectly match Android’s navigation scheme.

The post Ergonomic controller suggests a more comfortable way to use XR glasses first appeared on Yanko Design.

XREAL Beam Pro is an Android mobile device for creating and enjoying AR content

Posted on by

The launch of the Apple Vision Pro has made people interested in augmented reality and spatial computing technologies again, but the price tag on that product, not to mention its limited availability, means very few will be able to see what the fuss is all about, pardon the pun. On the other end of the spectrum, headsets like the Meta Quest, primarily designed for VR and the Metaverse, are indeed more accessible but also less comfortable to use, let alone bring along with you anywhere. Fortunately, these aren’t the only options, and AR glasses like the Xreal Air series have been trying to give everyone a taste of AR, regardless of what device they have. To make the experience even easier, XREAL is launching a curious new device that looks like a smartphone and acts almost like a smartphone, except that it’s dedicated to letting you not only consume but even create content in full 3D AR.

Designer: XREAL

AR glasses practically act like second or external monitors to computers and smartphones, relying on an external device for all the computing, content, and even power. The spectacles themselves provide the image projection hardware and sensors that can then be used by that external device to do things like pinning a screen to a specific location or even displaying a wall of windows that follow your head movement. This design simplifies the setup and saves you from having to spend too much on powerful hardware that will be quickly outdated, but it also means the experience isn’t exactly optimized for AR.

The new XREAL Beam Pro solves that problem by offering a device and a user experience tailored specifically for augmented reality, especially around the brand’s line of AR glasses. And it does so in a form that’s all too familiar to everyone these days: an Android phone. The device features a 6.5-inch LCD 2K (2400×1080) touchscreen running a customized version of Android 14 with Google Play support. It’s even powered by a Snapdragon processor with up to 8GB of RAM and 256GB of internal storage, just like a phone. The similarities with a phone, however, end there.

Running on top of Android is XREAL’s NebulaOS, a user interface designed for augmented reality, and it kicks in once you connect an Xreal Air or later models. This software allows you to enjoy “normal” 2D content as if they were made for AR, letting you place two windows side by side, have them stick to their position “in the air” no matter where you turn your head, or have the display follow your head smoothly. Thanks to built-in sensors in the glasses, users can enjoy 3DoF (Xreal Air, Air 2, Air 2 Pro) or 6DoF (Xreal Air 2 Ultra) smooth movement so you don’t have to manually adjust the screen each time.

What all this means is that you can enjoy all your favorite Android games, streaming content, and even Internet activities in an immersive AR environment, anytime anywhere. Even better, the dual 50MP cameras on its back are intentionally spaced far apart to let you create 3D content as well. XREAL has partnered with many cloud service providers to bring as much content to your hands and eyes as possible, including NVIDIA’s CloudXR platform, Amazan Luna and Xbox Cloud Gaming streaming services, and more.

That said, some people might be a bit confused by the XREAL Beam Pro’s phone-like design and Android interface. While it does have Wi-Fi and 5G, it doesn’t seem to support phone features like calls and SMS, especially if it doesn’t have a built-in mic. It’s still a perfectly usable data-only Android handheld, though, even without the XREAL Air glasses, but you’ll be missing out on what makes the device special in that case. Global pre-orders for the XREAL Beam Pro start today with a rather surprising price tag of $199 for the base 6GB RAM/128GB storage model.

The post XREAL Beam Pro is an Android mobile device for creating and enjoying AR content first appeared on Yanko Design.

World’s First AR Glasses that correct Partial Retinal Blindness: Hands-on with Eyecane AR at MWC 2024

Posted on by

I’ve always said that great technology doesn’t cater only to the needs of the dominant 95%, it also factors in the needs of the often neglected 5%. To that end, AR technology is great, but it hasn’t been applied in a way that benefits the 5th percentile – and Cellico wants to change that. The medical-tech company unveiled the Eyecane AR glasses at MWC, the world’s first augmented reality device designed to correct age-related macular degeneration (AMD).

Designed to look and feel like your standard sunglasses, the Eyecane AR helps people with retinal disease see clearly. A 4K camera at the center of the glasses records the world, feeding media into a tiny projected display within the Eyecane AR’s lenses. AMD causes blind spots within people’s vision, but the Eyecane AR’s cameras help fill in those blind spots with digitally captured imagery in real time, helping people see fully and clearly again.

Designer: Cellico

A disease that affects as many as 1 in 200 people by the time they reach 60, going up as high as 1 in 5 people by the time they hit their 90s. The affliction, caused by the degeneration of the macula (the central part of the retina) results in blurry or sometimes even no vision in the center of your eye. Think of a large black dot in otherwise relatively clear vision. Given that a lot of the important things we see find themselves in this central zone, people with AMD can have a tough time looking at objects, identifying people, and navigating scenarios. Cellico’s solution is incredibly simple – have a camera capture whatever is in that gap, and display it in the corner of your eye, where you can still see things relatively clearly. Creating somewhat of a picture-in-picture effect, Eyecane AR allows people with AMD to regain vision in their macular region simply by having a camera capture it and display it in another part of their field of view.

A snap-on sunshade helps people see clearly in bright settings too

By harnessing the power of a compact 4K 20MP camera seamlessly integrated into smart glasses and complemented by an intuitive mobile app, Eyecane AR captures and processes real-time images with precision, even applying optical image stabilization. These images are then projected onto an augmented reality display in Full-HD, effectively shifting central vision to the peripheral field of view. This groundbreaking approach not only restores clarity but also rekindles independence for those navigating the challenges of AMD.

simulates how people with AMD perceive the world, and how the Eyecane AR can help fill in the gap with a PIP on the left side.

Moving the PIP to the center of the screen shows what images would look like for people with regular vision.

The beauty of the Eyecane AR lies in the fact that it can be used right out of the box without a hospital visit. The Eyecane app has a built-in scotometry program that analyzes your vision for you, pinpointing the blind spot or the problematic area in your vision. The app then helps the AR glasses’ camera calibrate and focus on that region, capturing the image and displaying it in a corner of your peripheral vision. The entire process takes mere minutes, and helps quickly restore macular vision simply by relying on the inherent properties of augmented reality displays!

Key Features of Eyecane AR:

  • 4K camera with Optical Image Stabilization (OIS) embedded in AR glasses
  • Mobile app featuring a customized image-processing engine
  • Full HD Reflective Freeform crystal Lens offering a Field of View (FoV) of 40°
  • Voice control functionality for seamless user interaction
  • Electric Auto Sunshade coated with an LC film, ensuring optimal visual comfort in diverse lighting conditions
  • Lightweight construction, crafted from Titanium and Ultem materials, prioritizing comfort and wearability

The post World’s First AR Glasses that correct Partial Retinal Blindness: Hands-on with Eyecane AR at MWC 2024 first appeared on Yanko Design.

If the Apple Vision Pro and the Google Glass had a baby, these AR glasses would be it…

Posted on by

Showcasing their tech at the Mobile World Congress, Everysight is riding the new AR (or should we call it Spatial) wave with the Maverick, their small, sleek, and stylish glasses that challenge the bulky mixed reality glasses and headsets we see today with something so close to regular glasses, you wouldn’t be able to tell the difference. Designed with a projected display that lets you see data and metric overlaid on the existing world, the Maverick uses an entire slew of sensors to track position, orientation, and head-tilt to ensure that digital elements remain in your line of sight (LOS) and correctly oriented. In fact, the Maverick even bagged multiple awards last year, including the iF Design Award and the Red Dot Award.

Designer: Everysight

Unlike most AR headsets that can make you look a little dystopian when walking down the streets or sitting in a subway (we’re looking at you, Vision Pro wearers), the Maverick stands at the intersection of great tech and fashion. Weighing in at under 47 grams, these glasses boast a sporty, ergonomic frame that promises comfort for all-day wear, a crucial consideration for devices intended to be part of our daily lives. This comfort does not come at the expense of durability or style, making them a versatile accessory suitable for any occasion.

AR glasses are only as good as their displays (something that most Vision Pro users will swiftly point out – which is why the Maverick impresses with its crisp, high-contrast visuals despite its tiny package. Utilizing a Sony Color microOLED display, it delivers stunning visuals characterized by vibrant colors and sharp details. The high-brightness display guarantees an optimal viewing experience in both indoor and outdoor settings, a testament to the glasses’ adaptability and user-centric design.

Ease of use is at the forefront of the Maverick design, with an intuitive interface that allows users to navigate and control features through simple gestures. This user-friendly approach is further enhanced by advanced sensors like a 3D accelerometer, gyro, and magnetometer, which provide accurate line-of-sight tracking for an immersive augmented reality experience.

Battery life is a perennial concern for wearable technologies, and here, Maverick impresses with over 8 hours of continuous operation. This endurance is complemented by efficient power management, ensuring that the glasses support a day’s worth of activities without needing a recharge. Such longevity is essential for users who demand reliability from their smart devices.

User interface and interaction are streamlined for ease of use. Maverick features an intuitive interface that allows for effortless navigation and control through simple gestures. This ease of use is further enhanced by the inclusion of a 3D accelerometer, gyro, and magnetometer, providing accurate line-of-sight tracking that enriches the augmented reality experience by aligning virtual objects with the real world seamlessly. Moreover, the Maverick glasses are designed with inclusivity in mind. They offer an RX solution with personalized lenses tailored to individual prescriptions, ensuring that users with varying visual needs can enjoy the benefits of smart eyewear without compromise.

Connectivity is robust, with Bluetooth 5.2 ensuring seamless pairing with a wide range of devices, including iOS and Android smartphones, as well as Apple Watch and Android Wear. This connectivity underpins the Maverick’s versatility, making it a central hub for notifications and digital interactions on the go.

In the box, users will find everything needed to start their journey with Maverick: tinted removable visors, a charging cable, a carrying case, a pouch, a cleaning cloth, and interchangeable nose pieces. Everysight is selling a developer edition of the Maverick for $399, although it’s unclear when the public rollout will begin, and what the price will be for regular consumers.

Everysight’s Maverick glasses represent a significant advancement in smart eyewear, proving that it’s possible to stay stylish while benefiting from the latest in wearable technology. They set a new benchmark for combining practicality with elegance, ensuring users can stay connected in a visually compelling, productive, and convenient manner. If these glasses could brew coffee, we might never find a reason to take them off.

The post If the Apple Vision Pro and the Google Glass had a baby, these AR glasses would be it… first appeared on Yanko Design.

TECNO combines AR Glasses and a Windows handheld PC into a new gaming experience

Posted on by

Thanks to a certain fruity company, AR glasses and headsets are back in the news. We’re still at an exciting exploration stage where we are trying to discover what works and what doesn’t as far as user experiences go, at least based on the limitations of current technology. AR glasses and their headset cousins often come in two basic designs. One packs all the necessary computing hardware to drive AR experiences, which is great for independence but not so much for comfort. On the opposite side of the spectrum lies headsets that need to connect to a desktop or laptop, removing performance limits but tying users down to a heavy or immovable computer. Leveraging the recent trend in gaming PCs, the TECNO Pocket Go is an all-in-one solution that combines the best of worlds by pairing lightweight AR glasses with a powerful gaming computer that you can hold in your hands.

Designer: TECNO

As much as might dream of hi-tech Ray-Bans like Tony Stark’s, we still can’t fit that much hardware inside regular spectacles given our current level of technology. To make augmented or mixed reality glasses lightweight and relatively comfortable to wear for long periods of time, they need to have only the bare minimum to display high-quality images for both eyes. At the same time, however, it will need an external computer that does all the heavy work of processing what needs to be displayed, but it also has to be portable enough not to get in the way of your mobility.

That’s the perfect combination that the TECNO Pocket Go tries to offer, a system that’s made up of the TECNO AR Pocket Vision glasses and the TECNO AR Pocket Windows Handheld computer that comes in the form of a large game controller. The AR Pocket Vision boasts a 0.71-inch Micro-OLED display that can emulate a gigantic 215-inch screen, at least if you want something of that size. It has a 6-axis gyroscope that can accurately detect your head movements and translate that into data that the AR software can use. Despite the name, the AR Pocket Vision also pays close attention to sound, delivering an immersive audio experience thanks to N’BASS nano-structured acoustic materials and TECNO’s own unique vibration enhancement algorithms that turn in-game audio into vibrations.

The AR Pocket Windows Handheld delivers an even more portable experience that is 50% smaller and 30% lighter than your average handheld gaming PC today. Of course, it accomplishes that by taking the screen out of the equation since it will be connected to the AR Pocket Vision glasses anyway. That means the design can focus on performance and cooling while also improving the overall ergonomics of the handheld computer. It even has a replaceable battery so users can enjoy uninterrupted gaming and entertainment on the go.

Having an AR headset and a handheld computer working together is a very potent combination, and having both under a single brand and a single system significantly simplifies the overall user experience. And while the TECNO Pocket Go is primarily aimed at immersive gaming, such a power and portable system can also open the doors to other experiences, provided you’re fine with using a gamepad to control it all. TECNO hasn’t given word on when this pair will launch, but it will definitely spark the interest of gamers who want to take their handheld gaming experience to the next level.

The post TECNO combines AR Glasses and a Windows handheld PC into a new gaming experience first appeared on Yanko Design.