Touchscreens drive our world, but they still suck in 2022

Companies would have us dreaming of a future filled with displays we can see through and screens we touch to use, but the current state of the technology makes that future vision a little less convincing.

Our world today revolves around computers in all shapes, sizes, and power. A good number of them have screens, and a growing number of these even have touch screens. What was once limited to phones and kiosks is now becoming mainstream, even on laptops that can’t bend backward completely to become a tablet. In the near future, almost every foreseeable physical interface to a computer could be through these touchscreens. But if the current condition of the technology is to be considered, they have a long way to go before becoming the ideal way we interact with the computers around us.

State of the Art

That’s not to say that touch screens haven’t evolved significantly over the past years. The world graduated from the resistive touch screens of old, like those used by Palm, to the capacitive technology heralded by the very first iPhone. Screens have become more pixel-dense, resulting in higher quality images and also more responsive, especially for gaming purposes.

Designer: BOE

Let’s not forget the latest trends in mobile either, like foldable and rollable displays for phones and even TVs. But while these seemingly futuristic developments indeed impress in their visual appearance and design, they all still feel unnatural and artificial to us humans. And yet most of the products and experiences that visionaries and futurists talk about depend on these touch screens becoming second nature.

Designer: LG

Designer: Samsung

Future Vision

Before the metaverse, many companies fed people a vision of the future where you’d not only see a screen everywhere; you’d also be able to interact with them. In addition to almost paper-thin screens that fold like a newspaper, we’re also shown bus stations with interactive walls, windows that display information and can be tinted with a swipe of a finger, and store displays that let you try out clothes without even putting them on.

Designer: Microsoft

Even with the buzz around VR, AR, MR, XR, and the metaverse, some people will prefer to use screens rather than put on glasses and gloves to navigate the digital realm. Until the day we can project holograms anywhere and interact with them without any special device, touch screens will still be the most immediate way we can interact with devices and the digital realm. Videos and images depicting these feature visions make them look so fluid and so natural. But as anyone who has used phones and tablets, touch screens are anything but.

Designer: Corning

Human Factor

There is no perfect input method for computers, at least nothing that has been developed yet. Keyboard and mice carry with them the risk of repetitive strain injury, while styluses are an imperfect approximation of pencils and pens, especially when you consider that they’re sliding on glass. And while touch screens can practically turn any surface into an input device, they seem to almost go against aspects of human nature itself.

Feedback

Humans have five basic senses, but most of us tend to take the other three or four for granted until we lose them. Despite their name, touch screens actually feel unnatural precisely because they don’t complete the whole tactile picture that our minds need to process when interacting with physical objects. Pushing a button looks like pushing a button but also requires our brains to make something like a leap of faith that it really does what it’s supposed to do.

Tactile response and haptic feedback for touch screens have long been on the plate of engineers and designers, but we’re no closer to cracking the code. There have been numerous patents filed to solve that puzzle, from deformable screens to extremely localized vibrations, but those have mostly remained in the realm of ideas. We still have ways to go, and our brains haven’t yet evolved to the point that we can just ignore the human need for touch.

Designer: Tactus Technology

Touchscreens aren’t great at accessibility either, and their use often requires fine motor control. There are settings to increase the sensitivity of the touch sensor, but these are mostly band-aid solutions to an inherent problem. Of course, some devices do allow for alternate input methods like voice control, but these often come up short and don’t provide all the features and conveniences of a touch-centric user experience.

Familiarity

Humans are also creatures of habit, which is how many of us have been able to survive through the millennia. We are able to memorize some activities and have them run on autopilot while our minds are more actively engaged in other aspects. Imagine how the world would have been like if we had to put intense focus on writing a simple letter because we have to remember how to do each stroke.

Designers: Stephen Cheng & Chris Andreae

Part of that is thanks to muscle memory, which, in turn, depends on things being where they are almost 100% of the time. You don’t have to look at the keyboard each time to check if the letter “q” hasn’t moved around, and neither do you need to double-check that the left mouse button hasn’t switched sides. Some people in the past have grown the ability to type quickly and accurately on the T9 keypad of old phones because their fingers knew exactly where each button was and how many times to press it for specific letters. In contrast, it’s nearly impossible to use a touch screen without looking at it, especially when software updates change how big buttons are or where they’re located.

Designer: Apple

That’s not to say that humans will remain this way forever. In the past decades alone, we have formed habits and developed gestures that already look alien to older generations. Conversely, younger people have a hard time believing that anyone could type out messages using a keypad with rapid speed and deadly accuracy. Evolution, however, doesn’t happen in just a span of decades or even centuries, and humans will continue to remain beholden to their senses and the physicality of their bodies.

Flexibility

Touch screens, being based on digital user interfaces, have the advantage of not being locked to a single implementation. It’s definitely much easier to change the layout of a screen than to change the knobs on a physical panel. The arrival of foldable and rollable panels also means that screens have become literally more flexible, but these are not the kinds of flexibility that today’s touch screens lack.

Touch screens actually put limits on how you can use them or the devices they’re attached to. The number of gloves advertised to work with touch screens is a testament to how these screens aren’t usable under conditions where their analog counterparts have no problem. You can’t confidently take out your phone under a heavy downpour, but you’ll have no problems using a payphone with your soaking hands.

Designer: Adrien Beyk of Quanta Vici

Devices that rely on touch screens also become nearly useless when those screens break. Sometimes, it’s not even possible to back up or reset a phone so that you can safely send it for repairs without worrying about your private data. They need to be repaired or replaced first before the device can even be wiped, which defeats the purpose of securing the phone first. Until then, the device is as good as dead, no matter how advanced or how powerful it might be.

Endgame: Sustainability

Touch screens are the most common ways we interact with devices today, be it phones, computers, interactive displays, or smart home hubs. They might become the main points of interaction for everything in the world in the near future, short of being able to manipulate holograms and virtual objects floating in thin air. It is somewhat ironic, then, that they are the least sustainable among the different input methods we have today.

Displays themselves already consume power, and the materials used to make them aren’t the most environment-friendly options. Companies like Samsung are developing more power-efficient panels to reduce electricity consumption, and some are looking into alternative materials for components. Unfortunately, that’s just part of the problem.

Designer: Fairphone

The entire industry and its ecosystem seemed to be designed to be unsustainable by default. Only one phone manufacturer, for example, has made repairability and sustainability its main selling point, and it’s just a small drop in the ocean. Screens, in general, feel like throwaway components that add to the growing e-waste of the planet. Device manufacturers generally frown upon self-repairs and third-party replacements, making the process costly as well. In a future where there will be screens left and right as the primary way we interact with things in our world, that vision becomes a bit of a nightmare, especially for our planet.

A New Hope

Things don’t have to end on a depressing note, of course. Humans are pretty creative and ingenious in finding solutions to their problems, even if it takes a long time to develop the correct one. The current state of technology, particularly with touch screens, just represents a milestone in history, not its final state. Fortunately, there are clear signs of things turning for the better.

As mentioned, there are efforts to make screens themselves be more power-efficiency and consume less electricity. These might sound like small wins, but they do all add up. When all our screens use only a fraction of the power they do today, the overall carbon footprint these devices incur can significantly be reduced.

Designer: Samsung

Additionally, big companies today are now more aware of the environmental impacts of their products and processes, as well as their responsibilities in making sure that future generations still have a world to live in. Some are trying to switch to more sustainable packaging solutions, while many are trying to reduce their carbon emissions during production. We still have a lot of work to do, however, in making products more sustainable and repairable, prolonging their life even beyond legally required warranties.

The other technical problems, unfortunately, might be harder to solve with the current state of our technologies. Screens that can deform to give a better tactile response when pressing a button are very much the dream of many display makers, engineers, and designers. It’s not something we might be able to achieve this year, but it is definitely something to look forward to in our future visions.

The post Touchscreens drive our world, but they still suck in 2022 first appeared on Yanko Design.

This haptic wearable brings physical touch to audio for an immersive multimedia experience

We’ve got so many gadgets these days to elevate our sensory experience right from the comfort of your home – be it the crisp displays or the high-end audio equipment to immerse you in action. But the third sensory experience of touch is what we miss. Just imagine you are in-game battling it out with other players and the audio and visual experience is matched by the thumping in your chest, taking things to a whole new level. Or while listening to your favorite music, the beats are matched by the vibrating rhythm in your body – won’t that be worth experiencing?

Giving this very imagination a concrete pallet of practicality, Kyle Hamm has intended to design Waveform, a wearable that lets you feel the deep bass in your chest, matching the audio frequency being beamed in your ears by the pair of headphones. Similar to that vibration in your chest while at a live music concert – this gadget adds the dimension of touch to the audio. Learning from some of the prototypes that want to achieve something similar, Kyle focused on the portability, ergonomics, and comfort of the Waveform. After digging deep about the design and the functionality Kyle determined that the vibration is best felt on the front and back of the chest.

Thus came to life the blueprint and prototype of Waveform that’s inspired by the rhythmic movement of stone skips on the surface of the water. To ensure the vibration of the contoured gadget reaches the body, Waveform has spring-loaded arms to create tension with subtle pressure. It’s got to be the most comfortable armor that you can think of, but for a completely different utility. With the arm slide on a rail, the height placement can be adjusted for different users, making this wearable good for anyone and everyone. For ease of use, the functions of the Waveform are tactile – giving the wearer freedom to use it with VR headsets.

Waveform is a completely different way of experiencing audio, virtually making one feel inside the action for the best experience possible. The possibilities could be endless with the wearable gadget – watching movies in VR with this strapped on will give you the thrill of a lifetime. It won’t be surprising if future iterations and refinements to this design could blur the lines between what’s real and what’s not!

Designer: Kyle Hamm

This AI-operated villa in the Czech Republic comes with panoramic views and needs no keys!

Artificial-intelligence controls Villa Sophia, designed by Coll Coll, which blooms at the top of a hill above Prague, Czech Republic. Described as the “center of the universe,” by its creators, Michaela Pankova and Karel Panek, the architecture of Villa Sophia really does seem to present itself as a sort of nucleus, quietly blending the omnipresence of today’s technology with timeless values of connectedness and sustainability. The minds behind the hideout, the villa’s habitants, aimed to integrate robust AI technology into each nook and cranny of the home while also ensuring that the villa embodied warmth and intimacy for social gatherings or alone time. 

The home incorporates impressive artificial intelligence throughout such as musical instruments that play themselves, lights that turn on without switches, along with verbal and haptic sensors that track your footsteps, your hand motions, and spoken word. Oh, and did we mention, this smart-house needs no keys! On the home’s AI technology, one of its creators, Michaela Pankova says, “The house is like a brain,” and the home certainly is smart. Aware of where everyone is inside the house, Villa Sophia’s AI system listens and adapts to the growing needs of the home’s residents so that just by inhabiting the home, everyone can enjoy the benefits that come with technological living. Room temperatures will adjust as soon as someone makes note of the cold. Come sunset, blue lighting dissipates so that the house provides optimal lighting for sleep. Deliveries always make it inside as the smart home can unlock and open doors after assessing who’s knocking. The home has as many technological capabilities as the human has thoughts, in this way, artificial and human intelligence work in tandem. 

Considering the home’s catalog of intellectual technology, sustainability and interconnection still breathe inside and outside Villa Sophia. The home is just as eco-friendly as it is tech-savvy, with responsibly sourced wood material and polyurethane floor finishing, the interior design makes the overall home that much more efficient and eco-conscious. From the rich, walnut wood finishes to the living space’s accessible ramp that slithers through a sloped chunk of the staircase, a seamless fusion of distinguished technological innovation with an acute awareness of the human’s urge to control pervade this villa.

Designer: Michaela Pankova and Karel Panek of Coll Coll

This article was sent to us using the ‘Submit A Design’ feature.
We encourage designers/students/studios to send in their projects to be featured on Yanko Design!

This Apple Watch band lets you control your smartwatch without touching the screen!

Nobody’s ever really thought hard about this but there’s only one way to use the touchscreen on your Apple Watch – with the opposite hand. You can use either hand on your smartphone or tablet screen, but when you’ve got a watch strapped to your left-hand wrist, you can pretty much only control it with your right hand… and what do you do when the right hand’s busy holding bags, washing dishes, driving a car, wearing gloves, or petting your dog? Mudra has a pretty futuristic solution to that problem – you use sensors to control the watch without needing to touch it.

Working on a tech quite similar in outcome to the Google Soli chip found in the Pixel 4, the Mudra is a wristband for the Apple Watch that comes with its set of sensors that pick up hand gestures by measuring nerve activity in your wrist. The Mudra band allows you to use your watch without touching it, but more importantly, it gives you the ability to use your left-hand to control parts of the Watch experience, being able to snooze alarms, accept or reject calls, play/pause/skip music tracks, or even playing an old-fashioned game of Snake. The band picks up directly on gestures sent to your wrist via the motor nerve, almost forming a brain-to-device interface. State-of-the-art electrodes in the band can decode different signals, telling apart a variety of gestures that give you complete control over your watch (fun fact, Mudra translates to ‘gesture’ in Sanskrit). The band works with all generations of the Apple Watch, connecting to them via Bluetooth, and batteries inside the Mudra allow it to work for over two days before needing to be charged using a proprietary contact-based charger.

Designed to be a convenience, but with the potential of being much more, the Mudra band’s sensor technology has a wide variety of applications. Not only is it great for when your hands are occupied, it’s also extremely useful for the disabled (who can still send gesture-instructions through their motor nerves), and even offers a great way to interface with a screen without having to look at it, potentially making the Apple Watch safe to use while driving too!

Designer: Wearable Devices Ltd.

Microsoft envisions an Xbox controller with Braille

Microsoft is clearly invested in adaptive gaming controllers. Its Xbox Adaptive Controller for Xbox One and PC was the star of its latest Super Bowl ad. The company spent more than a year designing accessible packaging, and it recently teamed up with...