Smart device reminds you to take your meds when you have to

When I was diagnosed with a certain condition a couple of years ago, it also comes with the tedious (and expensive) “habit” of drinking all kinds of medication. While in my head I know I have to drink these meds at certain times of the day, there are still a lot of times that I actually forget. Sure, we can always add reminders on our phones but sometimes we just snooze those reminders. Or that may just be me. But in reality, people still need all kinds of reminders to take their meds.

Designer: Rume Studio

Ownum Pod is a concept for a device that may be the first one with a smart reminder for medication. This isn’t just an app that can give you notifications when it’s time to take your meds. It’s actually a smart device where you can put your medicine bottle in it and then configure the app to give you reminders when to take it. There is a precision scale inside the device so it knows whether or not you took the correct dosage of your pills or tablets.

The pod itself looks like a smartphone or device charger with a space in the middle to put the medicine bottle. It probably has a standard bottle where you can just store your respective medicine in. And if you’re like me that takes several different meds, you can interconnect multiple pods with just one power cable / charging connection. It has a rubber base and is also modular so you can place double or multiple pods together.

The UI and function seems pretty simple based on the product renders, although there wasn’t much explanation or visuals of the connected app. I don’t know if something like this can help discipline someone like me into taking their meds regularly. But having an option like this may be helpful.

The post Smart device reminds you to take your meds when you have to first appeared on Yanko Design.

Levitating Xbox controller themed on the “Dune: Part Two” movie is up for grabs via a competition

There’s no denying, we love everything that levitates. Consider the magical element of a floating gadget or the sheer curiosity of the working mechanism, anything that suspends in mid-air, ignites our curiosity. Of course, this levitating Xbox controller wouldn’t escape our radar.

This special edition gaming Xbox gaming controller will mark the release of Dune: Part 2 on March 1. Microsoft is labeling it as the world’s first floating Xbox controller, and we’ll agree since this is a one-of-a-kind creation. The idea behind the levitating aesthetic is to mimic the Ornithopter’s capability to hover over the Arrakis’ dunes. The good news is that you can win this one-off collectors’ piece by topping the sweepstakes competition by Microsoft on X.

Designer: Microsoft

Limited edition hardware is nothing new to Microsoft for promoting their flagship console. For the Dune edition version, the tech giant has collaborated with Warner Bros and Legendary Pictures to promote the release of Denis Villeneuve’s movie. Coming on to the levitating feature, the controller rests on a stand that floats. The visual trickery is not made clear by Microsoft but we presume magnets are used to weave the magic. Hiding behind the big sandy base that’s most likely created to aid this cool illusion.

The gaming controller has a custom finish complete with the movie logo and symbols. Similarly, the Xbox Series S console carries a vibrant design to represent the scale of Arrakis in the cosmos. It is accompanied by the Dune-themed Ornithopter Stand for the complete feel. If you are interested in rolling in for the competition jump right away to check out the official rules and eligibility details. The entry period is currently on and will go on till March 25.

The post Levitating Xbox controller themed on the “Dune: Part Two” movie is up for grabs via a competition first appeared on Yanko Design.

Discreet hearing aid concept empowers people with hearing disabilities

Many people try to deny experiencing physical disabilities for fear of making them look weak. This is especially true when it comes to hearing problems that people feel they can simply ignore or wave off easily. Those who do admit to having some hearing disabilities, however, are hesitant to get hearing aids that are expensive, fragile, uncomfortable, and too conspicuous, as if announcing their handicap to everyone around them. That doesn’t have to be the case, especially with today’s advancements in technology, and fortunately, some people are indeed stepping up to design a less obnoxious and more reliable hearing aid, such as this concept that tries to check all the boxes that would encourage more people to wear them and enjoy the world as it was meant to be heard.

Designers: Jitendra Kakade, Nikhil Srikrishnan, Riddhiman Dutta Choudhury

Despite how electronic components can now be so minuscule, most hearing aids still come in a large, two-piece design that, more often than not, clamps to the back of your ear. Such hearing aids are not only uncomfortable to wear, they also tend to put a very visible stigma on wearers, making them feel self-conscious and even ashamed to wear one. This leads to many owners abandoning these devices altogether, willing to sacrifice their happiness for the sake of their image.

Rezonance is a concept design that tries to think of a better solution that isn’t just more discreet but also more affordable and accessible in the long run. Instead of the typical clamping design, Rezonance employs bone conduction technology to be almost invisible. It’s a technology that is already used today on some wireless headphones, so it’s already a proven solution. By using bone conduction, there doesn’t need to be any visible part going into the person’s ear and Rezonance can stay hidden from view behind the wearer’s ear.

Instead of using clamping force to stay in place, the concept suggests an adhesive pad that’s similar to sports tape, ensuring that the material is not only waterproof but also reusable. Additionally, the components used to make the actual hearing aid are claimed to be quite cheap and easily available, which means that the final product itself doesn’t have to cost people an arm in exchange for their ear.

The design doesn’t specify whether Rezonance works only as a single piece or if you will need two for the full audio experience. Even then, it would still be a lot less cumbersome compared to the traditional hearing aid design. Of course, such a design will need to be verified first, especially by professionals, because a design that’s elegant yet ineffective will just end up disappointing and turning away people all the same.

The post Discreet hearing aid concept empowers people with hearing disabilities first appeared on Yanko Design.

Tumbler-shaped portable projector concept promises entertainment freedom

Projectors are becoming a popular alternative to extra large screens like TVs, mostly at home but sometimes even outdoors. Product design trends have started to move away from bulky boxes to more compact forms, but most of them are still restricted by a few design considerations. Even projectors that are supposedly designed for portability often come with clunky and sometimes unattractive stands, or worse, require setting up on tripods just to get the perfect angle. This concept design tries to solve that problem in a rather creative way, offering a highly compact and portable projector that can be propped up and angled conveniently, all without using a tripod or even a stand.

Designer: Hana Belassi

Thanks to progress in technology and manufacturing, it’s now possible to cram much of the electronics that powered large, hulking projectors into something the size of a small box or even a cylinder. But despite the smaller designs, or probably because of their more cramped designs, these portable projectors often rely on an external mechanism like a tripod or stand to prop them up at the desired angle. Not only does this ruin the aesthetics of the otherwise beautiful product, it also makes it cumbersome to bring the projector along wherever you go.

The Slim.VU concept tries to offer the ultimate on-the-go entertainment experience by encapsulating all the needed parts and design in a single, compact, and portable package. A projector with a built-in battery is not exactly new, but one that comes with 4G connectivity is still unheard of. That enables the projector to function not only without an external power source but even without a Wi-Fi connection, allowing it to access streaming sources without having to use up your phone’s cellular data.

1

The more interesting aspect of the projector’s design, however, is the built-in stand that looks nothing like a stand. The removable “cap” of this tumbler-like projector functions as this stand, holding the projector in its place magnetically. The curved shape of this stand lets you rotate the cylindrical projector and angle it properly. This way, you don’t need any other accessory to enjoy a video anytime you want, anywhere you go.

The Slim.VU projector concept contains everything you need, freeing you from concerns about power, connectivity, and stability. Of course, actually implementing such a projector is a different matter entirely, and it might need to make a few compromises in exchange for its compact form. Audio and video quality might actually take a hit just to cram this much technology inside a canister shape, making the portable projector less ideal for outdoor use, or even indoor when there’s too much ambient light.

The post Tumbler-shaped portable projector concept promises entertainment freedom first appeared on Yanko Design.

Mixed Reality Magnifying Glass for Kids Shows the World in a Different Light

When people talk about augmented or mixed reality, they most likely imagine strapping bulky visors to their heads and blocking their eyes. Although that is definitely the primary way to experience an immersive fusion of the physical and the digital, mixed reality actually goes beyond living in virtual worlds or seeing apps floating in front of you. You could, for example, point your smartphone somewhere in the real world and see a glimpse of digital information through that small window. Limited as that experience might sound, it can actually open up a whole new world to discover, especially if it allows children to learn more about the world they live in, giving them access to flora and fauna that they would have never encountered in the wild.

Designer: Junwoo Lim

To a child’s eyes, the world is both magical and mysterious, and that’s just for the things they can actually see. Our planet has a lot more treasures and oddities than they could possibly imagine, but most of them are out of reach due to urban development and safety considerations. At most, kids can learn about them through books, videos, and other flat media that, while informative, lack the proper context that young minds need to truly appreciate the scale of these earthbound creatures.

Mono is a mixed reality device concept that unlocks that world and allows kids to not only learn but also enjoy discovering these nuggets of knowledge in a way that doesn’t take them away from their current environment. Using mixed reality technologies, the gadget overlays virtual creatures like insects and animals on top of real-world objects, making them look like they’re actually there on the roof or in your hand. This allows kids to see them in their proper scale, observe their natural movement, or even see them interact with each other, all while still having access to additional text information layered on top of this view.

The device comes in a design that looks like a toy magnifying glass, an object that has long been associated with exploration and discovery. Instead of a transparent lens, it has a camera on one side and a screen on the other. Theoretically, the user can put the screen close to their eye the same way they would use a real magnifying glass, though that raises questions about the safety of that method. The controls for the device are simple enough for a child to understand, including a single button for power and a slider for zooming in and out to understand the scale of the creature being observed.

The Mono concept design tries to fill in an educational need for kids to learn more about the world in a safe and engaging environment, but without weighing down their heads with headsets. It demonstrates how mixed reality can be more than just an entertainment medium or a productivity tool for adults, but something that kids can also benefit from. A magnifying glass design definitely carries that exploration vibe, though it’s questionable whether it’s an appropriate one given how kids are likely to put the screen right in front of their eyes.

The post Mixed Reality Magnifying Glass for Kids Shows the World in a Different Light first appeared on Yanko Design.

Lunar New Year-themed Custom Mechanical Keycaps ring in the ‘Year Of The Dragon’

Celebrating the Chinese New Year in fitting spirit, this limited-edition mechanical keyboard comes with both QWERTY and the Standard Chinese Script… but what we love more is the fitting red and gold color scheme, and those beautiful majestic fire-breathing beasts found on the special keys! The special keycaps sit on Drop’s CSTM80 keyboard, and are designed as a collaboration between Drop and designer Boba.Types. “Adorned with fiery reds and rich golds (a dragon’s favorite colors, we’d hazard a guess), this set is nothing if not ornate,” mention the folks at Drop.

Designers: Drop & Boba.Types

While most keyboards are designed to be comfortable enough to use without looking at, this one makes it hard to look away. The keycaps are just gorgeous, and make for a great collector’s edition for people celebrating the Lunar New Year… or anyone with a fascination for the great “lóng” (dragon) of Chinese mythology.

The keycaps come as a base set, but also feature novelty and accent caps for adding a little more flavor to your already Sichuan-spicy keyboard. The accents come in the form of golden keys that stand out against the otherwise red keyboard, allowing you to easily spot keys you’re more likely to use frequently. The novelty keys add gorgeous mythological imagery to your keyboard, including a special numeric row that’s adorned with the 12 Chinese zodiac signs. Even special keys like the escape, shift, control, alt, etc. are jazzed up with symbolism… and while memorizing all the key types will probably be a bit of a headache, it’s absolutely worth it in the long run. Also, your friends will have a tough time figuring out how to snoop around on your computer!

The keycaps come in a special DCD profile (Drop Cylindrical Dye-Sub) developed by Drop. It’s designed to deliver a “classic feel with a unique, grit-free PBT texture for a finish as smooth—and strong—as dragons’ scales,” say the folks at Drop. The keycaps are compatible with Cherry MX switches and similar clones, and the base kit sets you back $49, while an additional $35 gets you the novelty keycap set.

The post Lunar New Year-themed Custom Mechanical Keycaps ring in the ‘Year Of The Dragon’ first appeared on Yanko Design.

Smartphone Accessories That Bring Back Some Tangibility Into Our Digital Lives

Living in a world full of smartphones and digital everything, the PUI (Physical User Interface) series steps in to make our tech experiences more hands-on. Amid touchscreens and high-tech gadgets, PUI wants to remind us of the good old days when we could touch and feel things. This series of smartphone accessories, seamlessly connected via Bluetooth, redefines the way we interact with our devices, encouraging users to reconnect with the physical world.

Designers: Taeyang KimYujeong Shin, and JiHoon Park

We all love our smartphones for making life easier, but deep down, there’s a part of us that misses the real touch. PUI gets that and wants to bring back the emotions we used to get from physical things. PUI comprises a range of accessories designed to reintroduce physical elements into the user’s daily interactions with their smartphones. These accessories include the PUI Alarm Clock, Camera Shutter, Dial Lock, Recorder, and Volume Control, each contributing to a richer physical experience.

PUI Alarm Clock:

The PUI Alarm Clock makes waking up more fun by bringing back the cool dial feature from old clocks but with a modern touch. It’s a bit sad that some of the Gen Zs and Gen Alphas don’t know how to set alarms on those old clocks. This Alarm Clock is like a time-traveling buddy, keeping the old clock style but fitting into our modern lives. You can easily set the alarm by turning the bottom dial, adding a hands-on feel that you don’t get with digital screens. It’s a small thing, but it makes waking up a bit more enjoyable and real. The PUI Alarm Clock is like a time machine, connecting the past and today, making mornings a simple joy for everyone. The PUI Alarm Clock stands as a bridge between generations, seamlessly weaving the nostalgia of the past into the fabric of our dynamic present.

PUI Camera Shutter:

The Camera Shutter accessory brings back the joy of photography by integrating a zoom dial and shutter button. Users can smoothly adjust the frame size with the zoom dial, and the physical act of pressing the shutter button to capture a moment adds a layer of satisfaction often missing in purely digital interactions. It’s a real-life micro-interaction that enhances the user experience.

PUI Dial Lock:

Diverging from traditional rigid screen locks, the PUI Dial Lock offers a tactile locking mechanism. Users input their password by manipulating the dial in a specific sequence, enhancing the security experience with a touch of physical engagement, almost giving a feeling of opening a locker and improving the importance of the device.

PUI Recorder:

The PUI Recorder serves as an audio recording device that incorporates physical buttons for record, play, and stop functions. The act of physically interacting with the device during recording adds a visually and aurally rich dimension to the experience. Making every touch count and moment consciously memorable.

PUI Volume Control:

Adjusting the volume is now a hands-on affair with the Volume Control. Turn the dial to control the sound. This physical touch goes beyond just tapping on a screen, giving a sense of ownership and satisfaction.

PUI (Physical User Interface) is like a breath of fresh air in a world full of digital screens. It connects our smartphones with real, touchable experiences. In a time when everything is about ease and speed, PUI brings back the joy of feeling and interacting with our devices in a more personal way. It’s a cool bridge between the old and the new, making our tech time more enjoyable and real.

The post Smartphone Accessories That Bring Back Some Tangibility Into Our Digital Lives first appeared on Yanko Design.

Ten of the Best IoT Devices To Create A Smart & Cohesive Home Environment

If you dream of having a smart home, then filling it up with excellent IoT gadgets is key. People prefer IoT devices today as they help them create an automated home that requires minimum interference and actions on their part. The range of IoT devices is truly quite remarkable today from smart shades that lift themselves to exceptional security cameras that ensure complete safety in your home. We’ve curated a collection of smart, well-designed, and easy-to-use IoT devices that will make your home a smooth automated haven. From IoT devices that help you stay connected with your pets while you’re away from home to the Frame Wall Pad, a full-screen touch system with Korean elegance – we have a whole range of exciting gadgets for you.

1. The Frame

Called the Frame, this impressive full-screen touch system is designed for Kocom, a renowned Korean smart home appliance company. The unique wall pad is designed to redefine and elevate the smart home experience with complete comfort and convenience.

Why is it noteworthy?

Frame’s impressive full-screen touch system differentiates it as a sophisticated and user-friendly centerpiece on the wall of any home. Its functionality and impeccable design set it apart from other systems on the market.

What we like

  • Serves as an embodiment of elegance, and technological advancement

What we dislike

2. SwitchBot Curtain 3

Called the SwitchBot Curtain 3, this simple robot can be attached to any curtain rod within 30 seconds, transforming your regular curtains into smart ones that can control your phone. You can smoothly operate the robot with shortcuts or voice commands.

Why is it noteworthy?

The SwitchBot Curtain 3 is currently in its third edition and features a new DynamiClamp design that lets it work on a large range of curtain rods and tracks, moving curtains the way you’d see them in five-star hotels.

What we like

  • Super easy to install, and can be configured in multiple ways
  • The DynamiClamp design lets the Curtain 3 be navigated in different kinds of rod designs

What we dislike

  • You need SwitchBot Hub for Voice Control feature

3. Mui Board Gen 2

Called the Mui Board Gen 2, this gadget looks like a simple piece of timber at first glance, but it converts into a touch-sensitive interface for controlling various aspects of a smart home. You can adjust your lighting, curtains, thermostat, and speakers with a simple tap on the wooden surface.

Why is it noteworthy?

This second-gen Mui Board features a new Matter networking protocol, allowing compatibility with smart devices from Apple, Google, and Amazon. This integration offers easy connectivity and elevates the board’s appeal.

What we like

  • Features ChatGPT integration via APIs

What we dislike

  • Looks could have been worked upon, to make it more appealing

4. Arpobot Smart Shade

The Arpobot Smart Shade is a Matter-compliant IoT accessory that is designed to work with almost every chain-operate blind and shade. It can transform your analog blinds into voice-activated automatic ones.

Why is it noteworthy?

You can just snap the Arpobot Smart Shade in place, and it will start working without needing extra hubs or separate apps…just your Apple/Google/Amazon smart home platform.

What we like

  • Easy to install
  • Minimalist design that blends well into almost every interior space

What we dislike

  • Hefty price tag

5. Migo

Migo is short ‘for amigo’, and it means friend in Spanish. The various components of Migo communicate and connect via Bluetooth, allowing owners and their dogs to interact remotely.

Why is it noteworthy?

The main appeal of Migo is the collar which has its own tracking system, temperature sensor, heart rate monitor, audio output, and an LED flashlight. It allows owners to have eyes on their dogs at home, through the camera unit that functions as a traditional surveillance camera.

What we like

  • The camera has a speaker, so owners can speak to their dogs

What we dislike

  • It’s currently a concept, so we don’t know how well it would translate into a tangible product

6. SwitchBot Bot

The SwitchBot Bot is designed to automate products that aren’t originally smart. Called the ‘Button Pusher’, this IoT gadget can stick to switchboards or appliances, pushing buttons and switches with a plastic flipper so you don’t need to.

Why is it noteworthy?

The Bot is a simple and efficient approach to enhancing homes and lives. It can turn simple products into remote-controlled ones that can be operated via an app, voice commands, smart home setups, or IFTTT routines.

What we like

  • Automate switches that aren’t designed to be smart
  • Economical than upgrading to a smart appliance

What we dislike

  • Needs SwitchBot Hub for Voice Control and Smart Home configuration

7. ecobee Smart Doorbell Camera

The ecobee doorbell camera records in 1080p to offer “enhanced low light vision”, and utilizes a 175-degree vertical field of view, allowing you to see everything clearly from the floor to the sky.

Why is it noteworthy?

It allows the viewer on the opposite side of the doorbell camera to see any packages being dropped on the porch, or in more dangerous cases, identify any potential threats that they may present on the opposite side of the door.

What we like

  • Features a slick outward appearance featuring a machined glass front panel surrounded by aluminum alloy

What we dislike

  • You need a subscription to ecobee Smart Security, which connects all ecobee security devices

8. Bownce

Bownce calls itself “the first IoT ball of its kind”. It is a small ball designed to get you sweating, and training your muscle groups with the help of technology. It has a compact size, accentuated by integrated electric components.

Why is it noteworthy?

It is quite small, and easy to install, allowing you to bring it to your office, backyard, or whichever room in your home you feel most comfortable in. It’s also not intimidating for newbies who want to start punching stuff.

What we like

  • It has integrated electric components, allowing you to track your performance
  • The connecting app logs your punches and gives you real-time updates and statistics

What we dislike

  • Not sure how it can replicate an actual punching bag

9. SwitchBot Smart Lock

The SwitchBot Smart Lock is created to fit over standard single deadbolt locks, automating it, and allowing you to open it using an app, Bluetooth, proximity, or even voice commands. The device has a motor that can either lock or unlock it.

Why is it noteworthy?

The lock connects with the SwitchBot app via Bluetooth and can work with your Apple Watch as well. It also pairs with the Hub for WiFi-based connectivity, and you can control it using your voice.

What we like

  • It is protected by 128-bit AES encryption
  • Can be configured with your smart doorbell to open for approved people

What we dislike

  • The battery lasts for 6 months

10. Bird Buddy

Called the Bird Buddy, this AI-powered bird feeder captures videos of any birds that make it to your garden or porch, streaming their faces to your phone, alongside a notification when they show up. The feeder features a camera in the front, which captures the bird as closely as possible.

Why is it noteworthy?

The Bird Buddy’s AI identifies the birds for you as well, maintaining a record of the birds that visit, along with their pictures, in case you don’t make it to your porch in time with the DSLR.

What we like

  • Weather-proof feeder
  • Features a modular design, allowing you to snap the camera attachment off and take it indoors for charging

What we dislike

  • Has a low battery life
  • The Bluetooth camera pairing process is a bit buggy

The post Ten of the Best IoT Devices To Create A Smart & Cohesive Home Environment first appeared on Yanko Design.

AI-powered synthesizer lets you create tailored music just by pressing buttons

AI has become a powerful and controversial tool that’s being applied to the creation of many things in different industries. The most well-known are, of course, images and text, but these same technologies can also be applied to other fields, even ones that are considered to require more human creativity than others. Music, for example, is believed to be an art that’s hard to master and difficult to quantify in a way that would be of use to AI, but that’s exactly what’s happening here with this “artifact from the future.” That said, the suitcase-sized synthesizer doesn’t completely wrest the act of creation away from your hands but turns it into a creative collaboration between man and machine.

Designer: Arvind Sanjeev

Imagine having to only press a few buttons and you’ll have tunes that are specifically crafted to suit a given mood or genre. Most synthesizers simply give you the raw controls to mix and match to your heart’s content, but you’ll have to draw from your own creativity to actually come up with a pleasing harmony tailored to fit that situation. SPIN, the name for this AI-powered music synthesizer, actually helps you in this creative journey by serving ready-made ingredients to put into your mix without taking anything away from your freedom. It’s like the difference between buying a can of tomato sauce for a recipe versus making your own from scratch.

SPIN has buttons for different moods, genres, and sounds that you can mix and match to your heart’s content. How does happy death-metal disco sound? Why not try some dark jazz opera to really turn heads? Not every combination is going to work, of course, so you’ll still have to step in and fine-tune it to your tastes, no pun intended. And with sliders for BPM or duration and a turntable to scratch, you also have the tools to make your own style shine, with or without AI’s help.

The synth is just as much a work of art as it is a demonstration of the power of AI. A variety of off-the-shelf components are assembled to provide the brains and muscle behind the scenes, almost literally. You won’t see any of these while using SPIN, as all are hidden behind an interface and a design that’s meant to encourage playfulness and experimentation. Even the choice of bright yellow and white colors, unusual for most synth designs, emphasizes that rather jovial character.

Generative AI has been receiving a lot of flak, in no small part thanks to abuse and misuse of the technology rather than anything inherent. SPIN is an attempt to reverse that perception and present AI not only as something approachable but even fun to use. Given how it works, you won’t even have to worry about infringing on anyone’s copyright or intellectual property, leaving you free to explore that harmony between human creativity and machine learning.

The post AI-powered synthesizer lets you create tailored music just by pressing buttons first appeared on Yanko Design.

Actual working Pokédex uses ChatGPT to identify Pokémon… and you can build one too

Let’s face it. You didn’t click on this article by accident. You’re as much of a Pokémon nerd as I am and there’s complete reason to feel excited given what I’m about to show you. A YouTuber by the name of Abe’s Projects decided to throw together a few components to make a rudimentary (but functioning) Pokédex and I CANNOT KEEP CALM!

This Pokédex works surprisingly like the original. Relying on the powers of ChatGPT to identify imagery captured through a rather basic camera setup, Abe’s Pokédex does a fairly good job of replicating the experience of the original from the hit TV series and comic book. Abe even encased his electronics in a wonderfully nostalgic red 3D-printed enclosure, making it resemble the original Pokédex to an uncanny degree… and if that wasn’t enough, he even programmed the Pokédex to speak just like the original, with a computer-ish robotic voice.

Designer: Abe’s Projects

The process, although fairly complicated, gets detailed out by Abe in the YouTube video. One of his admittedly harder builds, Abe mentions the first conundrum – planning the exterior and interior. The problem – you can’t 3D model an outer shape without knowing where your inner components are going to sit, and you can’t know where your inner components are going to sit without planning out your outer shell. Nevertheless, Abe designed a rudimentary framework featuring an outer shell, a few removable components (like the bezel for the screen and buttons), and a flap that ‘opens’ your Pokédex.

The internals feature a XIAO ESP32S3 Sense microcontroller that has its own integrated camera, connected to a black and white OLED screen (based on the Pokédex toy from the 90s), an amplifier that hooks to a speaker, a set of breaker buttons, a battery, and a USB-C port for loading all the information to run the mini-computer, as well as to charge the battery.

The way the Pokédex works is rather clever – it uses GPT4 along with the PokéAPI, relying on the latter’s massive information database. The GPT4 gives the device its AI chops, and an AI voice generator (PlayHT) helps create the signature vocal effect of the Pokédex. Together, they work in tandem to first, identify the Pokémon, second, reference the information in the database, third, display the Pokémon on the screen, and finally, play relevant audio about the Pokémon’s name, type, background, and performance. This does, however, mean that the Pokédex needs to stay connected to WiFi at all times to constantly tap into GPT4 and the PokéAPI (since nothing happens locally on-device).

The entire process wasn’t without its fair share of problems, however. The problems started with the software itself, which hung, crashed, and sometimes got overburdened with just the amount of heavy lifting it had to do. Meanwhile, the PlayHT audio generator posed its own share of issues, like an annoying ticking noise that played in the background as the AI spoke. Abe mentions all the problems he had in a dedicated section of the video, also outlining how he fixed them (hint: a lot of coding).

Once all the bugs were fixed, Abe took his Pokédex out for a spin. In all fairness, it did a pretty good job of identifying Pokémon strictly by analyzing their shape. This meant the Pokédex worked absolutely flawlessly when pointed at images, or an accurate 3D figurine or toy. It didn’t however, fare too well with plushes, which can sometimes have exaggerated proportions. That being said, it’s still impressive that the Pokédex works ‘as advertised’.

Building your own isn’t simple, Abe mentions… although he does have a paywall on his YouTube page where paid members can get access to behind-the-scenes content where Abe talks more extensively about his entire process. If you’re a coding and engineering whiz (with a penchant for Pokémon and 3D printing), hop on over to the Abe’s Projects YouTube page and maybe you’ll figure out how to build your own Pokédex too! Maybe you’ll simplify the process so simpletons like us can build them as well…

The post Actual working Pokédex uses ChatGPT to identify Pokémon… and you can build one too first appeared on Yanko Design.