The Coolest Projection Mapping Tech Yet

Projection mapping can offer up some pretty cool visuals. The technique combines using specially designed projections which line up with the surfaces they’re being projected on. But up until now, most projection mapping has been done on either fixed or predictably moving rigid surfaces.

dynamic_projection_mapping_1

This amazing new technology allows projection mapping to be done in real time against moving objects with unpredictable deformations. The result is images which can bend and flex on surfaces as complex as moving fabric or a sheet of paper blowing in the wind. Check it out in action in the video below:

The technology was developed by engineers at the Ishikawa Watanabe Laboratory, who say it can dynamically adjust images up to 1000 times per second, with just a 3ms delay, so the visuals appear to adapt to their projection surfaces immediately.

I’m not sure of the practical applications for this other than interactive installations and performance, but it’s still really cool.

[via The Awesomer]

Interactive Table Tennis Trainer Will Be a Smash Hit

We’ve seen projection mapping applied to pool tables for decorative or instructional purposes. This one’s a sleek version for table tennis. Made by Thomas Mayer for his thesis in Interaction Design, the Table Tennis Trainer will turn you into the Ivan Drago of ping pong.

interactive_table_tennis_trainer_by_thomas_mayer_1zoom in

Thomas used a pair of PlayStation Eye cameras and a projector to track the ball and turn the table into an interactive display. The system’s flashiest feature is that it displays a profile of the player, such as his best score, win-loss record and even relevant attributes. However, it requires an NFC reader on the table and a chip embedded in the player’s paddle to serve as his login credential and perhaps data storage.

interactive_table_tennis_trainer_by_thomas_mayer_2zoom in

My favorite feature is the training mode for lone players. For instance, it can ask you to hit certain spots on the table when serving. Finally, the Table Tennis Trainer has several visual effects that make two player games more fun.

I think it’s worth exploring for the training mini-games alone. It could also introduce fun modes to the game, such as having players score more points if they hit certain spots or they can spell or draw characters on the table. I hope augmented reality takes off so we can have smart interfaces like this everywhere.

[via Gizmodo]

Immersis Projection Mapping System: IllumiRoom 2.0

Last year, Microsoft Research made headlines with its IllumiRoom concept, which extends video from a console or media player to the walls and objects around the TV. A company called Catopsys is working on an similar but theoretically much better version of IllumiRoom called Immersis.

immersis_projector_1zoom in

Immersis displays videos from a computer via a DVI connection. Similar to IllumiRoom, Immersis uses a projector with a proprietary 180º fisheye lens and a projection mapping algorithm to create an immersive effect. That is, it analyzes the dimensions of the projection surface or surfaces and adjusts its projection to fit the surface(s).

But while IllumiRoom requires that videos and games be made specifically for the technology, Catopsys claims that Immersis will work with practically any game that uses a real-time 3D engine. It can also display 360º videos and 360º photos that are based on Google’s Photosphere format. That being said, Catopsys will also release plugins for Unreal Engine and Unity so that developers can tailor their games to Immersis.

Another advantage of Immersis is that not only can you use it to extend video that’s being fed to a TV, monitor, etc., you can actually use Immersis as your only video output device. This makes the projection more seamless, which is great if your TV is a lot smaller than the area around it.

Pledge at least $500 (USD) on Kickstarter to get an Immersis developer kit or at least $1,100 to get the retail version as a reward.

[via Slash Gear]

RomoCart Lets You Make Race Tracks for Robots: DIY Anki Drive

You might have heard of Anki Drive, the racing game where you control a toy car with your mobile device and race on a track against computer-controlled cars. Ken Kawamoto and Tomoaki Akitomi made their own robot racing game based on Romo, a programmable robot powered by the iPhone. But instead of having a set track and preset power ups, their RomoCart system allows for randomly generated tracks and power ups.

romocart by ken kawamoto and tomoaki akitomi 620x363magnify

With RomoCart, you generate a race track by placing objects on the floor. The RomoCart program takes input from a depth-sensing camera such as the Kinect or Xtion Pro Live to create a virtual track around those objects. The track and other virtual elements will be displayed on the floor through a projector. You can also add items or power ups similar to Mario Kart, such as missiles and bananas. You can even designate some of the objects you placed on the floor as weapons. In one game Ken and Tomoaki turned a teddy bear into a missile turret.

romocart by ken kawamoto and tomoaki akitomi 2 620x348magnify

The RomoCart program handles the effects of the virtual elements on the robots, while players control the movement and abilities of their Romo using a gamepad. Finally, the RomoCart program also uses the depth-sensing camera to detect your presence, allowing you to interact with some of the game’s virtual elements. For example, you can step on a missile, destroying it to protect your robot.

It would’ve been a nice touch if you could death stare your opponents. Head to Ken’s blog for more on RomoCart.

[via Hack A Day]

Sega Augmented Reality Sandbox: Terramapping

Japan’s arcades will soon have a game that requires a more hands-on approach. Sega’s Eederu Sunaba is an augmented reality game that uses sensors and projectors to display virtual landscapes and animals on a sandbox. The landscapes and animals instantly appear based on what you build with the sand.

sega edel sand augmented reality sandbox game 620x351magnify

For instance, in the image above the game projected a lake on the area where the player dug a trench. Make a mound and the game could turn it into a mountain or a volcano with gigantic beetles spewing out of it. The virtual animals also react to touch, which in the hands of a child is most probably a reckless slam or punch. The video below also shows a game mode where the player is asked to replicate a shape or a formation.

I’d love to have something like that but for tabletop RPG sessions. Imagine being able to create different environments on blank cardboard tiles.

[via Engadget]

The Face-Stealing Robot

Robots can be awesome. They also can be creepy.  This robot fits firmly into the latter category. While most robots have expressionless heads, this one has a face. But not just any face – this robot can have YOUR face on it.

socibot 1 620x279magnify

By mounting an LED projector inside of its head, the SociBot can change its face to suit your every whim. It can be loaded with a library of standard faces, or in minutes, your face can be scanned and uploaded to its head. Each face then is mapped with a library of expressions, and mouth movements for talking. The robot can also track gestures, faces, and speak in over twenty languages. Using an IR depth sensor, it can even track the position of up to 12 people in a crowd.

The robot was designed by Will Jackson and his colleagues at Engineered Arts - who are also behind RoboThespian. He says the intent is to provide greater social interaction from the electronic devices we use, and the technology could be used for things like information kiosks or for jobs like automated bank tellers. Oh and if you think that’s creepy, get a load of SociBot with its head off:

headless robotmagnify

[via New Scientist]

Ghost Box Interactive Projector: I See Fake People

Projection mapping makes for eye-catching presentations, but for now it’s mostly used in advertising, live performances and for artistic purposes. The folks at animation studio Leviathan think they can simplify the technology for commercial and personal use. The studio’s proof-of-concept is called Ghost Box.

ghost box interactive projector by leviathan 620x325magnify

As with other projection mapping setups, Ghost Box uses projectors – in this case two of them – to beam dynamic visuals to a three dimensional object. The kicker here is that instead of requiring sophisticated knowledge or equipment, the system is self-contained and the projectors are controlled by easy to use mobile apps. For instance, in the video below you can see Ghost Box was used as a car configurator. Users simply tap and swipe on a tablet to change the properties of the car, and their choices are projected in real time to a scale model.

Nothing beats seeing and handling an actual object, but I can see Ghost Box being useful for educational purposes. A Ghost Wall or a Ghost Room would be way better though.

[via PSFK]

Animated Donkey Kong Wedding Cake: How High Can You Eat?

While we’ve certainly seen our fair share of cool video game inspired cakes over the years, this is the first time I’ve seen one that almost looks playable. By using projection mapping technology, this wedding cake has been turned into an animated version of Donkey Kong.

donkey kong wedding cake 620x413magnify

Posh DJs and their pal Dan from Invader Visuals worked their magic with a set of boxy white cakes from MealsForReals to make this epically geeky cake come together. But enough talking about it, it only really makes sense if you see it in action:

Cool, no? It looks like it also has Dig Dug, Pac-Man and other modes, but the Donkey Kong level is the best since it fits so perfectly onto the tiers of the cake. I only wish the cake came with a joystick so you could play it before eating it.

P.S. If you loved the video’s soundtrack as much as I did, you can find the whole tune here.

[via Forever Geek]

Camera System Keeps Track of Fast Moving Objects: Flash Focus

A camera that can keep a fast moving object in its sight is very useful. It could be adapted to cover sports or wartime events, or for academic and military purposes. That’s why a group of researchers at the University of Tokyo’s Ishikawa Oku Laboratory are working on a camera system that can automatically keep its eyes on the prize.

dynamic tracking camera system by ishikawa oku lab

The current prototype uses two small mirrors that move independently of each other: one for panning and one for tilting. DigInfo says that the mirrors are controlled “in the order of milliseconds” and the camera can take an image every 1/1000th of a second. Even more impressive, the system can also be used in reverse. Instead of taking an image, it can project an image onto a fast moving object in real time. Imagine being able to tag an escaping prisoner or a wild animal. Or a celebrity.

I wonder if it could track a bullet.

[via DigInfo]

Microsoft IllumiRoom Project: Same Display, Bigger Screen

Earlier this year Microsoft introduced IllumiRoom, a prototype technology that augments TVs and other displays by projecting room-filling visuals that complement what is being shown on the screen. Microsoft Research recently released a video that explains the basics of IllumiRoom.

microsoft illumiroom project

IllumiRoom can augment your gaming sessions in a number of ways. The most obvious and impressive way is to extend what’s being shown on your TV into the area around it. The resulting effect is halfway between a 3D headset and a cinema. But this is also the most difficult feature to implement because it will require “access to the game’s source code.” Other features of the IllumiRoom include adding spatial cues or matching mood lighting to enhance immersion.

Movies can also be extended using the IllumiRoom, but again the movie would have to be made with this function in mind. In other words, every scene has to be shot in a wide field of view in addition to the usual shots.

As mentioned in the video, the current proof-of-concept prototype uses a Kinect to analyze the color and geometry of the area around the TV and an off-the-shelf projector to display the complementary visuals. But as Microsoft’s researchers imply in their paper (pdf), the goal is to pack all the necessary hardware into one device. This IllumiRoom-capable device will then be “connected wirelessly to a next generation gaming console as a secondary display.” I wonder if we’ll hear more about it on May 21.

[Microsoft Research via Destructoid]