Header Banner
Next Reality Logo
Next Reality
nextreality.mark.png
Apple Snap AR Business Google Instagram | Facebook NFT HoloLens Magic Leap Hands-On Smartphone AR The Future of AR Next Reality 30 AR Glossary ARKit Dev 101 What Is AR? Mixed Reality HoloLens Dev 101 Augmented Reality Hololens How-Tos HoloLens v. Magic Leap v. Meta 2 VR v. AR v. MR

MIT's Remote Touch Interface Lets You Pick Up & Move Objects Through the Internet

A flashlight illuminating a textured surface with a blurred image on a screen in the background.

We can't be in two places at once, but with virtual touch interfaces we can theoretically use a machine to act as our second body in a remote location. Over at MIT, Daniel Leithinger and Sean Follmer, with the advisement of Hiroshi Ishii, created an interface that makes this possible.

The inFORM, a "dynamic shape display," essentially acts as a pinscreen platform with variable height properties. As you'll see in the video above, a Microsoft Kinect tracks the hands of the user in empty space and represents those movements remotely through the pinscreen. When the user's hands move vertically, the relevant segments of the board ride up. This allows for a duller reproduction of the user's appendages in real time, but nevertheless a reproduction precise enough to pick up and move objects (like a red ball).

A person interacting with a touch screen display featuring a geometric pattern.

Tangible Media Group/Vimeo

A red ball on a woven mat with wooden blocks arranged in a pattern and a tablet displaying a person's image in the background.

Tangible Media Group/Vimeo

A person interacting with a touch screen display featuring a geometric pattern.

Tangible Media Group/Vimeo

A red ball on a woven mat with wooden blocks arranged in a pattern and a tablet displaying a person's image in the background.

Tangible Media Group/Vimeo

While a device like the inFORM has relatively few practical applications in its current embodiment, it demonstrates a very simple method of reproducing physical interaction through a virtual interface. It may be just a step towards the goal of creating more robust methods of interaction as we start to blend the digital and real worlds, but it's a very clever and important one.

Remote participants in a video conference can be displayed physically, allowing for a strong sense of presence and the ability to interact physically at a distance.

The near (or even far) future likely won't bring us teleportation, but we're nevertheless finding more and more ways to bridge the global gap with technology. For all intents and purposes, we actually will soon be able to be in two places at once.

Cover image by Tangible Media Group/Vimeo

Apple's iOS 26 and iPadOS 26 updates are packed with new features, and you can try them before almost everyone else. First, check Gadget Hacks' list of supported iPhone and iPad models, then follow the step-by-step guide to install the iOS/iPadOS 26 beta — no paid developer account required.

Related Articles

Comments

No Comments Exist

Be the first, drop a comment!