Hand in the game
May 5, 2016
Share
Researchers at Queen鈥檚 University鈥檚 Human Media Lab have developed the world鈥檚 first hand-held device with a fully cylindrical user interface. The device, dubbed MagicWand, has a wide range of possible implementations, including as a game controller.
Similar to the Nintendo Wii remote, users are able to use physical gestures to interact with virtual objects. The MagicWand, however, takes the user experience one step further, by using the dual screens to represent virtual objects in the user鈥檚 hand. The device uses visual perspective correction technology to strengthen the illusion of physical control of the virtual object, changing the view of the object, relative to the user, as it is moved around.
鈥淭his, for example, means you can rotate MagicWand and see a gaming character inside it from all sides, as if it were 3D,鈥 says Roel Vertegaal (School of Computing), Director of the Human Media Lab at Queen鈥檚. 鈥淪martphones are flat and not ergonomically suitable for use as a controller or pointing device. MagicWand is the first hand-held with a 360 degree high resolution display to have the regular physical affordances of a pointer stick."
MagicWand uses two high definition 720p LG Display Flexible OLED screens powered by Android 4.4 鈥淜itKat鈥 boards. Sensors inside the device capture and transmit movements, as well as adjust how objects are displayed. The screens are synchronized to act as a single, continuous 1440x1280 display. The MagicWand runs the Unity 3D game engine, allowing it to interact with gaming content on consoles over WiFi.
"As the Wii U has shown, the form factor of a controller is really critical when interacting with gaming content," Dr. Vertegaal says. "MagicWand really allows users, for the first time, to play around with gestures while being able to hold gaming visuals literally in their hand. It is the world's first true DisplayObject (an everyday object with an interactive digital skin of pixels), going well beyond what has been demonstrated in any smartphone or controller."
Dr. Vertegaal thinks DisplayObjects with cylindrical form factors will be in the hands of consumers within five years. Queen鈥檚 researchers will unveil the MagicWand prototype at the ACM CHI 2016 Conference on Human Factors in Computing Systems in San Jose, Calif., on May 9. The annual forum is the world鈥檚 top conference on human-computer interaction.
This research was supported by Immersion Canada, Inc. and the Natural Sciences and Engineering Research Council of Canada (NSERC).