kinect

AmplifyLA Interactive Bike Installation

Amplify.la ( a startup accelerator in Venice CA) An interactive installation for their upcoming launch party. I have always loved the concept of physical, analog objects interacting with digital, so for the concept I decided to have an exercise bike that drove you through a digital world. Using an Arduino microcontroller to detect each pedal of the bike, we then sent that info to Touch Designer which handled the creation of the game and the visuals. The Microsoft Kinect tracks the users leaning from side to side, giving us a way to navigate even when using a stationary exercise bike. We only had 5 days to make everything so this was a crazy quick project. Thanks to Matthew Wachter and Ming Hsiung coming in and helping make this thing on such a tight deadline.

Real time analysis of a physical model using a Kinect scanner and 4 projectors. The physical model is scanned in, analysed and the analysis results are projected back onto the model, using four projectors to cover horizontal and vertical model faces. The user can interact with the model, or adjust parameters via a touch screen. The setup performs real time pedestrian flow analysis. Metrics such as facade visibility, path overlap or the shadows cast by the geometry are projected back onto the model. We developed the software further in our lab in Singapore. The final setup consists of a 1x1 metre table with the physical model, a Kinect scanner, 3 touchscreens and 4 projectors. The software consists of three parts: the detection of objects from the Kinect point cloud, the spatial analysis software, and the projection mapping framework, which is used to calibrate each of the 4 projectors to the physical model. Source

The m wall system is a permanently installed interactive media wall, consisting of 20 Full HD displays and a dedicated client-server system (11 computers). On the one side, a powerful in-house development tool for interactive installations, it can also be used to simulate and playback large format video content.

The system offers endless possibilities in the fields of generative and reactive content creation. External live feeds such as twitter, video streams and picture content from the web can be embedded into the content. The m wall system can be controlled through various interfaces, such as, e.g. iPads, Kinect Motion Control, or classic show control systems. Source

Muscle Computer Interface

Article: Source

Microsoft’s Kinect technology was a big hit and it has really changed the way how people play the games. However it is also being used for many other purposes. And if Microsoft Research continues its high-tech development, then days are not far when we will be controlling the computers solely through our muscles and body structures, together eliminating the need of controllers. This technology is being demoed and called the “Muscle-Computer Interface” that lets you control the computers through your body muscles and finger movements.

Microsoft muscle-computer interface

This innovative technology uses electromyography (EMG) that is fundamentally the muscular counterpart of an electroencephalography (EEG) the foundation for brain controlled computer interfaces. The EMG senses the electrical signals generated by muscle cells following the signal influx from the brain. Simply tying an armband around the muscles on your forearm will let EMG sense the gestures of your finger. This technology can also be used to control computers through special EMG optimized computer interface. Microsoft Research team is working on the same computer interface which should translate particular EMG readings into gestures that can be used to program the computer as if the gestures are peripheral controllers like keyboard and mouse.

Example of the armband with integral EMG sensors and other EMG sensor nodes:

Armband with integral sensors

Just in the recent few years, a patent application was submitted by the Microsoft in which it was stated that it is not necessary that only armbands can be used to integrate the EMG technology; instead it could be anything like wristwatches, clothes, glasses and other similar objects.  With the integration of EMG technology, all these controllers will be powered by batteries and thus link to a wireless hub. While Microsoft also stated that multiple EMG devices can be wore at a single time.

However, with good comes bad. You will need to place the EMG device accurately on your body parts and if your body structure is different like as if you are fat or skinny it will be difficult for the device to sense the EMG readings accurately.

According to Microsoft, the EMG integrated armband will also vibrate upon the gestures. If a person uses the finger gesture to control the computer, a small amount of vibration will be formed, and if the gesture is not recognized, a heavy vibration will be felt; the duration will be short, though.

Here is the video which demonstrates the previous archetypes of Microsoft that should clear the concept of EMG powered muscle-computer interaction. In this video a man is playing a guitar in the computer with his fingers’ and hands’ gestures but that doesn’t clearly specify if it could be used to control the mouse pointer on the computer screen:

Source: Extreme Tech

Introducing Bodymetrics for Your Living Room. We recently partnered with London-based technology company, Bodymetrics, to develop a means for online shoppers to buy clothes from the comfort of their couch. Whattya mean big deal? Well, did we mention that the clothes are guaranteed to fit? Thanks to BodyMetrics’ 3D body-scanning technology, which is based off of the same PrimeSense scanners and camera tech as the Microsoft Kinect, shoppers are able to have their body dimensions scanned in and saved to an online profile. Just think of it like the transport room in Star Trek … if Scotty had a bit of an online shopping problem.

V Motion Project: Music Video powered by Kinect. They created this piece by hacking the Kinect motion tracking software and integrated it with audio production software, The V Motion Project created a tool that could transform the body’s movements into music. It’s great to see the Kinect technology being used in innovative and creative ways like this and it helps that the music track is pretty cool.