Passing controller data from Arduino to Processing. The arcade button controls the appearance of the white dot on the screen and two potentiometers control movement left and right.
Sandman: Kinect Sensor + Processing
I used the Kinect sensor and Daniel Shifman’s openkinect library for Processing to create this "sandman" effect. An ellipse shape is constantly drawing over the background which creates the bubbling “overdraw” effect. This experiment was created for my Parsons Design & Technology class called Embodied Play (taught by Kyle Li).
Asterisms
This is an installation I created to map my classmates based on their individual experiences and interests. Each student mapped items that correspond with their particular area of expertise. The finished image dimensionalized the complexities of our multidisciplinary design group and allowed everyone to identify patterns of overlap with fellow students. The mapping also generated a unique "constellation" for each student and created asterisms where there were overlaps. Asterisms are created when stars visually overlap with one another in space to create the perception that some stars are brighter than others. A slight shift in our perspective would reveal that any two points that appear to overlap could actually be separated by vast distances. [gallery link="file"]
GhostGame: Processing + Kinect
Here's a little game design experiment sending Kinect sensor data to Processing via OSCeleton. The Kinect sensor tracks your hand movement and correspondingly moves your "good" ghost character around the game environment to collect "souls" and gather points as you try to avoid the "bad" ghosts. Returning to your "home" in the center of the screen resets the hearts for the next round. This is just a proof of concept that I created to test the playability of the game and explore the use of Kinect with Processing.
IBM Think! Exhibit - NYC
IBM Think! was an exhibit / interactive experience staged in an underground parking garage at Lincoln Center in NYC. The entrance ramp was flanked by a huge LED wall which streamed a mix of prepared video and real time data (pollution index, traffic data etc). Inside the exhibit were large vertical LCD panels and mirrored walls which transformed the space into an immersive presentation that surrounded the audience with choreographed sound, video and text. When the video presentation ended the screens essentially turned into large interactive iPad-like devices which the exhibit-goers used to explore content. This was a very well crafted exhibit full of useful information and technology.