Spring 2010
Virtual Synth
Interactive Multimedia Project for MAT 200C : Multimedia Systems (Spring 2010)
Virtual Synth is an application of OpenCV for Processing. It creates a virtual frame on top of the camera stream that contains interactive objects. The square objects are updated on every frame of the stream to detect motion in that region, and as a result update the frequency of a Synth in supercollider to play different tones. Communication between Processing and Supercollider is done via oscP5 which uses Open Sound Control. GUI objects include sliders for changing contrast, brightness and threshold values for motion detection.
Check out the demo video:
Virtual Synth Behind the Scenes from Ritesh L on Vimeo.
Object Tracking in the IR Domain for Multi-Touch Surfaces
Group Collaboration Project for MAT 200C: Spring 2010
I worked with a team of six other people to create a multi-touch surface table for MAT. We used FTIR for touch detection, TUIO for tracking and Processing for the display.
The concept of Natural User Interfaces is becoming more and more widespread from applications in user appliances to research instruments. In this domain of technology where user experiences range from simple touch screens to fluid interfaces, multi-touch surfaces have an important role to play. For some they might promise of a more integrated, interactive and intuitive multi-user solution, while for others they might pose a situation of unwanted change. This project takes a positive approach towards adapting to this technology and investigates to a certain extent, the mechanics of it. It also presents a brief overview of certain applications for such an interface and how they can be expanded. It is concluded that touch interfaces provide a sense of instant feedback and a feeling of prompt reaction which makes it a richer and faster experience. Further investigations and user feedback would lead to more streamlined applications that could take collaborative software applications to the next level.