Posts Tagged ‘Multimedia’
Virtual Synth
Interactive Multimedia Project for MAT 200C : Multimedia Systems (Spring 2010)
Virtual Synth is an application of OpenCV for Processing. It creates a virtual frame on top of the camera stream that contains interactive objects. The square objects are updated on every frame of the stream to detect motion in that region, and as a result update the frequency of a Synth in supercollider to play different tones. Communication between Processing and Supercollider is done via oscP5 which uses Open Sound Control. GUI objects include sliders for changing contrast, brightness and threshold values for motion detection.
Check out the demo video:
Virtual Synth Behind the Scenes from Ritesh L on Vimeo.
Accelerated Interactivity (SuperFormula Edition)
Interactive Multimedia Project (MAT 594O : Sensors)
This project was an exploration to link ideas in Human Computer Interaction and Computational Geometry to create an engaging audio-visual environment. The concept of the project was to trigger a series of 3D forms (based on the SuperFormula proposed by Johan Gielis) transformations & Sound (Vibrato) transformations in Virtual (3d) Space. All action is triggered through a series of hand gestures (Arduino w/ Accelerometer), motion of the hand rotation measured (X,Y,Z) axis and the up/down quick movements to change the SuperShape. Further adjustments to signal received in the system can be used to create more expressive transformations of the SuperShapes.
The user/viewer will be presented an interface (Arduino attached to either right/left hand) that will engage the system, stimuli of site, sound and motion. The areas of HCI, Computer Graphics and Electronic Music were concurrent areas for research.
Visual interactivity was done with Processing and Vibrato was implemented in Max/MSP.
Check out the video:
Accelerated Interactivity (Superformula Edition) from Ritesh L on Vimeo.