Hyper-instruments
 
ManiTT.jpg


LeoPiano.jpg

 
 
 
 
 


The PalmDriver  (formerly TwinTowers) is an electronic device based on IR technology which consists of 8 sets of 4 sensing elements arranged as the vertical edges of a square-based parallelepiped.
At the time (1995) the first prototype was realized, we used only two sets of elements so that the shape of the beams reminded the profile of the “late” TwinTowers in New York to us.
The measurements of distance of the different zones of the hands’ palm are performed by the amount of reflected light captured by the receivers and are quite accurate in respect to the irregularity and color of the hands’ palms.
The
PalmDriver  is stable and responsive; as a consequence, sounds generated by the computer evoke on the performer the sensation of “touching the sound”.    video


Image processing technology has been used for realizing Handel System: a CCD camera is connected to a video grabber card; the digital image is then analyzed as the reconstructed image consisting of those pixels whose luminance is greater than a predefined threshold and color.
Panes are defined dynamically; x-y position and dimensions of the frames inside panes are detected.

see paper : Handel, a free-hands gesture recognition system (CMMR2004 - Springer)




On the basis of Handel, the Imaginary Piano has been realized: here a single rectangle - with a small thickness, as long as the horizontal dimension of the video capture area - is defined at the height where the keyboard usually lies.
When a finger, or a hand, crosses that strip downward, the systems reports proper information regarding the “key number” and a specific message is issued accordingly to “where” and  "how fast" the rectangle has been crossed. Information is used for controlling an algorithmic compositions rather than for playing scored music. video