This interactive piece allows participants to generate a variety of sounds and images as if painting a picture on a canvas of space through simple hand motion or playing a piano with invisible keys.No visual interface or control device is used to operate this piece. The participant simply stands where indicated before the screen, then moves his or her hands at face level to generate images on-screen and sounds emitted from loudspeakers. The images displayed change according to hand motion, whether up and down or right and left. Likewise, sounds from the surrounding speakers are directed by hand motions. This piece is designed to provide participants with uninhibited creative space and time. The only input device is the hands and body of the participant. Both hands can be used to create sounds and images sequentially, which is an important feature of this work. This allows the participant to use both hands as if conducting a symphony or dancing. Such natural and free body movement is not possible through operation using a mouse, touch panelor space input device. Thus, this product is not simply for an input device or pointing device but for a unique environmental interface that mirrors the physical motion of the user. Ultimately, this product enables participants unlimited free expression when it plays a musical instrument or paints on canvas, without any physical restrictions.

This interactive piece allows the participant to generate a variety of sounds and images as if painting a picture on a canvas of space through simple hand motion or playing a piano with invisible keys. Instead of providing an interactive display through which the participants moves through a prearranged, simulated environment, this product offers the user a way to spend time more creatively in a physical space. No visual interface or control device is used to operate this piece. The participant simply stands where indicated before the screen, then moves his or her hands at face level to generate images on-screen and sounds emitted from eight loudspeakers. The images displayed change according to

hand motion, whether up and down or right and left. Likewise, sounds from the surrounding speakers are directed by hand motions. In other words, an invisible three-dimensional interface allows the participant to manipulate images and sounds. Various image patterns and sounds with a specific tone and rhythm are produced in response to random hand motion as programmed in the software.Infrared light is cast upon the moving hands, while highly sensitive video cameras in front and on the sides capture the hand motion. The computer processes the motion to generate images, and an MIDI signal is sent to the digital sound sampler to generate sounds. This piece is designed to provide the participant with uninhibited creative space and time. The only input device is the hands and body of the user. Both hands can be used to create sounds and images sequentially, which is an important feature of this piece. This allows the participant to use both hands as if conducting a symphony or dancing. Such natural and free body movement is not possible through operation using a mouse, touch panel or space input device. Thus, this piece is not simply for an input device or pointing device but for a unique environmental interface that mirrors the physical motion of the participant. Ultimately, this piece enables users unlimited free expression when it plays a musical instrument or paints on canvas, without any physical restrictions. Though music can be played through this interface, a precise musical scale is difficult to produce because the interface is invisible. Therefore, this piece works supposing possible participant action. The eight loudspeakers are positioned to envelope the participant in three-dimensional sound in response to hand motion. Sound is just as important as the image. Many so-called virtual reality products are designed to immerse the participant in a space of images. But since we have physical bodies, it is impossible to enter a space displayed on a flat display device. Conversely, since sound can freely exist in space, we can physically enter the realm of sound. In this sense, sounds are essentially more virtual than images. Each sound and image generated by this piece have been simplified so that a distinct chord and image accompany the sequential motion of the hands. This feature serves to stimulate the participant's imagination regarding free movement. Those that expect to experience some preconceived notion of virtual reality or an interactive video game in this product will be disappointed. Conventional interactive media products are extensions of the methodologies of games, books and images through which we travel along a set course or turn the page. This piece, however, affords the freedom to create our own music and art on a large canvas just like the abstract expressionist.

SIGGRAPH96 Bridge The Art Show New Orleans,USA 1996

Cyberforum Lisbon,Portugal 1996