After decades in which the keyboard and mouse have been the main user input devices in computer science, the use of (multi) touch screens is now becoming more and more ubiquitous. This is a revolutionary development, because touching a graphical user interface directly is a far more immersive activity than using the traditional indirect controller devices. Touch interaction is of particular use with tasks that require skill and a close connection between human and computer, such as creating music.

NiftySynth : “a preview of (multi) touch synthesizers to come?”

To satisfy both our wish to create a multi touch application and a music synthesizer application at the same time, we have created an interactive multitouch audio experience application built in Actionscript 3 / Flash. Using the TUIO multitouch and SiON synthesizer libraries we have been able to develop a portable multitouch application that can be controlled using a professional multitouch surface such as the surface in the Intertain lab at the VU in Amsterdam, but also with a homemade multitouch surface such as the one we have created ourselves (see the photos below).
Though the application is built for TUIO multitouch data, it also has singletouch mouse support so it’ll work with a normal mouse as well, so be sure to try out the NiftySynth application. For a demonstration on the Intertain multitouch surface please watch the videos!


Support Applications


Colin Petty combining NiftySynth with motion gestures


Everyone is familiar with the situation: you find yourself in a room full of people, listening to a presentation by a speaker. Sometimes, these presentations can be boring. Often when a presentation, the interestingness of the ‘slides’ is one of the key factors. If only those slides would be a bit less static!

PowerRail aims to make presentations more dynamic.

PowerRail is a Papervision 3d and XML powered presenting tool. The application delivers a flash 3d environment in which content ranging from text, images, video’s and even live streams can be displayed, grouped, and presented either in an automatic timed slideshow, or interactively depending on the user or presenter’s actions. This means PowerRail is multimodal, it can for example be used both as a rich internet application to present a set of assets online, or in full screen presentation mode during presentations for audiences.

Because of the versatility of the application the results are only limited to the user’s creativity.