An agent based approach to interaction and composition

The Agent Tool [1] is a complex composition and performance environment that affords the scripting of abstract agents of varying complexity to control elements of synthesis and sound manipulation. The micro-threaded architecture of the system means that all scripts are written from the perspective of an agent/performer. Consequently, complex compositions, gestures and performances can be crafted in a simple and efficient manner. It is designed to be an open-ended framework whereby all data can be emitted via Open Sound Control (OSC) for external processing if required. User interaction with the system can come in a variety of forms. These include, but are not limited to graphical manipulation, scripting, real time video input and external control via OSC. The system was initially designed as an environment to allow dynamic and efficient graphic sound synthesis through extraction of data from static imagery, video playback or real time video input. The open scripting engine consequently allows the system to perform direct audification of image stimuli or conversely allow complex sonifications to take place. The Agent Tool is a cross-platform package that runs on various Linux distributions, Mac OSX and Windows operating systems. This paper seeks to discuss the agent based functionality the system offers and consequently the composition and interaction design that the system affords.