Collaborative Composition For Musical Robots

  • Ajay Kapur California Institute of the Arts, Valencia, CA, USA University of Victoria, Victoria, BC, Canada Simon Fraser University, Burnaby, BC, Canada KarmetiK LLC, Reno, NV, USA
  • Arne Eigenfeldt Simon Fraser University, Burnaby, BC, Canada
  • Curtis Bahn Rensselear Polytechnic Institute, Troy, NY, USA
  • W. Andrew Schloss University of Victoria, Victoria, BC, Canada


The goal of this research is to collaborate with a number of different artists to explore the capabilities of robotic musical instruments to cultivate new music. This paper describes the challenges faced in using musical robotics in rehearsals and on the performance stage. It also describes the design of custom software frameworks and tools for the variety of composers and performers interacting with the new instruments. Details of how laboratory experiments and rehearsals moved to the concert hall in a variety of diverse performance scenarios are described. Finally, a paradigm for how to teach musical robotics as a multimedia composition course is discussed.


C. G. Atkeson, J. Hale, et. al., "Using Humanoid Robots to Study Human Behavior," IEEE Intelligent Systems: Special Issue on Humanoid Robotics, vol. 15, pp. 46- 56, 2000. A. Baginsky, "The Three Sirens: A Self Learning Robotic Rock Band."M. V. Dorssen, "The Cell."A. Eigenfeldt, "The Creation of Evolutionary Rhythms Within a Multi-Agent Networked Drum Ensemble," ICMC, Copenhagen, Denmark, 2007.A. Z. Hajian, D. S. Sanchez, and R. D. Howe, "Drum Roll: Increasing Bandwidth Through Passive Impedance Modulation," IEEE Robotics and Automation Conference, Albuquerque, USA, 1997. Kapur and E. Singer, "A Retrieval Approach for Human/Robot Musical Performance," ISMIR, Victoria, Canada, 2006.A. Kapur, Trimpin, E. Singer, A. Suleman, and G. Tzanetakis, "A Comparison of Solenoid-Based Strategies for Robotic Drumming," ICMC, Copenhagen, Denmark, 2007.A. Kapur, G. Tzanetakis, and P. F. Driessen, "Audio-Based Gesture Extraction on the ESitar Controller," DAFX, Naples, Italy, 2004.C. MacMurtie, "Amorphic Robot Works."M. Mathews and A. Schloss, "The RadioDrum as a Synthesizer Controller," ICMC, 1989.G. Monahan, "Kinetic Sound Environments as a Mutation of the Audio System," Musicworks, Toronto, Canada, 1995.E. Singer, J. Feddersen, et. al., "LEMUR's Musical Robots," NIME, Hamamatsu, Japan, 2004.Trimpin, Portfolio. Seattle, Washington.G. Wang & P. R. Cook, "ChucK: A Concurrent, On-the- fly Audio Programming Language," ICMC, Singapore, 2003.G. Weinberg, et. al., "Haile - A Preceptual Robotic Percussionist," ICMC, Barcelona, Spain, 2005.M. M. Williamson, "Robot Arm Control Exploring Natural Dynamics," vol. Ph.D. Boston: MIT, 1999.M. Wright, A. Freed, and A. Momeni, "OpenSound Control: State of the Art 2003," NIME, Montreal, Canada, 2003.