Sensing Music-related Actions (completed)

Sensing Music-related Actions (SMA) is an interdisciplinary research project focusing on capturing and understanding more about body movements in a musical context. This is done through the combination of methods from musicology and informatics, and the researchers are working with advanced motion capture technologies and machine learning techniques.

Dame i svarte klær i blått rom viser mange ulike bevegelser. Collage med 16 bilder. Foto.

About the project

This interdisciplinary project, combining scientific, technological and artistic methods, proposes three crucial topics for future development of multimodal devices:

  • the importance of action-sound couplings for both performance and perception of music
  • the control potential of human bodily movement
  • a move towards an active music experience

Research questions and methods

The basic research question that underlies this project is:

  • How can action-sound couplings be exploited in human-computer interaction?

A number of sub-questions are linked to this:

  • Which sensor technologies can be used to capture complex body movement?
  • Which machine-learning techniques can be used to extract semantic actions from a continuous stream of movement data?
  • How are actions and sounds coupled in everyday life?
  • How can such theories and technologies be used to control sound and music?
  • How can we create musical structures that can be controlled by the user?

Aims and objectives

Principal objective:

  • Exploring action-sound couplings in human-computer interaction.


  • Develop sensor technologies for capturing complex body movement.
  • Develop machine-learning techniques and segmentation methods for extracting semantic actions from a continuous stream of sensor data.
  • Develop theories of action-sound couplings in everyday life.
  • Develop prototypes of enactive media devices that allow for continuously controlling music based on the actions of the user.
  • Develop hypermusic structures that can be used in the enactive media devices.

Cooperation and financing

Sensing Music-related Actions is a joint research project of the departments of Musicology and Informatics, and has received external funding through the VERDIKTprogram of the The Research Council of Norway. The project runs from July 2008 until December 2012.


View all works in Cristin

  • Jensenius, Alexander Refsum (2013). Kinectofon: Performing with Shapes in Planes.
  • Godøy, Rolf Inge; Jensenius, Alexander Refsum & Grønli, Kristin Straumsheim (2013). Musikkens elektroniske fremtid. [Internet]. Forskningsrådets Nyheter.
  • Jensenius, Alexander Refsum; Godøy, Rolf Inge; Johnson, Victoria Kristine Å & Grønli, Kristin Straumsheim (2013). Fremtidens musikere må bygge instrumentet og lage låta underveis. [Internet]. Teknisk ukeblad.
  • Sprenger, Mona; Jensenius, Alexander Refsum & Adde, Lars (2013). Bevegelse avslører cerebral parese. [Newspaper]. Teknisk ukeblad.
  • Gjesdal, Trine-Lise & Jensenius, Alexander Refsum (2013). Musikklaboratoriet. [Newspaper]. Nysgjerrigper.
  • Jensenius, Alexander Refsum (2013). Musikk, kropp, bevegelse og bevegelsessporing.
  • Nymoen, Kristian; Tørresen, Jim; Godøy, Rolf Inge; Jensenius, Alexander Refsum & Høvin, Mats Erling (2013). Methods and Technologies for Analysing Links Between Musical Sound and Body Motion. Akademisk Forlag. ISSN 1501-7710.

View all works in Cristin

Published Aug. 21, 2012 11:42 AM - Last modified Sep. 1, 2020 10:05 AM