Learning movement through human-computer co-creative improvisation

Lucas Liu, Duri Long, Swar Gujrania, Brian Magerko

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations


Computers that are able to collaboratively improvise movement with humans could have an impact on a variety of application domains, ranging from improving procedural animation in game environments to fostering human-computer co-creativity. Enabling real-time movement improvisation requires equipping computers with strategies for learning and understanding movement. Most existing research focuses on gesture classification, which does not facilitate the learning of new gestures, thereby limiting the creative capacity of computers. In this paper, we explore how to develop a gesture clustering pipeline that facilitates reasoning about arbitrary novel movements in real-time. We describe the implementation of this pipeline within the context of LuminAI, a system in which humans can collaboratively improvise movements together with an AI agent. A preliminary evaluation indicates that our pipeline is capable of efficiently clustering similar gestures together, but further work is necessary to fully assess the pipeline's ability to meaningfully cluster complex movements.

Original languageEnglish (US)
Title of host publicationMOCO 2019 - 6th International Conference on Movement and Computing
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450376549
StatePublished - Oct 10 2019
Event6th International Conference for Movement and Computing, MOCO 2019 - Tempe, United States
Duration: Oct 10 2019Oct 12 2019

Publication series

NameACM International Conference Proceeding Series


Conference6th International Conference for Movement and Computing, MOCO 2019
Country/TerritoryUnited States


  • Clustering
  • Co-creative
  • Dance
  • Dimensionality reduction
  • Dynamic programming
  • Kinect
  • Lifelong machine learning
  • Machine learning
  • Motion capture
  • Movement
  • Pre-processing

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications


Dive into the research topics of 'Learning movement through human-computer co-creative improvisation'. Together they form a unique fingerprint.

Cite this