Mobile robot motion control from demonstration and corrective feedback

Brenna D. Argall, Brett Browning, Manuela M. Veloso

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations

Abstract

Robust motion control algorithms are fundamental to the successful, autonomous operation of mobile robots. Motion control is known to be a difficult problem, and is often dictated by a policy, or state-action mapping. In this chapter, we present an approach for the refinement of mobile robot motion control policies, that incorporates corrective feedback from a human teacher. The target application domain of this work is the low-level motion control of a mobile robot. Within such domains, the rapid sampling rate and continuous action space of policies are both key challenges to providing policy corrections. To address these challenges, we contribute advice-operators as a corrective feedback form suitable for providing continuous-valued corrections, and Focused Feedback For Mobile Robot Policies (F3MRP) as a framework suitable for providing feedback on policies sampled at a high frequency. Under our approach, policies refined through teacher feedback are initially derived using Learning from Demonstration (LfD) techniques, which generalize a policy from example task executions by a teacher. We apply our techniques within the Advice-Operator Policy Improvement (A-OPI) algorithm, validated on a Segway RMP robot within a motion control domain. A-OPI refines LfD policies by correcting policy performance via advice-operators and F3MRP. Within our validation domain, policy performance is found to improve with corrective teacher feedback, and moreover to be similar or superior to that of policies provided with more teacher demonstrations.

Original languageEnglish (US)
Title of host publicationFrom Motor Learning to Interaction Learning in Robots
EditorsOliver Sigaud, Jan Peters, Jan Peters
Pages431-450
Number of pages20
DOIs
StatePublished - Jan 19 2010

Publication series

NameStudies in Computational Intelligence
Volume264
ISSN (Print)1860-949X

ASJC Scopus subject areas

  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Mobile robot motion control from demonstration and corrective feedback'. Together they form a unique fingerprint.

Cite this