Learning perceptual coupling for motor primitives
- 1 September 2008
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Dynamic system-based motor primitives have enabled robots to learn complex tasks ranging from Tennis-swings to locomotion. However, to date there have been only few extensions which have incorporated perceptual coupling to variables of external focus, and, furthermore, these modifications have relied upon handcrafted solutions. Humans learn how to couple their movement primitives with external variables. Clearly, such a solution is needed in robotics. In this paper, we propose an augmented version of the dynamic systems motor primitives which incorporates perceptual coupling to an external variable. The resulting perceptually driven motor primitives include the previous primitives as a special case and can inherit some of their interesting properties. We show that these motor primitives can perform complex tasks such a Ball-in-a-Cup or Kendama task even with large variances in the initial conditions where a skilled human player would be challenged. For doing so, we initialize the motor primitives in the traditional way by imitation learning without perceptual coupling. Subsequently, we improve the motor primitives using a novel reinforcement learning method which is particularly well-suited for motor primitives.Keywords
This publication has 10 references indexed in Scilit:
- Reinforcement Learning for Operational Space ControlPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Dynamics systems vs. optimal control — a unifying viewPublished by Elsevier ,2007
- Attention and Motor Skill LearningPublished by Bloomsbury Academic ,2007
- Policy Gradient Methods for RoboticsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Learning from demonstration: repetitive movements for autonomous service roboticsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Rapid synchronization and accurate phase-locking of rhythmic motor primitivesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Learning from demonstration and adaptation of biped locomotionRobotics and Autonomous Systems, 2004
- Movement imitation with nonlinear dynamical systems in humanoid robotsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- An Introduction to MCMC for Machine LearningMachine Learning, 2003
- Simple statistical gradient-following algorithms for connectionist reinforcement learningMachine Learning, 1992