Found 11 results.




learning object affordances: from sensory - motor coordination to imitation

Author(s): Luis Montesano, Manuel Lopes, Alexandre Bernardino, Member, IEEE, Jose Santos-Victor
Venue: IEEE Transactions on Robotics (Volume 24, Issue 1)
Year Published: 2008
Keywords: humanoid robotics, learning from demonstration, planning
Expert Opinion: Affordances have been very influential in robotics in the last decade and this study laid the foundations of affordance-based robot learning research that emphasizes importance of exploration; and learning the relation between objects, actions and the observed effects. They showed how learned affordances can be used for goal-oriented action execution and for imitation.

hindsight experience replay

Author(s): Marcin Andrychowicz, Filip Wolski, Alex Ray, Jonas Schneider, Rachel Fong, Peter Welinder, Bob McGrew, Josh Tobin, Pieter Abbeel, Wojciech Zaremba
Venue: Neural Information Processing Systems Conference (NeurIPS)
Year Published: 2018
Keywords: manipulation, humanoid robotics, reinforcement learning, neural networks
Expert Opinion: A really nice, simple idea for learning parameterized skills (building on UVFAs) and efficiently dealing with sparse reward. I think Learning Parameterized Motor Skills on a Humanoid Robot (Castro Da Silva et. al) has a much better description of the parameterized skill learning problem than the HER or UVFA papers, but the HER paper has better practical ideas.

learning attractor landscapes for learning motor primitives

Author(s): Auke Jan Ijspeert, Jun Nakanishi, and Stefan Schaal
Venue: Neural Information Processing Systems Conference (NeurIPS)
Year Published: 2003
Keywords: manipulation, planning, learning from demonstration, reinforcement learning, humanoid robotics
Expert Opinion: This is the basis for large body of work on learning movement primitives. This first paper on the topic was published by the same authors at ICRA 2002

cognitive developmental robotics: a survey

Author(s): Minoru Asada, Koh Hosoda, Yasuo Kuniyoshi, Hiroshi Ishiguro, Toshio Inui, Yuichiro Yoshikawa, Masaki Ogino, and Chisato Yoshida
Venue: IEEE Transactions on Autonomous Mental Development
Year Published: 2009
Keywords: survey, humanoid robotics, cognitive sciences, visual perception
Expert Opinion: I really like the overview of cognitive robotics, where learning can be applied and what the required parts are essential to learning and cognitive (artificial) systems.

developmental robotics: from babies to robots

Author(s): A Cangelosi, M Schlesinger
Venue: Book
Year Published: 2015
Keywords: humanoid robotics, reinforcement learning, cognitive sciences
Expert Opinion: This book gave the first broad overview of the field of developmental robotics.

is imitation learning the route to humanoid robots?

Author(s): Stefan Schaal
Venue: Trends in Cognitive Sciences
Year Published: 1999
Keywords: neural networks, humanoid robotics, survey, learning from demonstration, planning
Expert Opinion: I think this work is a seminal work on imitation learning, which is a fundamental framework in the field of robot learning.

on learning, representing and generalizing a task in a humanoid robot

Author(s): Sylvain Calinon, Florent Guenter and Aude Billard
Venue: IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) (Volume 27, Issue 2)
Year Published: 2007
Keywords: humanoid robotics, gaussians
Expert Opinion: First work to explicitly represent motion variance for motion generation.

movement imitation with nonlinear dynamical systems in humanoid robots

Author(s): Auke Jan Ijspeert, Jun Nakanishi, Stefan Schaal
Venue: IEEE International Conference on Robotics and Automation (ICRA)
Year Published: 2002
Keywords: probabilistic models, nonlinear systems, dynamical systems, learning from demonstration, humanoid robotics
Expert Opinion: This paper introduced Dynamic Motor Primitives (DMPs) - a very prominent representation for robot motion used in many learning approaches. While originally introduced as an imitation learning approach, DMPs have gone on to become central to many reinforcement learning papers. Many modern approaches that end with the word "primitive" are descendants of this work, including Probabilistic Motion Primitives (ProMPs), or Interaction Primitives.

robot programming by demonstration

Author(s): Aude Billard and Sylvain Calinon, Ruediger Dillmann, Stefan Schaal
Venue: Book
Year Published: 2008
Keywords: humanoid robotics, learning from demonstration, dynamical systems
Expert Opinion: Provides a clear presentation of robot learning from demonstration from the authors who made the approach popular

a roadmap for cognitive development in robots

Author(s): David Vernon, Claes von Hofsten, and Luciano Fadiga
Venue: Book
Year Published: 2011
Keywords: humanoid robotics
Expert Opinion: David Vernon's two references highlight the importance of the architecture and the role of its components in learning how to execute and interpret actions. The first, co-authored with a Neuroscientist (Luciano Fadiga) and a Developmental Psychology (Claes von Hofsten) highlights how the development of sensory, motor and cognitive skills in childhood can be analyzed as a process supporting the acquisition of complex behaviors in humans and artificial systems as well as the parallel between action execution and action understanding in the acquisition of cognitive skills (the mirror neuron approach).

artificial cognitive systems: a primer

Author(s): David Vernon
Venue: Book
Year Published: 2014
Keywords: cognitive sciences, dynamical systems, neural networks, humanoid robotics
Expert Opinion: David Vernon's two references highlight the importance of the architecture and the role of its components in learning how to execute and interpret actions. The second is a must-read book for who is interested in the field of artificial cognitive systems.