Instructing cooperating assembly robots through situated dialogues in natural language

Abstract
We present an assembly cell consisting of two cooperat- ing robots and a variety of sensors. It offers a number of complex skills necessary for constructing aggregates from elements of a toy construction set. A high degree of flex- ibility was achieved because the skills were realised only through sensory feedback, not by resorting to fixtures or specialised tools. The operation of the cell is completely controlled through natural language. Results from experi- ments in cognitive sciences and computer linguistics were incorporated to integrate natural language with vision as well as to control the construction dialogue between a hu- man instructor and the robotic system. The experimental setup is described; a sample dialogue demonstrates the ca- pabilites of the cell. A brief discussion of issues for furth er research concludes the paper.

This publication has 5 references indexed in Scilit: