Search the Dagstuhl Website
Looking for information on the websites of the individual seminars? - Then please:
Not found what you are looking for? - Some of our services have separate websites, each with its own search option. Please check the following list:
Schloss Dagstuhl - LZI - Logo
Schloss Dagstuhl Services
Within this website:
External resources:
  • DOOR (for registering your stay at Dagstuhl)
  • DOSA (for proposing future Dagstuhl Seminars or Dagstuhl Perspectives Workshops)
Within this website:
External resources:
Within this website:
External resources:
  • the dblp Computer Science Bibliography

Dagstuhl Seminar 06231

Towards Affordance-Based Robot Control

( Jun 05 – Jun 09, 2006 )

(Click in the middle of the image to enlarge)

Please use the following short url to reference this page:



Today’s mobile robot perception is insufficient for acting goal-directedly in unconstrained, dynamic everyday environments like a home, a factory, or a city. Subject to restrictions in bandwidth, computer power, and computation time, a robot has to react to a wealth of dynamically changing stimuli in such environments, requiring rapid, selective attention to decisive, action-relevant information of high current utility. Robust and general engineering methods for effectively and efficiently coupling perception, action and reasoning are unavailable. Interesting performance, if any, is currently only achieved by sophisticated robot programming exploiting domain features and specialties, which leaves ordinary users no chance of changing how the robot acts.

The latter facts are high barriers for introducing, for example, service robots into human living or work environments. In order to overcome these barriers, additonal R&D efforts are required. The European Commission is undertaking a determined effort to fund related basic, inter-disciplinary research in a line of Strategic Objectives, including the Cognitive Systems calls in their 6th Framework Programme (FP6, [1]). One of the funded Cognitive Systems projects is MACS (“Multisensory autonomous cognitive systems interacting with dynamic environments for perceiving and using affordances”).

In Cognitive Science, an affordance in the sense of perceptual psychologist J.J. Gibson is a resource or support that the environment offers an agent for action, and that the agent can directly perceive and employ. Only rarely has this concept been used in Robotics and AI, although it offers an original perspective on coupling perception, action and reasoning, differing notably from standard hybrid robot control architectures. Taking it literally as a means or a metaphor for coupling perception and action directly, the potential is obvious that affordances offer for designing new powerful and intuitive robot control architectures.

Perceiving affordances in the environment means perception as filtered through the individual capabilities for physical action and through the current goals or intentions, thereby coupling perception and action deep down in the control architecture and providing an action-oriented interpretation of percepts in real time. Moreover, affordances provide on a high granularity level a basis for agent interaction and for learning or adapting context-dependent, goal-directed action.

The main objective of the MACS project is to explore and exploit the concept of affordances for the design and implementation of autonomous mobile robots acting goal-directedly in a dynamic environment. The aim is to develop affordance-based control as a method for robotics. That involves making affordances a first-class concept in a robot control architecture. By interfacing perception and action in terms of affordances, the project aims to provide a new way for reasoning and learning to connect with reactive robot control. The potential of this new methodology will be shown by going beyond navigation-like tasks towards goal-directed autonomous manipulation in the project demonstrators. All over, MACS aims at embedding its technical results into cognitive science.

Gibson’s concept of affordances has a strong appeal. It has been used in design and other areas. Reasons for the lack of usage of the concept in the Robotics literature probably include the non-technical way in which affordances are described in the Cognitive Science literature, making it hard to operationalize the concept in the context of a robot control program. In addition, the concept of affordances as a coupling of perception and action of an individual in its environment is not unanimously accepted in the Cognitive Science literature.

During the MACS proposal phase in late 2003, the idea of organizing an interdisciplinary Dagstuhl seminar related to the core MACS topics emerged. The planned purpose of the Seminar was threefold, namely

  1. to disseminate the MACS project ideas and concepts into related scientific communities,
  2. to receive feedback on and discuss these ideas, and
  3. to discuss the usage of affordances in other research areas.

The organizers saw researchers in four broad areas (philosophy and logic, artificial intelligence and computer science, psychology, and economics and game theory) addressing highly related (in some cases, the same) problems, in which work in one area in all likelihood would benefit research in another. Hence for the Dagstuhl seminar, the organizers felt that there would be valuable interactions and contributions that could be anticipated by bringing people together from these areas.

Goals of the Seminar

The aim of the seminar was to bring together researchers from Robotics, Informatics and the Cognitive Sciences to exchange their experiences and opinions, and generate new ideas regarding the following questions:

  • How could or should a robot control architecture look like that makes use of affordances as first-class items in perceiving the environment?
  • How could or should such an architecture make use of affordances for action and reasoning?
  • Is there more to affordances than function-oriented perception, action and reasoning?

The answers to these questions are currently widely open. Two points can be stated with certainty, however. First, an affordance-based robot control architecture cannot simply be an extension (an “added layer”, so to speak) to existing modern control architectures. The reason is that affordances would spring into existence in low-level perception, would have to pass filters in the control, such as attentional mechanisms, in order not to flood the robot’s higher processing levels, and serve in some explicitly represented form of a structured result of perception as a resource for action selection, deliberation, and learning. So if there is such a thing as an affordance-based control architecture, affordances will have to play a role in all of its layers.

Second, the answers to the seminar questions do not depend on whether or not the Cognitive Sciences agree that Gibson is “right” in the sense that affordances exist in biological brains or minds or exist in the interaction between biological individuals and their environment. The point is, if Gibson’s description of phenomena of functional coupling between perception and action is correct, then it is of high interest for robot control designers, independent of how it is best understood according to Cognitive Science standards. Therefore, the seminar would profit from either proponents or opponents of the affordance model. The aim here was discussion and exchange, not unanimity.

  • Michael Beetz (TU München, DE) [dblp]
  • Gordon Bernedo-Schneider (Universität Kassel, DE)
  • James Bonaiuto (USC - Los Angeles, US)
  • Ralph Breithaupt (Fraunhofer IAIS - St. Augustin, DE)
  • Maya Cakmak (Middle East Technical University - Ankara, TR) [dblp]
  • Mehmet R. Dogar (Middle East Technical University - Ankara, TR) [dblp]
  • Georg Dorffner (ÖSGK - Vienna, AT)
  • Simone Frintrop (KTH Royal Institute of Technology, SE)
  • Gerald Fritz (Joanneum Research - Graz, AT)
  • Verena V. Hafner (TU Berlin, DE) [dblp]
  • Matthias Hennig (TU Dresden, DE)
  • Joachim Hertzberg (Universität Osnabrück, DE) [dblp]
  • Jörg Irran (OFAI - Wien, AT)
  • Krzysztof Janowicz (Universität Münster, DE) [dblp]
  • Florian Kintzler (OFAI - Wien, AT)
  • Kai Lingemann (Universität Osnabrück, DE)
  • Stefan May (Fraunhofer IAIS - St. Augustin, DE)
  • Reinhard Moratz (Universität Bremen, DE)
  • Andreas Nüchter (Universität Osnabrück, DE)
  • Lucas Paletta (Joanneum Research - Graz, AT)
  • Martin Raubal (Universität Münster, DE) [dblp]
  • Erich Rome (Fraunhofer IAIS - St. Augustin, DE)
  • Piotr Rudol (Linköping University, SE)
  • Alessandro Saffiotti (University of Örebro, SE) [dblp]
  • Erol Sahin (Middle East Technical University - Ankara, TR)
  • Sumit Sen (Universität Münster, DE)
  • Louise Stark (University of the Pacific - Stockton, US)
  • Melanie Sutton (IHMC - Pensacola, US)
  • Elin-Anna Topp (KTH Royal Institute of Technology, SE)
  • Göktürk Ucoluk (Middle East Technical University - Ankara, TR)
  • Emre Ugur (Middle East Technical University - Ankara, TR) [dblp]
  • Barbara Webb (University of Edinburgh, GB)
  • Jeremy L. Wyatt (University of Birmingham, GB) [dblp]

Related Seminars
  • Dagstuhl Seminar 09431: From Form to Function (2009-10-18 - 2009-10-23) (Details)

  • Artificial Intelligence / Robotics (primary)
  • Interdisciplinary: Cognitive Sciences (secondary)

  • Autonomous mobile robot
  • robot control architecture
  • robot perception
  • cognitive robotics
  • knowledge representation and learning
  • affordances
  • cognitive role of function and action
  • attention
  • motivation