Discovering Communication

Oudeyer, Dr. P-Y. (2006) Discovering Communication. [Journal (Paginated)]

Full text available as:



What kind of motivation drives child language development? This article presents a computational model and a robotic experiment to articulate the hypothesis that children discover communication as a result of exploring and playing with their environment. The considered robotic agent is intrinsically motivated towards situations in which it optimally progresses in learning. To experience optimal learning progress, it must avoid situations already familiar but also situations where nothing can be learnt. The robot is placed in an environment in which both communicating and non-communicating objects are present. As a consequence of its intrinsic motivation, the robot explores this environment in an organized manner focusing first on non-communicative activities and then discovering the learning potential of certain types of interactive behaviour. In this experiment, the agent ends up being interested by communication through vocal interactions without having a specific drive for communication.

Item Type:Journal (Paginated)
Keywords:development, robotics, communication, intrinsic motivation, vocalizations, stages
Subjects:Computer Science > Language
Computer Science > Robotics
ID Code:5149
Deposited By: Oudeyer, Pierre-Yves
Deposited On:17 Sep 2006
Last Modified:11 Mar 2011 08:56

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in cogprints you will be forwarded to the paracite service. Poorly formated references will probably not work.

Baillie, J., 2004. Urbi: A universal language for robotic control. International Journal

of Humanoid Robotics.

Barto, A., Singh, S., Chentanez, N., 2004. Intrinsically motivated learning of hierarchical

collections of skills. In: Proceedings of the 3rd International Conference on

Development and Learning (ICDL 2004). Salk Institute, San Diego.

Cangelosi, A., Parisi, D., 2002. Simulating the Evolution of Language. Springer.

De Boer, B., 2001. The origins of vowel systems. Oxford University Press.

Deci, E., Ryan, R., 1985. Intrinsic Motivation and Self-Determination in Human Behavior.

Plenum Press.

Dessalles, J.-L., 1998. Altruism, status and the origin of relevance. In: Hurford, J.,

Knight, C., Studdert-Kennedy, M. (Eds.), Approaches to the Evolution of Language:

Social and Cognitive bases. Edinburgh University Press, Edinburgh.

Gintis, H., Smith, E., Bowles, S., 2001. Costly signaling and cooperation. Journal of

Theoretical Biology 213, 103–119.

Gold, E., 1967. Language identification in the limit. Information and Control 10, 447–


Gold, K., Scassellati, B., 2006. Learning acceptable windows of contingency. Connection

Science 18 (2).

Hafner, V., Kaplan, F., 2005. Interpersonal maps and the body correspondence problem.

In: Demiris, Y., Dautenhahn, K., Nehaniv, C. (Eds.), Proceedings of the Third

International Symposium on Imitation in animals and artifacts. Herderfordshire, UK,

pp. 48–53.

Herrmann, J., Pawelzik, K., Geisel, T., 2000. Learning predicitve representations. Neurocomputing

32-33, 785–791.

Hutchins, E., Hazlehurst, B., 1995. How to invent a lexicon: the development of shared

symbols in interaction. In: Gilbert, N., Conte, R. (Eds.), Artificial Societies: The

Computer Simulation of Social Life. UCL Press, London, pp. 157–189.

Kaplan, F., 2005. Simple models of distribued coordination. Connection Science 17 (3).

Kaplan, F., Oudeyer, P.-Y., 2004. Maximizing learning progress: an internal reward

system for development. In: Iida, F., Pfeifer, R., Steels, L., Kuniyoshi, Y. (Eds.),

Embodied Artificial Intelligence. LNCS 3139. Springer-Verlag, London, UK, pp.


Kaplan, F., Oudeyer, P.-Y., 2005. The progress-drive hypothesis: an interpretation of

early imitation. In: Dautenhahn, K., Nehaniv, C. (Eds.), Models and mechanisms of

imitation and social learning: Behavioural, social and communication dimensions.

Cambridge University Press, to appear.

Ke, J., Minett, J., Au, C.-P., Wang, W., 2002. Self-organization and selection in the emergence of vocabulary. Complexity 7 (3), 41–54.

Kirby, S., 2002. Natural language and artificial life. Artificial life 8, 185–215.

Kuipers, B., Beeson, P., Modayil, J., Provost, J., 2006. Bootstrap learning of foundational

representations. Connection Science 18 (2).

Marshall, J., Blank, D., Meeden, L., 2004. An emergent framework for self-motivation

in developmental robotics. In: Proceedings of the 3rd International Conference on

Development and Learning (ICDL 2004). Salk Institute, San Diego.

Meltzoff, A., Gopnick, A., 1993. The role of imitation in understanding persons and

developing a theory of mind. In: S. Baron-Cohen, H. T.-F., D.Cohen (Eds.), Understanding

other minds. Oxford University Press, Oxford, England, pp. 335–366.

Moore, C., Corkum, V., 1994. Social understanding at the end of the first year of life.

Developmental Review 14, 349–372.

Olsson, L., Nehaniv, C. L., Polani, D., 2006. From unknown sensors and actuators to

actions grounded in sensorimotor perceptions. Connection Science 18 (2).

Oudeyer, P.-Y., 2005. How phonological structures can be culturally selected for learnability.

Adaptive Behavior 13 (4).

Oudeyer, P.-Y., 2006. Self-Organization in the Evolution of Speech. Studies in the Evolution

of Language. Oxford University Press.

Oudeyer, P.-Y., Kaplan, F., 2004. Intelligent adaptive curiosity: a source of selfdevelopment.

In: Berthouze, L., Kozima, H., Prince, C. G., Sandini, G., Stojanov,

G., Metta, G., Balkenius, C. (Eds.), Proceedings of the 4th International Workshop

on Epigenetic Robotics. Vol. 117. Lund University Cognitive Studies, pp. 127–130.

Oudeyer, P.-Y., Kaplan, F., Hafner, V., 2005a. Intrinsic motivation systems for openended

development. Technical report 05-03, SONY CSL PARIS.

Oudeyer, P.-Y., Kaplan, F., Hafner, V. V., Whyte, A., 2005b. The playground experiment:

Task-independent development of a curious robot. In: Bank, D., Meeden, L.

(Eds.), Proceedings of the AAAI Spring Symposium on Developmental Robotics,

2005. Stanford, California, pp. 42–47.

Philipona, D., O Regan, J., Nadal, J.-P., 2003. Is there something out there? inferring

space from sensorimotor dependencies. Neural Computation 15 (9), 2029–2049.

Piaget, J., 1952. The origins of intelligence in children. Norton, New York, NY.

Pinker, S., Bloom, P., 1990. Natural language and natural selection. Behavioral and

Brain Sciences 13 (4), 707–784.

Provost, J., Kuipers, B. J., Miikkulainen, R., 2006. Developing navigation behavior

through self-organizing distinctive state abstraction. Connection Science 18 (2).

Rolls, E. T., 1999. The Brain and Emotion. Oxford UP.

Schaffer, H., 1977. Early interactive development in studies of mother-infant interaction.

In: Proceedings of Loch Lomonds Symposium. Academic Press, New York,

pp. 3–18.

Schlesinger, M., 2006. Decomposing infants’ object representations: A dual-route processing

account. Connection Science 18 (2).

Schmidhuber, J., 1991. Curious model-building control systems. In: Proceeding International

Joint Conference on Neural Networks. Vol. 2. IEEE, Singapore, pp. 1458–


Schmidhuber, J., 2006. Developmental robotics, optimal artificial curiosity, creativity,

music, and the fine arts. Connection Science 18 (2).

Shoham, Y., Tennenholtz, M., 1997. On the emergence of social conventions: modeling,

analysis, and simulations. Artificial Intelligence 94 (1–2), 139–166.

Smith, K., Kirby, S., Brighton, H., 2003. Iterated learning: a framework for the emergence

of language. Artificial Life 9 (4), 371–386.

Steels, L., J. D. B., Neubauer, N., 2005. Linking in fluid construction grammars. Submitted.

Steels, L., 1996. Emergent adaptive lexicons. In: Maes, P., Mataric, M., Meyer, J.-

A., Pollack, J., Wilson, S. (Eds.), From Animals to Animats 4: Proceedings of

the Fourth International Conference On Simulation of Adaptive Behavior. The MIT

Press, Cambridge, MA, pp. 562–567.

Steels, L., July 2003. Evolving grounded communication for robots. Trends in Cognitive

Science 7 (7), 308–312.

Steels, L., Kaplan, F., 1999. Collective learning and semiotic dynamics. In: Floreano,

D., Nicoud, J.-D., Mondada, F. (Eds.), Advances in Artificial Life: 5th European

Conference (ECAL 99). Lecture Notes in Artificial Intelligence 1674. Springer-

Verlag, Berlin, pp. 679–688.

Steels, L., Kaplan, F., 2000. Aibo’s first words: The social learning of language and

meaning. Evolution of Communication 4 (1), 3–32.

Stronger, D., Stone, P., 2006. Towards autonomous sensor and actuator model induction

on a mobile robot. Connection Science 18 (2).

Sutton, R., Barto, A., 1998. Reinforcement learning: an introduction. MIT Press, Cambridge,


Thrun, S., 1995. Exploration in active learning. In: Arbib, M. (Ed.), Handbook of Brain

Science and Neural Networks. MIT Press, Cambridge, MA.

Vygotsky, L., 1978. Mind in society. Harvard university press,

Weng, J., McClelland, J., Pentland, A., Sporns, O., Stockman, I., Sur, M., Thelen, E.,

2001. Autonomous mental development by robots and animals. Science 291, 599–


White, R., 1959. Motivation reconsidered: The concept of competence. Psychological

review 66, 297–333.


Repository Staff Only: item control page