Cogprints

Feel the beat: using cross-modal rhythm to integrate perception of objects, others, and self

Fitzpatrick, Paul and Arsenio, Artur (2004) Feel the beat: using cross-modal rhythm to integrate perception of objects, others, and self. [Conference Paper]

Full text available as:

[img]
Preview
PDF
1308Kb

Abstract

For a robot to be capable of development, it must be able to explore its environment and learn from its experiences. It must find (or create) opportunities to experience the unfamiliar in ways that reveal properties valid beyond the immediate context. In this paper, we develop a novel method for using the rhythm of everyday actions as a basis for identifying the characteristic appearance and sounds associated with objects, people, and the robot itself. Our approach is to identify and segment groups of signals in individual modalities (sight, hearing, and proprioception) based on their rhythmic variation, then to identify and bind causally-related groups of signals across different modalities. By including proprioception as a modality, this cross-modal binding method applies to the robot itself, and we report a series of experiments in which the robot learns about the characteristics of its own body.

Item Type:Conference Paper
Keywords:periodic motion, rhythm based segmentation, periodic motion, cross-modal association, robotic proprioception
Subjects:Computer Science > Machine Vision
Computer Science > Machine Learning
Computer Science > Robotics
ID Code:4062
Deposited By: Prince, Dr Christopher G.
Deposited On:14 Apr 2005
Last Modified:11 Mar 2011 08:55

Metadata

Repository Staff Only: item control page