---
abstract: |-
  Human developmental learning is capable of
  dealing with the dynamic visual world, speech-based
  dialogue, and their complex real-time association.
  However, the architecture that realizes
  this for robotic cognitive development has
  not been reported in the past. This paper takes
  up this challenge. The proposed architecture does
  not require a strict coupling between visual and
  auditory stimuli. Two major operations contribute
  to the “abstraction” process: multiscale temporal
  priming and high-dimensional numeric abstraction
  through internal responses with reduced variance.
  As a basic principle of developmental learning,
  the programmer does not know the nature
  of the world events at the time of programming
  and, thus, hand-designed task-specific representation
  is not possible. We successfully tested the
  architecture on the SAIL robot under an unprecedented
  challenging multimodal interaction mode:
  use real-time speech dialogue as a teaching source
  for simultaneous and incremental visual learning
  and language acquisition, while the robot is viewing
  a dynamic world that contains a rotating object
  to which the dialogue is referring.
altloc:
  - http://www.lucs.lu.se/ftp/pub/LUCS_Studies/LUCS101/Zhang.pdf
chapter: ~
commentary: ~
commref: ~
confdates: 'August 4-5, 2003'
conference: 'Third International Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems'
confloc: 'Boston, MA, USA'
contact_email: ~
creators_id: []
creators_name:
  - family: Zhang
    given: Yilu
    honourific: ''
    lineage: ''
  - family: Weng
    given: Juyang
    honourific: ''
    lineage: ''
date: 2003
date_type: published
datestamp: 2004-02-12
department: ~
dir: disk0/00/00/33/42
edit_lock_since: ~
edit_lock_until: ~
edit_lock_user: ~
editors_id: []
editors_name:
  - family: Prince
    given: Christopher G.
    honourific: ''
    lineage: ''
  - family: Berthouze
    given: Luc
    honourific: ''
    lineage: ''
  - family: Kozima
    given: Hideki
    honourific: ''
    lineage: ''
  - family: Bullock
    given: Daniel
    honourific: ''
    lineage: ''
  - family: Stojanov
    given: Georgi
    honourific: ''
    lineage: ''
  - family: Balkenius
    given: Christian
    honourific: ''
    lineage: ''
eprint_status: archive
eprintid: 3342
fileinfo: /style/images/fileicons/application_pdf.png;/3342/1/Zhang.pdf
full_text_status: public
importid: ~
institution: ~
isbn: ~
ispublished: pub
issn: ~
item_issues_comment: []
item_issues_count: 0
item_issues_description: []
item_issues_id: []
item_issues_reported_by: []
item_issues_resolved_by: []
item_issues_status: []
item_issues_timestamp: []
item_issues_type: []
keywords: 'autonomous mental development, incremental hierarchial discriminant regression, language acquisition, SAIL'
lastmod: 2011-03-11 08:55:25
latitude: ~
longitude: ~
metadata_visibility: show
note: ~
number: ~
pagerange: 147-154
pubdom: TRUE
publication: ~
publisher: Lund University Cognitive Studies
refereed: TRUE
referencetext: ~
relation_type: []
relation_uri: []
reportno: ~
rev_number: 12
series: ~
source: ~
status_changed: 2007-09-12 16:50:14
subjects:
  - comp-sci-mach-learn
  - comp-sci-robot
succeeds: ~
suggestions: ~
sword_depositor: ~
sword_slug: ~
thesistype: ~
title: Conjunctive Visual and Auditory Development via Real-Time Dialogue
type: confpaper
userid: 3507
volume: 101
<script src="//archive-bar.soton.ac.uk/archive-bar.js"></script>