---
abstract: |-
Human developmental learning is capable of
dealing with the dynamic visual world, speech-based
dialogue, and their complex real-time association.
However, the architecture that realizes
this for robotic cognitive development has
not been reported in the past. This paper takes
up this challenge. The proposed architecture does
not require a strict coupling between visual and
auditory stimuli. Two major operations contribute
to the “abstraction” process: multiscale temporal
priming and high-dimensional numeric abstraction
through internal responses with reduced variance.
As a basic principle of developmental learning,
the programmer does not know the nature
of the world events at the time of programming
and, thus, hand-designed task-specific representation
is not possible. We successfully tested the
architecture on the SAIL robot under an unprecedented
challenging multimodal interaction mode:
use real-time speech dialogue as a teaching source
for simultaneous and incremental visual learning
and language acquisition, while the robot is viewing
a dynamic world that contains a rotating object
to which the dialogue is referring.
altloc:
- http://www.lucs.lu.se/ftp/pub/LUCS_Studies/LUCS101/Zhang.pdf
chapter: ~
commentary: ~
commref: ~
confdates: 'August 4-5, 2003'
conference: 'Third International Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems'
confloc: 'Boston, MA, USA'
contact_email: ~
creators_id: []
creators_name:
- family: Zhang
given: Yilu
honourific: ''
lineage: ''
- family: Weng
given: Juyang
honourific: ''
lineage: ''
date: 2003
date_type: published
datestamp: 2004-02-12
department: ~
dir: disk0/00/00/33/42
edit_lock_since: ~
edit_lock_until: ~
edit_lock_user: ~
editors_id: []
editors_name:
- family: Prince
given: Christopher G.
honourific: ''
lineage: ''
- family: Berthouze
given: Luc
honourific: ''
lineage: ''
- family: Kozima
given: Hideki
honourific: ''
lineage: ''
- family: Bullock
given: Daniel
honourific: ''
lineage: ''
- family: Stojanov
given: Georgi
honourific: ''
lineage: ''
- family: Balkenius
given: Christian
honourific: ''
lineage: ''
eprint_status: archive
eprintid: 3342
fileinfo: /style/images/fileicons/application_pdf.png;/3342/1/Zhang.pdf
full_text_status: public
importid: ~
institution: ~
isbn: ~
ispublished: pub
issn: ~
item_issues_comment: []
item_issues_count: 0
item_issues_description: []
item_issues_id: []
item_issues_reported_by: []
item_issues_resolved_by: []
item_issues_status: []
item_issues_timestamp: []
item_issues_type: []
keywords: 'autonomous mental development, incremental hierarchial discriminant regression, language acquisition, SAIL'
lastmod: 2011-03-11 08:55:25
latitude: ~
longitude: ~
metadata_visibility: show
note: ~
number: ~
pagerange: 147-154
pubdom: TRUE
publication: ~
publisher: Lund University Cognitive Studies
refereed: TRUE
referencetext: ~
relation_type: []
relation_uri: []
reportno: ~
rev_number: 12
series: ~
source: ~
status_changed: 2007-09-12 16:50:14
subjects:
- comp-sci-mach-learn
- comp-sci-robot
succeeds: ~
suggestions: ~
sword_depositor: ~
sword_slug: ~
thesistype: ~
title: Conjunctive Visual and Auditory Development via Real-Time Dialogue
type: confpaper
userid: 3507
volume: 101