?url_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&rft.title=Conjunctive+Visual+and+Auditory+Development+via+Real-Time+Dialogue&rft.creator=Zhang%2C+Yilu&rft.creator=Weng%2C+Juyang&rft.subject=Machine+Learning&rft.subject=Robotics&rft.description=Human+developmental+learning+is+capable+of%0Adealing+with+the+dynamic+visual+world%2C+speech-based%0Adialogue%2C+and+their+complex+real-time+association.%0AHowever%2C+the+architecture+that+realizes%0Athis+for+robotic+cognitive+development+has%0Anot+been+reported+in+the+past.+This+paper+takes%0Aup+this+challenge.+The+proposed+architecture+does%0Anot+require+a+strict+coupling+between+visual+and%0Aauditory+stimuli.+Two+major+operations+contribute%0Ato+the+%E2%80%9Cabstraction%E2%80%9D+process%3A+multiscale+temporal%0Apriming+and+high-dimensional+numeric+abstraction%0Athrough+internal+responses+with+reduced+variance.%0AAs+a+basic+principle+of+developmental+learning%2C%0Athe+programmer+does+not+know+the+nature%0Aof+the+world+events+at+the+time+of+programming%0Aand%2C+thus%2C+hand-designed+task-specific+representation%0Ais+not+possible.+We+successfully+tested+the%0Aarchitecture+on+the+SAIL+robot+under+an+unprecedented%0Achallenging+multimodal+interaction+mode%3A%0Ause+real-time+speech+dialogue+as+a+teaching+source%0Afor+simultaneous+and+incremental+visual+learning%0Aand+language+acquisition%2C+while+the+robot+is+viewing%0Aa+dynamic+world+that+contains+a+rotating+object%0Ato+which+the+dialogue+is+referring.&rft.publisher=Lund+University+Cognitive+Studies&rft.contributor=Prince%2C+Christopher+G.&rft.contributor=Berthouze%2C+Luc&rft.contributor=Kozima%2C+Hideki&rft.contributor=Bullock%2C+Daniel&rft.contributor=Stojanov%2C+Georgi&rft.contributor=Balkenius%2C+Christian&rft.date=2003&rft.type=Conference+Paper&rft.type=PeerReviewed&rft.format=application%2Fpdf&rft.identifier=http%3A%2F%2Fcogprints.org%2F3342%2F1%2FZhang.pdf&rft.identifier=++Zhang%2C+Yilu+and+Weng%2C+Juyang++(2003)+Conjunctive+Visual+and+Auditory+Development+via+Real-Time+Dialogue.++%5BConference+Paper%5D+++++&rft.relation=http%3A%2F%2Fcogprints.org%2F3342%2F