---
abstract: 'The value system of a developmental robot signals the occurrence of salient sensory inputs, modulates the mapping from sensory inputs to action outputs, and evaluates candidate actions. In the work reported here, a low level value system is modeled and implemented. It simulates the non-associative animal learning mechanism known as habituation effect. Reinforcement learning is also integrated with novelty. Experimental results show that the proposed value system works as designed in a study of robot viewing angle selection.'
altloc:
  - http://www.lucs.lu.se/ftp/pub/LUCS_Studies/LUCS94/Huang.pdf
chapter: ~
commentary: ~
commref: ~
confdates: 'August 10-11, 2002'
conference: 'Second International Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems'
confloc: 'Edinburgh, Scotland'
contact_email: ~
creators_id: []
creators_name:
  - family: Huang
    given: Xiao
    honourific: ''
    lineage: ''
  - family: Weng
    given: John
    honourific: ''
    lineage: ''
date: 2002
date_type: published
datestamp: 2003-10-04
department: ~
dir: disk0/00/00/25/11
edit_lock_since: ~
edit_lock_until: ~
edit_lock_user: ~
editors_id: []
editors_name:
  - family: Prince
    given: Christopher G.
    honourific: ''
    lineage: ''
  - family: Demiris
    given: Yiannis
    honourific: ''
    lineage: ''
  - family: Marom
    given: Yuval
    honourific: ''
    lineage: ''
  - family: Kozima
    given: Hideki
    honourific: ''
    lineage: ''
  - family: Balkenius
    given: Christian
    honourific: ''
    lineage: ''
eprint_status: archive
eprintid: 2511
fileinfo: /style/images/fileicons/application_pdf.png;/2511/1/Huang.pdf
full_text_status: public
importid: ~
institution: ~
isbn: ~
ispublished: pub
issn: ~
item_issues_comment: []
item_issues_count: 0
item_issues_description: []
item_issues_id: []
item_issues_reported_by: []
item_issues_resolved_by: []
item_issues_status: []
item_issues_timestamp: []
item_issues_type: []
keywords: 'developmental robot, value system, sensory, habituation effect, reinforcement learning, IHDR, SAIL'
lastmod: 2011-03-11 08:55:03
latitude: ~
longitude: ~
metadata_visibility: show
note: ~
number: ~
pagerange: 47-55
pubdom: TRUE
publication: ~
publisher: Lund University Cognitive Studies
refereed: TRUE
referencetext: ~
relation_type: []
relation_uri: []
reportno: ~
rev_number: 12
series: ~
source: ~
status_changed: 2007-09-12 16:45:20
subjects:
  - comp-sci-stat-model
  - comp-sci-mach-learn
  - comp-sci-art-intel
  - comp-sci-robot
succeeds: ~
suggestions: ~
sword_depositor: ~
sword_slug: ~
thesistype: ~
title: Novelty and Reinforcement Learning in the Value System of Developmental Robots
type: confpaper
userid: 3507
volume: 94
<script src="//archive-bar.soton.ac.uk/archive-bar.js"></script>