---
abstract: 'It has often been noted that the learning problem in feed-forward neural networks is very badly conditioned. Although, generally, the special form of the transfer function is usually taken to be the cause of this condition, we show that it is caused by the manner in which neurons are connected. By analyzing the expected values of the Hessian in a feed-forward network it is shown that, even in a network where all the learning samples are well chosen and the transfer function is not in its saturated state, the system has a non-optimal condition. We subsequently propose a change in the feed-forward network structure which alleviates this problem. We finally demonstrate the positive influence of this approach.'
altloc:
- http://www.robotic.dlr.de/Smagt/papers/SmaHir98b.ps.gz
chapter: ~
commentary: ~
commref: ~
confdates: 'September 1-4, 1998'
conference: International Conference on Artificial Neural Networks
confloc: 'Skovde, Sweden'
contact_email: ~
creators_id: []
creators_name:
- family: Smagt
given: P. van der
honourific: ''
lineage: ''
- family: Hirzinger
given: G.
honourific: ''
lineage: ''
date: 1998
date_type: published
datestamp: 1998-07-03
department: ~
dir: disk0/00/00/04/95
edit_lock_since: ~
edit_lock_until: ~
edit_lock_user: ~
editors_id: []
editors_name: []
eprint_status: archive
eprintid: 495
fileinfo: /style/images/fileicons/application_postscript.png;/495/2/SmaHir98b.ps
full_text_status: public
importid: ~
institution: ~
isbn: ~
ispublished: inpress
issn: ~
item_issues_comment: []
item_issues_count: 0
item_issues_description: []
item_issues_id: []
item_issues_reported_by: []
item_issues_resolved_by: []
item_issues_status: []
item_issues_timestamp: []
item_issues_type: []
keywords: ~
lastmod: 2011-03-11 08:54:00
latitude: ~
longitude: ~
metadata_visibility: show
note: ~
number: ~
pagerange: ~
pubdom: FALSE
publication: ~
publisher: 'Springer Verlag, Berlin'
refereed: FALSE
referencetext: ~
relation_type: []
relation_uri: []
reportno: ~
rev_number: 10
series: ~
source: ~
status_changed: 2007-09-12 16:29:07
subjects:
- comp-sci-neural-nets
- comp-sci-stat-model
succeeds: ~
suggestions: ~
sword_depositor: ~
sword_slug: ~
thesistype: ~
title: Why feed-forward networks are in a bad shape
type: confpaper
userid: 462
volume: ~