?url_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&rft.title=Natural+Language+Processing%0Awith+Modular+Neural+Networks+and+Distributed+Lexicon&rft.creator=Miikkulainen%2C+Risto&rft.creator=Dyer%2C+Michael+G.&rft.subject=Language&rft.subject=Neural+Nets&rft.subject=Computational+Linguistics&rft.description=An+approach+to+connectionist+natural+language+processing+is+proposed%2C+which+is+based+on+hierarchically+organized+modular+Parallel+Distributed+Processing+(PDP)+networks+and+a+central+lexicon+of+distributed+input%2Foutput+representations.+The+modules+communicate+using+these+representations%2C+which+are+global+and+publicly+available+in+the+system.+The+representations+are+developed+automatically+by+all+networks+while+they+are+learning+their+processing+tasks.+The+resulting+representations+reflect+the+regularities+in+the+subtasks%2C+which+facilitates+robust+processing+in+the+face+of+noise+and+damage%2C+supports+improved+generalization%2C+and+provides+expectations+about+possible+contexts.++The+lexicon+can+be+extended+by+cloning+new+instances+of+the+items%2C+that+is%2C+by+generating+a+number+of+items+with+known+processing+properties+and+distinct+identities.+This+technique+combinatorially+increases+the+processing+power+of+the+system.+The+recurrent+FGREP+module%2C+together+with+a+central+lexicon%2C+is+used+as+a+basic+building+block+in+modeling+higher+level+natural+language+tasks.+A+single+module+is+used+to+form+case-role+representations+of+sentences+from+word-by-word+sequential+natural+language+input.+A+hierarchical+organization+of+four+recurrent+FGREP+modules+(the+DISPAR+system)+is+trained+to+produce+fully+expanded+paraphrases+of+script-based+stories%2C+where+unmentioned+events+and+role+fillers+are+inferred.&rft.date=1991&rft.type=Journal+(Paginated)&rft.type=PeerReviewed&rft.format=application%2Fpostscript&rft.identifier=http%3A%2F%2Fcogprints.org%2F1896%2F2%2Ftt.ps&rft.identifier=++Miikkulainen%2C+Risto+and+Dyer%2C+Michael+G.++(1991)+Natural+Language+Processing+with+Modular+Neural+Networks+and+Distributed+Lexicon.++%5BJournal+(Paginated)%5D+++++&rft.relation=http%3A%2F%2Fcogprints.org%2F1896%2F