The Missing Link between Morphemic Assemblies and Behavioral Responses:a Bayesian Information-Theoretical model of lexical processing

Moscoso del Prado Martin, Fermin and Aleksandar, Kostic and Dusica, Filipovic-Djurdjevic (2006) The Missing Link between Morphemic Assemblies and Behavioral Responses:a Bayesian Information-Theoretical model of lexical processing. (Unpublished)


There is a more recent version of this eprint available. Click here to view it.

Full text available as:



We present the Bayesian Information-Theoretical (BIT) model of lexical processing: A mathematical model illustrating a novel approach to the modelling of language processes. The model shows how a neurophysiological theory of lexical processing relying on Hebbian association and neural assemblies can directly account for a variety of eects previously observed in behavioral experiments. We develop two information-theoretical measures of the distribution of usages of a word or morpheme. These measures are calculated through unsupervised means from corpora. We show that our measures succesfully predict responses in three visual lexical decision datasets investigating the processing of in ectional morphology in Serbian and English languages, and the eects of polysemy and homonymy in English. We discuss how our model provides a neurophysiological grounding for the facilitatory and inhibitory eects of dierent types of lexical neighborhoods. In addition, our results show how, under a model based on neural assemblies, distributed patterns of activation naturally result in the arisal of discrete symbol-like structures. Therefore, the BIT model oers a point of reconciliation in the debate between distributed connectionist and discrete localist models. Finally, we argue that the modelling framework exemplied by the BIT model, is a powerful tool for integrating the different levels of the description of the human language processing system.

Item Type:Other
Keywords:Word assemblies, Bayesian model, Gaussian mixture, Bayesian, Hebbian, Polysemy, Homonymy, Inflectional morphology, Co-occurrence vectors
Subjects:Neuroscience > Neurolinguistics
Computer Science > Statistical Models
Computer Science > Language
Neuroscience > Neural Modelling
Linguistics > Computational Linguistics
Neuroscience > Computational Neuroscience
Linguistics > Semantics
Linguistics > Morphology
Computer Science > Machine Learning
Psychology > Psycholinguistics
Psychology > Cognitive Psychology
Computer Science > Neural Nets
Computer Science > Artificial Intelligence
ID Code:4754
Deposited By: Moscoso del Prado Martin, Dr Fermin
Deposited On:06 Mar 2006
Last Modified:11 Mar 2011 08:56

Available Versions of this Item


Repository Staff Only: item control page