The Processing of Lexical Sequences

Shaoul, Dr. Cyrus (2012) The Processing of Lexical Sequences. [Thesis]

Full text available as:



Psycholinguistics has traditionally been defined as the study of how we process units of language such as letters, words and sentences. But what about other units? This dissertation concerns itself with short lexical sequences called n- grams, longer than words but shorter than most sentences. N-grams can be phrases (such as the 3-gram "the great divide") or just fragments (such as the 4- gram means "nothing to a"). Words are often thought to be the universal, atomic building block of longer lexical sequences, but n-grams are equally capable of carrying meaning and being combined to create any sentence. Are n-grams more than just the sum of their parts (the sum of their words)? How do language users process n-grams when they are asked to read them or produce them? Using evidence that I have gathered, I will address these and other questions with the goal of better understanding n-gram processing.

Item Type:Thesis
Keywords:n-grams, frequency, mutual information, lexical probability
Subjects:Psychology > Psycholinguistics
ID Code:8831
Deposited By: Shaoul, Dr. Cyrus
Deposited On:04 May 2013 22:47
Last Modified:04 May 2013 22:47

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in cogprints you will be forwarded to the paracite service. Poorly formated references will probably not work.

Acheson, D., & MacDonald, M. (2009). Verbal working memory and lan-

guage production: Common approaches to the serial ordering of verbal

information. Psychological bulletin, 135 (1), 50.

Agresti, A. (2010). Analysis of ordinal categorical data. Hoboken, NJ, USA:

John Wiley & Sons Inc.

Akaike, H. (1974). A new look at the statistical model identification. IEEE

Transactions on Automatic Control, 19 (6), 716–723.

Altmann, G., & Mirkovi ́

c, J. (2009). Incrementality and prediction in human

sentence processing. Cognitive Science, 33 (4), 583–609.

Anderson, J. (1982). Acquisition of cognitive skill. Psychological Review,

89 (4), 369–406.

Anderson, J. (1990). The adaptive character of thought. Lawrence Erlbaum.

Andrews, S., & Bond, R. (2009). Lexical expertise and reading skill: Bottom-

up and top-down processing of lexical ambiguity. Reading and Writing,

22 (6), 687–711.

Angele, B., & Rayner, K. (2011). Parafoveal processing of word n+2 dur-

ing reading: Do the preceding words matter? Journal of Experimental

Psychology: Human Perception and Performance, 37 (4), 1210.

Arnon, I., & Clark, E. V. (2011). Why Brush Your Teeth Is Better Than

Teeth – Children’s Word Production Is Facilitated in Familiar Sentence-

Frames. Language Learning and Development, 7 (2), 107.

Arnon, I., & Snider, N. (2010). More than words: Frequency effects for multi-

word phrases. Journal of Memory and Language, 62 (1), 67–82.

Baayen, R. H. (2008). Analyzing linguistic data: A practical introduction to

statistics using R. Cambridge, UK: Cambridge University Press.

Baayen, R. H. (2010a). Demythologizing the word frequency effect: A dis-

criminative learning perspective. The Mental Lexicon, 5 (3), 436–461.

Baayen, R. H. (2010b). A real experiment is a factorial experiment? The

Mental Lexicon, 5 (1), 149–157.

Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008). Mixed-effects modeling

with crossed random effects for subjects and items. Journal of Memory

and Language, 59 (4), 390–412.

Baayen, R. H., Feldman, L., & Schreuder, R. (2006). Morphological influences

on the recognition of monosyllabic monomorphemic words. Journal of

Memory and Language, 55, 290–313.

Baayen, R. H., & Hendrix, P. (2011). Sidestepping the combinatorial ex-

plosion: Towards a processing model based on discriminative learning.

Proceedings of the Annual Meeting of the Linguistic Society of America.

Baayen, R. H., Kuperman, V., & Bertram, R. (2010). Frequency effects in

compound processing. In S. Scalise & I. Vogel (Eds.), Compounding.

Amsterdam/Philadelphia: Benjamins.

Baayen, R. H., & Milin, P. (2010). Analyzing reaction times. International

Journal of Psychological Research, 3.2, 12-28.

Baayen, R. H., Milin, P., Djurdjevic, D., Hendrix, P., & Marelli, M. (2011). An

amorphous model for morphological processing in visual comprehension

based on naive discriminative learning. Psychological Review, 118 (3),


Baetes, E., & Elman, J. (1993). Connectionism and the study of change. Brain

Dovelopement and Cognition, 420–440.

Baker, J., Deng, L., Glass, J., Khudanpur, S., Lee, C. hui, Morgan, N., et

al. (2009). Developments and directions in speech recognition and un-

derstanding, part 1 [DSP education]. IEEE Signal Processing Magazine,

26 (3), 75–80.

Balota, D. A., Pilotti, M., & Cortese, M. J. (2001). Subjective frequency

estimates for 2,938 monosyllabic words. Memory & Cognition, 29 (4),


Bandura, A. (1997). Self-efficacy: the exercise of control. New York, US: W.H.


Banks, W. (1977). Encoding and processing of symbolic information in com-

parative judgments. The psychology of learning and motivation, 11 (101-


Bannard, C., & Matthews, D. (2008). Stored word sequences in language

learning: The effect of familiarity on children’s repetition of Four-Word

combinations. Psychological Science, 19 (3), 241–248.

Bar, M. (2007). The proactive brain: using analogies and associations to

generate predictions. Trends in Cognitive Sciences, 11 (7), 280–289.

Bar, M. (2009). The proactive brain: memory for predictions. Philosophi-

cal Transactions of the Royal Society B: Biological Sciences, 364 (1521),


Bates, D. M. (in preparation). lme4: Mixed-effects modeling with R. Springer.

Battig, W., & Montague, W. (1969). Category norms of verbal items in 56

categories a replication and extension of the connecticut category norms.

Journal of Experimental Psychology(392).

Beattie, G., & Butterworth, B. (1979). Contextual probability and word

frequency as determinants of pauses and errors in spontaneous speech.

Language and Speech, 22 (3), 201.

Bell, A., Brenier, J. M., Gregory, M., Girand, C., & Jurafsky, D. (2009).

Predictability effects on durations of content and function words in con-

versational english. Journal of Memory and Language, 60 (1), 92–111.

Belsley, D. A., Kuh, E., & Welsch, R. E. (2004). Regression diagnostics:

Identifying influential data and sources of collinearity. Hoboken, NJ,

USA: Wiley-Interscience.

Biber, D. (1999). Lexical bundles in conversation and academic prose. Lan-

guage and Computers, 26, 181–190.

Biber, D., Conrad, S., & Cortes, V. (2004). If you look at ...: Lexical bundles in

university teaching and textbooks. Applied Linguistics, 25 (3), 371–405.

Bicknell, K., & Levy, R. (2010). Rational eye movements in reading combining

uncertainty about previous words with contextual probability. In Pro-

ceedings of the 32nd annual conference of the cognitive science society.

Binder, J., McKiernan, K., Parsons, M., Westbury, C., Possing, E., Kaufman,

J., et al. (2003). Neural correlates of lexical access during visual word

recognition. Journal of Cognitive Neuroscience, 15 (3), 372–393.

Block, C., & Baldwin, C. (2010). Cloze probability and completion norms

for 498 sentences: Behavioral and neural validation using event-related

potentials. Behavior research methods, 42 (3), 665–670.

Bloom, P., & Fischler, I. (1980). Completion norms for 329 sentence contexts.

Memory & Cognition, 8 (6), 631–642.

Bloor, D. (1983). Wittgenstein: A social theory of knowledge. London, UK:


Bod, R. (2009). From exemplar to grammar: A probabilistic Analogy-Based

model of language learning. Cognitive Science, 33 (5), 752–793.

Bormuth, J. (1966). Readability: A new approach. Reading research quarterly,


Box, G. E., & Cox, D. R. (1964). An analysis of transformations (with

discussion). Journal of the Royal Statistical Society, Series B, 26 (211-

252), 57.

Brainerd, C., & Reyna, V. (2002). Fuzzy-trace theory and false memory.

Current Directions in Psychological Science, 11 (5), 164–169.

Brants, T., & Franz, A. (2006). Web 1T 5-gram version 1. Philadelphia, PA

USA: Linguistic Data Consortium.

Brants, T., & Franz, A. (2009). Web 1t 5-gram, 10 european languages version

1. Linguistic Data Consortium, Philadelphia.

Breiman, L. (2001). Random forests. Machine learning, 45 (1), 5–32.

Bunce, S., Izzetoglu, M., Izzetoglu, K., Onaral, B., & Pourrezaei, K. (2006).

Functional near-infrared spectroscopy. Engineering in Medicine and Bi-

ology Magazine, IEEE, 25 (4), 54–62.

Burgess, C. (1998). From simple associations to the building blocks of lan-

guage: Modeling meaning in memory with the HAL model. Behavior

Research Methods, Instruments, & Computers, 30, 188–198.

Burnham, K. P., & Anderson, D. R. (2002). Model selection and multimodel

inference: a practical information-theoretic approach. New York, NY,

USA: Springer Verlag.

Bybee, J. (2002). Phonological evidence for exemplar storage of multiword

sequences. Studies in Second Language Acquisition, 24 (02), 215–221.

Bybee, J., & Scheibman, J. (1999). The effect of usage on degrees of con-stituency: the reduction of ’don’t’ in English.(Statistical data included).

Linguistics: an interdisciplinary journal of the language sciences.

Chi, M. (2005). Commonsense conceptions of emergent processes: Why some

misconceptions are robust. The Journal of the Learning Sciences, 161–


Chi, M., Roscoe, R., Slotta, J., Roy, M., & Chase, C. (2011). Misconceived

causal explanations for emergent processes. Cognitive Science.

Chomsky, N. (1980). Rules and representations. New York, US: Columbia

University Press.

Chomsky, N. (2005). Rules and representations. New York, US: Columbia

Univ Pr.

Christensen, R. H. B.


Ordinal—regression models for or-

dinal data.

(R package version 2010.12-15 http://www.cran.r-

Christiansen, M. H., Conway, C. M., & Onnis, L. (in press). Similar neural

correlates for language and sequential learning: Evidence from event-

related brain potentials. Language and Cognitive Processes.

Church, K. W., & Hanks, P. (1990). Word association norms, mutual infor-

mation, and lexicography. Comput. Linguist., 16 (1), 22–29.

Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Mah-

wah, NJ, US: Lawrence Erlbaum.

Collins, A., & Loftus, E. (1975). A spreading-activation theory of semantic

processing. Psychological Review, 82 (6), 407.

Colombo, L., Pasini, M., & Balota, D. A. (2006). Dissociating the influence

of familiarity and meaningfulness from word frequency in naming and

lexical decision performance. Memory & cognition, 34 (6), 1312.

Columbus, G., Bolger, P., & Baayen, R. H. (2010). Processing Multiword Units:

Degrees of Idiomaticity Seen Through Eye Movement Data. (Paper pre-

sented at the Seventh Conference of the Mental Lexicon. University of

Windsor, Ontario, Canada, June 30th -.July 3rd, 2010.)

Columbus, G., Bolger, P., & Baayen, R. H. (2011). Implications for language

models: fixation and dwell times reveal important predictors for process-

ing multiword units. (Paper presented at the European Conference on

Eye Movement. Marseille, France, August 21st-25th, 2011)

Conklin, K., & Schmitt, N. (2008). Formulaic sequences: Are they processed

more quickly than nonformulaic language by native and nonnative speak-

ers? Applied Linguistics, 29 (1), 72.

Connine, C. M., Mullennix, J., Shernoff, E., & Yelen, J. (1990). Word famil-

iarity and frequency in visual and auditory word recognition. Journal

of Experimental Psychology. Learning, Memory, and Cognition, 16 (6),


Conway, C. M., Bauernschmidt, A., Huang, S., & Pisoni, D. (2010). Implicit

statistical learning in language processing: Word predictability is the

key. Cognition, 114 (3), 356–371.

Cowan, N. (2008). What are the differences between long-term, short-term,

and working memory? Progress in brain research, 169, 323–338.

Criss, A., Aue, W., & Smith, L. (2010). The effects of word frequency and

context variability in cued recall. Journal of Memory and Language.

Crocker, M., Knoeferle, P., & Mayberry, M. (2010). Situated sentence pro-

cessing: The coordinated interplay account and a neurobehavioral model.

Brain and language, 112 (3), 189–201.

Crowe, S. (1998). Decrease in performance on the verbal fluency test as a

function of time: Evaluation in a young healthy sample. Journal of

Clinical and Experimental Neuropsychology, 20 (3), 391–401.

Danks, D. (2003). Equilibria of the rescorla-wagner model. Journal of Math-

ematical Psychology, 47 (2), 109–121.

Deese, J. (1959). On the prediction of occurrence of particular verbal intrusions

in immediate recall. Journal of Experimental Psychology, 58 (1), 17.

DeLong, K., Urbach, T., & Kutas, M. (2005). Probabilistic word pre-activation

during language comprehension inferred from electrical brain activity.

Nature Neuroscience, 8 (8), 1117.

Dennett, D. (1991). Consciousness explained. Boston, MA, USA: Little,

Brown and Co.

Diessel, H. (2007). Frequency effects in language acquisition, language use,

and diachronic change. New Ideas in Psychology, 25 (2), 104–123.

Dilkina, K., McClelland, J. L., & Plaut, D. C. (2010a). Are there mental

lexicons? The role of semantics in lexical decision. Brain Research,

1365, 66–81.

Dilkina, K., McClelland, J. L., & Plaut, D. C. (2010b). Are there mental

lexicons? The role of semantics in lexical decision. Brain Research,

1365, 66–81.

Dilkina, K., McClelland, J. L., & Plaut, D. C. (2010c, December). Are there

mental lexicons? The role of semantics in lexical decision. Brain Re-

search, 1365, 66–81.

Ellis, N. C., & Simpson-Vlach, R. (2009). Formulaic language in native speak-

ers: Triangulating psycholinguistics, corpus linguistics, and education.

Corpus Linguistics and Linguistic Theory, 5 (1), 61–78.

Ellis, W. (1999). A source book of gestalt psychology (Vol. 2). London, UK:

Psychology Press.

Elman, J. (1990). Finding structure in time. Cognitive Science, 14 (2), 211,


Elman, J. (2009). On the meaning of words and dinosaur bones: Lexical

knowledge without a lexicon. Cognitive science, 33, 547–582.

Elman, J. (2011). Lexical knowledge without a lexicon? The Mental Lexicon,

6:1, 1-33.

Engbert, R., Nuthmann, A., Richter, E., & Kliegl, R. (2005). Swift: a dynam-

ical model of saccade generation during reading. Psychological Review,

112 (4), 777.

Erman, B., & Warren, B. (2000). The idiom principle and the open choice

principle. Text - Interdisciplinary Journal for the Study of Discourse,

20 (1), 29–62.

Fano, R. M., & Hawkins, D. (1961). Transmission of information: A statistical

theory of communications. American Journal of Physics, 29, 793.

Fillenbaum, S., Jones, L., & Rapoport, A. (1963). The predictability of words

and their grammatical classes as a function of rate of deletion from a

speech transcript1. Journal of Verbal Learning and Verbal Behavior,

2 (2), 186–194.

Finch, W. H., Chang, M., Davis, A. S., Holden, J. E., Rothlisberg, B. A., &

McIntosh, D. E. (2011). The prediction of intelligence in preschool chil-

dren using alternative models to regression. Behavior Research Methods.

Finn, P. (1977). Word frequency, information theory, and cloze performance:

A transfer feature theory of processing in reading. Reading Research

Quarterly, 508–537.

Fodor, J. (1983). The modularity of mind (Vol. 341). Cambridge, MA., USA,

USA: MIT press.

Forster, K. I. (1979). Levels of processing and the structure of the language

processor. In Sentence processing: Psycholinguistic studies presented to

merrill garrett (pp. 27–85).

Forster, K. I., & Hector, J. (2002). Cascaded versus noncascaded models of

lexical and semantic processing: Theturple effect. Memory & cognition,

30 (7), 1106–1117.

Francis, W., & Kucera, H. (1982). Frequency analysis of english usage. Boston,

MA, USA: Houghton Mifflin Company.

Frank, S. L., & Bod, R. (2011). Insensitivity of the Human Sentence-Processing

System to Hierarchical Structure. Psychological Science, 22 (6), 829 –834.

Frank, S. L., & Vigliocco, G. (in press). Sentence Comprehension as Mental

Simulation: An Information-Theoretic Perspective. Information.

Friedman, L., & Wall, M. (2005). Graphical views of suppression and mul-

ticollinearity in multiple linear regression. The American Statistician,

59 (2), 127–136.

Gagn ́

e, C. L., & Spalding, T. L. (2009). Constituent integration during the

processing of compound words: Does it involve the use of relational

structures? Journal of Memory and Language, 60 (1), 20–35.

Geer, D. (2005). Statistical machine translation gains respect. Computer, 38,


Gernsbacher, M. A. (1984). Resolving 20 years of inconsistent interactions

between lexical familiarity and orthography, concreteness, and polysemy.

Journal of Experimental Psychology: General, 113 (2), 256–281.

Glenberg, A. (1997). What memory is for. Behavioral and brain sciences,

20 (01), 1–19.

Goldberg, A. (2006). Constructions at work : the nature of generalization in

language. Oxford ;;New York: Oxford University Press.

Gregory, M. L., Raymond, W. D., Bell, A., Fosler-Lussier, E., & Jurafsky, D.

(1999). The effects of collocational strength and contextual predictability

in lexical production. In Proceedings of cls35 (Vol. 35, pp. 151–166).

Chicago, IL, USA: Chicago Linguistic Society.

Griffin, Z., & Bock, K. (1998). Constraint, word frequency, and the relationship

between lexical processing levels in spoken word production* 1,* 2,* 3.

Journal of Memory and Language, 38 (3), 313–338.

Hahn, L. W., & Sivley, R. M. (2011). Entropy, semantic relatedness and

proximity. Behavior Research Methods.

Harris, Z. (1951). Methods in structural linguistics. Chicago, IL, USA: Uni-

versity of Chicago Press.

Hay, J., Pelucchi, B., Estes, K., & Saffran, J. (2011). Linking sounds to

meanings: infant statistical learning in a natural language. Cognitive

Psychology, 63 (2), 93–106.

Jackendoff, R. (2002). Foundations of language: Brain, meaning, grammar,

evolution. New York: Oxford University Press.

Jackendoff, R. (2007). A parallel architecture perspective on language pro-

cessing. Brain Research, 1146, 2–22.

Jones, M. N., & Mewhort, D. J. K. (2007). Representing word meaning

and order information in a composite holographic lexicon. Psychological

Review, 114, 1–37.

Juhasz, B. J., & Berkowitz, R. N. (2011). Effects of morphological fami-

lies on English compound word recognition: A multitask investigation.

Language and Cognitive Processes, 26 (4), 653.

Jurafsky, D. (1996). A probabilistic model of lexical and syntactic access and

disambiguation. Cognitive Science, 20 (2), 137–194.

Jurafsky, D. (2003). Probabilistic modeling in psycholinguisitics: Linguistic

comprehension and production. In R. Bod, J. Hay, & S. Jannedy (Eds.),

Probabilistic linguistics. Cambridge, MA., USA: MIT Press. (Series:

Bradford book Bibliography note: Includes bibliographical references (p.

[389]-436) and indexes Series: (Bradford book))

Kamide, Y. (2008). Anticipatory processes in sentence processing. Language

and Linguistics Compass, 2 (4), 647.

Kilgarriff, A. (2005, August). Language is never, ever, ever, random. Corpus

Linguistics and Linguistic Theory, 1 (2), 263–276.

Kilgarriff, A., & Grefenstette, G. (2011). Introduction to the special issue on

the web as corpus. Computational Linguistics, 29 (3), 333–347.

Kirkham, N. Z., Slemmer, J. A., & Johnson, S. P. (2002). Visual statistical

learning in infancy: evidence for a domain general learning mechanism.

Cognition, 83 (2), B35–B42.

Kliegl, R., Nuthmann, A., & Engbert, R. (2006). Tracking the mind during

reading: The influence of past, present, and future words on fixation

durations. Journal of Experimental Psychology: General, 135 (1), 12.

Kliegl, R., Risse, S., & Laubrock, J. (2007). Preview benefit and parafoveal-

on-foveal effects from word n+2. Journal of Experimental Psychology:

Human Perception and Performance, 33 (5), 1250.

Kohonen, T., & Somervuo, P. (1998). Self-organizing maps of symbol strings.

Neurocomputing, 21 (1-3), 19–30.


cera, H., & Francis, W. (1967). Computational analysis of present-day

american english. Dartmouth, NH, USA: Dartmouth Publishing Group.

Kukona, A., Fang, S., Aicher, K., Chen, H., & Magnuson, J. (2011). The time

course of anticipatory constraint integration. Cognition.

Kuperberg, G. (2007). Neural mechanisms of language comprehension: Chal-

lenges to syntax. Brain Research, 1146, 23–49.

Kuperman, V., Bertram, R., & Baayen, R. H. (2008). Morphological dynamics

in compound processing. Language and Cognitive Processes, 23 (7), 1089.

Kuperman, V., Bertram, R., & Baayen, R. H. (2010). Processing trade-offs in

the reading of dutch derived words. Journal of Memory and Language,

62 (2), 83–97.

Kuperman, V., Dambacher, M., Nuthmann, A., & Kliegl, R. (2010). The effect

of word position on eye-movements in sentence and paragraph reading.

Quarterly Journal of Experimental Psychology, 1–20.

Kuperman, V., Schreuder, R., Bertram, R., & Baayen, R. H. (2009). Reading

polymorphemic Dutch compounds: toward a multiple route model of lex-

ical processing. Journal of Experimental Psychology. Human Perception

and Performance, 35 (3), 876–895.

Kutas, M., & Hillyard, S. (1984). Brain potentials during reading reflect word

expectancy and semantic association. Nature, 307 (5947), 161–163.

Kwisthout, J., Wareham, T., & Rooij, I. van. (2011). Bayesian intractability

is not an ailment that approximation can cure. Cognitive Science.

Landauer, T. K., & Dumais, S. T. (1997). A solution to plato’s problem: The

latent semantic analysis theory of acquisition, induction, and represen-

tation of knowledge. Psychological Review, 104, 211–240.

Legge, G., Klitz, T., & Tjan, B. (1997). Mr. chips: an ideal-observer model

of reading. Psychological review, 104 (3), 524.

Lemke, S., Tremblay, A., & Tucker, B. (2009). Function words of lexical

bundles: The relation of frequency and reduction. The Journal of the

Acoustical Society of America, 125, 2656.

Levy, R. (2008). Expectation-based syntactic comprehension. Cognition,

106 (3), 1126–1177.

Levy, R., Bicknell, K., Slattery, T., & Rayner, K. (2009). Eye movement

evidence that readers maintain and act on uncertainty about past lin-

guistic input. Proceedings of the National Academy of Sciences, 106 (50),


Li, P. (2009). Lexical organization and competition in first and second

languages: Computational and neural mechanisms. Cognitive science,

33 (4), 629–664.

Loewenstein, M., Tabor, W., & Tanenhaus, M. K. (1999). Dynamical models

of sentence processing - a strongly interactive model of natural language

interpretation. Cognitive Science, 23, 491–515.

Lund, K., & Burgess, C. (1996). Producing high-dimensional semantic spacesfrom lexical co-occurrence. Behavior Research Methods, Instrumenta-

tion, and Computers, 28, 203–208.

Macdonald, M. C. (1993). The interaction of lexical and syntactic ambiguity.

Journal of Memory and Language, 32 (5), 692–715.

Matthews, D., & Bannard, C. (2010). Children’s production of unfamiliar

word sequences is predicted by positional variability and latent classes

in a large sample of Child-Directed speech. Cognitive Science, 34 (3),


McDonald, S., & Shillcock, R. (2001). Rethinking the word frequency effect:

The neglected role of distributional information in lexical processing.

Language and Speech, 44 (3), 295.

McDonald, S., & Shillcock, R. (2003). Eye movements reveal the on-line com-

putation of lexical probabilities during reading. Psychological Science,

14 (6), 648.

McEvoy, C., Nelson, D. L., & Komatsu, T. (1999). What is the connection

between true and false memories? the differential roles of interitem asso-

ciations in recall and recognition. Journal of Experimental Psychology:

Learning, Memory, and Cognition, 25 (5), 1177.

McKenna, M. C. (1986). Cloze procedure as a memory-search process. Journal

of Educational Psychology, 78, 433 - 440.

Mirman, D., Graf Estes, K., & Magnuson, J. (2010). Computational modeling

of statistical learning: Effects of transitional probability versus frequency

and links to word learning. Infancy, 15 (5), 471–486.

Misyak, J., Christiansen, M., & Tomblin, B. J. (2010). Sequential expectations:

The role of prediction-based learning in language. Topics in Cognitive

Science, 2 (1), 138–153.

Mitchell, D., Cuetos, F., Corley, M., & Brysbaert, M. (1995). Exposure-

based models of human parsing: Evidence for the use of coarse-grained

(nonlexical) statistical records. Journal of Psycholinguistic Research,

24 (6), 469–488.

Moyer, R. S., & Dumais, S. T. (1978). Mental comparison. The Psychology of

Learning & Motivation: Advances in Research & Theory, 12, 117.

Nelson, D. L., & McEvoy, C. (2007). Entangled associative structures and

context. In Proceedings of the aaai spring symposium on quantum inter-

action. Palo Alto, CA, USA: AAAI Press.

Nelson, D. L., McEvoy, C., & Dennis, S. (2000). What is free association and

what does it measure? Memory & Cognition, 28 (6), 887–899.

Nelson, D. L., McEvoy, C. L., & Schreiber, T. A. (1998). The university

of south florida word association, rhyme, and word fragment norms.


Nelson, D. L., McKinney, V., Gee, N., & Janczura, G. (1998). Interpreting

the influence of implicitly activated memories on recall and recognition.

Psychological Review, 105 (2), 299.

Newell, A. (1990). Unified theories of cognition. Cambridge, MA., USA:

Harvard University Press.

Newmeyer, F. (1996). Generative linguistics : a historical perspective. London

;;New York: Routledge.

Norris, D., & Kinoshita, S. (2008). Perception as evidence accumulation and

bayesian inference: Insights from masked priming. Journal of Experi-

mental Psychology: General, 137 (3), 434–455.

Osgood, C. E., Sebeok, T. A., Gardner, J., Carroll, J., Newmark, L., Ervin,

S., et al. (1954). Psycholinguistics: a survey of theory and research

problems. [References]. Journal of Abnormal and Social Psychology.

Owens, M., O’Boyle, P., McMahon, J., Ming, J., & Smith, F. (1997). A

comparison of human and statistical language model performance using

missing-word tests. Language and Speech, 40 (4), 377.

Perfetti, C. A. (1992). The representation problem in reading acquisition.

Mahwah, NJ, US: Lawrence Erlbaum Associates, Inc.

Perfetti, C. A., Hart, L., Verhoeven, L., Elbro, C., & Reitsma, P. (2002). The

lexical quality hypothesis. Precursors of functional literacy, 11, 67–86.

Piantadosi, S. T., Tily, H., & Gibson, E. (2011, Mar). Word lengths are

optimized for efficient communication. Proc Natl Acad Sci U S A, 108 (9),


Pickering, M., & Garrod, S. (2007). Do people use language production to

make predictions during comprehension? Trends in Cognitive Sciences,

11 (3), 105–110.

Pinheiro, J. C., & Bates, D. M. (2009). Mixed-effects models in S and S-PLUS.

New York, NY, USA: Springer Verlag.

Pinker, S., & Ullman, M. T. (2002, November). The past and future of the

past tense. Trends in Cognitive Sciences, 6 (11), 456–463.

Pluymaekers, M., Ernestus, M., & Baayen, R. (2005b). Articulatory plan-

ning is continuous and sensitive to informational redundancy. Phonetica,

62 (2-4), 146–159.

Pluymaekers, M., Ernestus, M., & Baayen, R. H. (2005a). Articulatory plan-

ning is continuous and sensitive to informational redundancy. Phonetica,

62 (2-4), 146–159.

Prior, A., & Bentin, S. (2003). Incidental formation of episodic associations:

The importance of sentential context. Memory & Cognition, 31 (2), 306–


Prior, A., & Bentin, S. (2008). Word associations are formed incidentally

during sentential semantic integration. Acta Psychologica, 127 (1), 57–


R Development Core Team. (2009). R: A language and environment for sta-

tistical computing. Vienna, Austria: R Foundation for Statistical Com-


Raffone, A., & Leeuwen, C. van. (2003). Dynamic synchronization and chaos

in an associative neural network with multiple active memories. Chaos:

An Interdisciplinary Journal of Nonlinear Science, 13, 1090.

Rayner, K. (2009). Eye Movements in Reading: Models and Data. Journal of

eye movement research, 2 (5), 1–10.

Rayner, K., Inhoff, A. W., Morrison, R. E., Slowiaczek, M. L., & Bertera, J. H.

(1981). Masking of foveal and parafoveal vision during eye fixations in

reading. Journal of Experimental Psychology: Human Perception and

Performance, 7 (1), 167–179.

Rayner, K., & Pollatsek, A. (1989). The psychology of reading. Mahwah, NJ,

US: Lawrence Erlbaum.

Recchia, G., & Jones, M. (2009). More data trumps smarter algorithms:

comparing pointwise mutual information with latent semantic analysis.

Behavior research methods, 41 (3), 647–656.

Remillard, G. (2010). Implicit learning of fifth- and sixth-order sequential

probabilities. Memory & Cognition, 38 (7), 905–915.

Roberts, M. A. J., & Chater, N. (2008). Using statistical smoothing to estimate

the psycholinguistic acceptability of novel phrases. Behavior Research

Methods, 40 (1), 84–93.

Rodriguez, P. (2003). Comparing simple recurrent networks and n-Grams in

a large corpus. Applied Intelligence, 19 (1), 39–50.

Roediger, H., & McDermott, K. (1995). Creating false memories: Remem-

bering words not presented in lists. Journal of Experimental Psychology:

Learning, Memory, and Cognition, 21 (4), 803.

Rosen, V., & Engle, R. (1997). The role of working memory capacity in

retrieval. Journal of Experimental Psychology: General, 126 (3), 211.

Ruff, R., Light, R., Parker, S., & Levin, H. (1997). The psychological construct

of word fluency. Brain and Language, 57 (3), 394–405.

Saffran, J. R., Aslin, R. N., & Newport, E. L. (1996). Statistical learning by

8-month-old infants. Science, 274, 1926 – 1928.

Schwanenflugel, P., & LaCount, K. (1988). Semantic relatedness and the scope

of facilitation for upcoming words in sentences. Journal of Experimental

Psychology: Learning, Memory, and Cognition, 14 (2), 344.

Seidenberg, M., & McClelland, J. (1989). A distributed, developmental model

of word recognition and naming. Psychological Review, 96 (4), 523.

Seidenberg, M. S., & McClelland, J. L. (1989). A distributed, developmental

model of word recognition and naming. Psychological Review, 96 (4),


Shannon, C. E. (1948). A mathematical theory of communication. Bell System

Technical Journal, 27, 379–423.

Shannon, C. E. (1951). Prediction and entropy of printed english. Bell System

Technical Journal, 30 (1), 50–64.

Shaoul, C., & Westbury, C.


HiDEx: the high dimen-

sional explorer. Edmonton, AB. (Published: Downloaded from ̃westburylab/downloads.html)

Shaoul, C., & Westbury, C. (2011). Formulaic sequences: Do they exist and do

they matter? Methodological and Analytic Frontiers in Lexical Research

(Part II). Special Issue of The Mental Lexicon, 6 (1), 171-196.

Shrout, P., & Fleiss, J. (1979). Intraclass correlations: uses in assessing rater

reliability. Psychological bulletin, 86 (2), 420.

Sibley, D. E., Kello, C. T., Plaut, D. C., & Elman, J. L. (2008). Large-Scale

modeling of wordform learning and representation. Cognitive Science,

32 (4), 741–754.

Siyanova-Chanturia, A., Conklin, K., & Heuven, W. van. (2011). Seeing a

Phrase “Time and Again” Matters: The Role of Phrasal Frequency in the

Processing of Multiword Sequences. Journal of Experimental Psychology:

Learning Memory and Cognition, 37 (3), 776–784.

Smith, N., & Levy, R. (2011). Cloze but no cigar: The complex relationship

between cloze, corpus, and subjective probabilities in language process-

ing. In Proceedings of the 33rd annual meeting of the cognitive science


Speelman, C. (2005). Beyond the learning curve : skill acquisition and the

construction of mind. Oxford: Oxford University Press.

Squire, L., & Kandel, E. (2000). Memory: From mind to molecules. New

York, NY, USA: Holt.

Stanovich, K. (2000). Progress in understanding reading: Scientific founda-

tions and new frontiers. New York, NY, USA: The Guilford Press.

Strobl, C., Boulesteix, A., Kneib, T., Augustin, T., & Zeileis, A. (2008). Con-

ditional variable importance for random forests. BMC Bioinformatics,

9 (1), 307.

Strobl, C., Malley, J., & Tutz, G. (2009). An introduction to recursive parti-

tioning: Rationale, application, and characteristics of classification and

regression trees, bagging, and random forests. Psychological Methods,

14 (4), 323–348.

Taft, M. (1979). Recognition of affixed words and the word frequency effect.

Memory & Cognition, 7 (4), 263–272.

Taylor, W. (1953). ” cloze procedure”: a new tool for measuring readability.

Journalism quarterly.

Tenenbaum, J., Kemp, C., Griffiths, T., & Goodman, N. (2011). How to grow

a mind: Statistics, structure, and abstraction. science, 331 (6022), 1279.

Thompson, G. L., & Desrochers, A. (2009). Corroborating biased indicators:

Global and local agreement among objective and subjective estimates of

printed word frequency. Behavior Research Methods, 41 (2), 452–471.

Toglia, M. P. (2009). Withstanding the test of time: The 1978 semantic word

norms. Behavior Research Methods, 41 (2), 531–533.

Tomasello, M. (2003). Constructing a language : a usage-based theory of

language acquisition. Cambridge Mass.: Harvard University Press.

Tremblay, A., & Baayen, R. H. (2010). Holistic processing of regular four-

word sequences: A behavioral and erp study of the effects of structure,

frequency, and probability on immediate free recall. Perspectives on

formulaic language: Acquisition and communication, 151–173.

Tremblay, A., Derwing, B., Libben, G., & Westbury, C. (2011). Process-

ing advantages of lexical bundles: Evidence from self-paced reading and

sentence recall tasks. Language Learning, 61 (2), 569–613.

Tremblay, A., & Tucker, B. V. (2011). The effects of N-gram probabilistic

measures on the recognition and production of four-word sequences. The

Mental Lexicon, 6 (2), 302–324.

Troyer, A. (2000). Normative data for clustering and switching on verbal

fluency tasks. Journal of Clinical and Experimental Neuropsychology,

22, 370–378.

Tulving, E. (1985). How many memory systems are there?. American Psy-

chologist, 40 (4), 385.

Ullman, M. T. (2001). The Declarative-Procedural model of lexicon and

grammar. Journal of Psycholinguistic Research, 30 (1), 37–69.

Ullman, M. T., Miranda, R., & Travers, M. (2008). Sex differences in the

neurocognition of language. In J. B. Becker, K. J. Berkley, & N. Gearyet

(Eds.), Sex on the brain: From genes to behavior (p. 291-309). NY, NY,

USA: Oxford University Press.

Unsworth, N., Spillers, G., & Brewer, G. (2010). Variation in verbal fluency: A

latent variable analysis of clustering, switching, and overall performance.

The Quarterly Journal of Experimental Psychology, 64 (3), 447–466.

Van Berkum, J. (2008). Understanding sentences in context. Current Direc-

tions in Psychological Science, 17 (6), 376.

Vitu, F., & McConkie, G. W. (2000). Regressive saccades and word perception

in adult reading. Reading as a perceptual process, 301–326.

Westbury, C.


ACTUATE: Assessing Cases, The Uni-

versity of Alberta Testing Environment.

(Downloaded from ̃westburylab/)

Willems, R., & Hagoort, P. (2007). Neural evidence for the interplay between

language, gesture, and action: A review. Brain and Language, 101 (3),


Wood, S. (2006). Generalized additive models: an introduction with r (Vol. 66).

New York, NY, USA: CRC Press.

Wray, A. (1998). Protolanguage as a holistic system for social interaction.

Language & Communication, 18 (1), 47–67.

Yap, M. J., & Balota, D. A. (2009). Visual word recognition of multisyllabic

words. Journal of Memory and Language, 60 (4), 502–529.

Zwaan, R. (2008). Experiential traces and mental simulations in language

comprehension. Symbols, embodiment, and meaning, 165–180.


Repository Staff Only: item control page