Cogprints

Representation, space and Hollywood Squares: Looking at things that aren't there anymore

Richardson, Daniel and Spivey, Michael (2000) Representation, space and Hollywood Squares: Looking at things that aren't there anymore. [Journal (Paginated)]

Full text available as:

[img] PDF
2433Kb

Abstract

It has been argued that the human cognitive system is capable of using spatial indexes or oculomotor coordinates to relieve working memory load (Ballard, Hayhoe, Pook & Rao, 1997) track multiple moving items through occlusion (Scholl & Pylyshyn, 1999) or link incompatible cognitive and sensorimotor codes (Bridgeman and Huemer, 1998). Here we examine the use of such spatial information in memory for semantic information. Previous research has often focused on the role of task demands and the level of automaticity in the encoding of spatial location in memory tasks. We present five experiments where location is irrelevant to the task, and participants' encoding of spatial information is measured implicitly by their looking behavior during recall. In a paradigm developed from Spivey and Geng (submitted), participants were presented with pieces of auditory, semantic information as part of an event occurring in one of four regions of a computer screen. In front of a blank grid, they were asked a question relating to one of those facts. Under certain conditions it was found that during the question period participants made significantly more saccades to the empty region of space where the semantic information had been previously presented. Our findings are discussed in relation to previous research on memory and spatial location, the dorsal and ventral streams of the visual system, and the notion of a cognitive-perceptual system using spatial indexes to exploit the stability of the external world.

Item Type:Journal (Paginated)
Keywords:Memory; Eye movements; Visual attention; Spatial representation; Embodiment
Subjects:Neuroscience > Behavioral Neuroscience
Psychology > Cognitive Psychology
Psychology > Perceptual Cognitive Psychology
ID Code:904
Deposited By: Richardson, Daniel
Deposited On:28 Jul 2000
Last Modified:11 Mar 2011 08:54

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in cogprints you will be forwarded to the paracite service. Poorly formated references will probably not work.

Allopenna, P. D., Magnuson, J. S. & Tanenhaus, M. K., (1998). Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. Journal of Memory and Language. 38(4), 419-439

Althoff, R. R., & Cohen, N.J., (1999) Eye-movement-based memory effect: A reprocessing effect in face perception. Journal of Experimental Psychology: Learning, Memory, and Cognition. 25(4), 997-1010.

Andrade, J. & Meudell, P. (1993). Short report: Is spatial information encoded automatically in memory? The Quarterly Journal of Experimental Psychology, 46A (2), 365-375.

Ballard, D.H., Hayhoe, M.M. & Pelz, J.B. (1995). Memory representations in natural tasks. Journal of Cognitive Neuroscience, 7(1), 66-80.

Ballard, D.H., Hayhoe, M.M., Pook, P.K. & Rao, R.P.N. (1997). Deictic codes for the embodiment of cognition. Behavioral and Brain Sciences, 20(4), 723-767.

Bjork, R. A. & Richardson, K., A. (1989). On the puzzling relationship between environmental context and human memory.. In Izawa, Chizuko (Ed), Current issues in cognitive processes: The Tulane Flowerree Symposium on Cognition. Hillsdale, NJ, USA: Lawrence Erlbaum Associates, Inc.

Blackmore, S.J., Brelstaff, G., Nelson, K. & Troscianko, T. (1995). Is the richness of our visual world an illusion? Transsaccadic memory for complex scenes Perception, 24, 1075-1081.

Bradley, M.M., Cuthbert, B.N. & Lang, P.J. (1988). Perceptually driven movements as contextual retrieval cues. Bulletin of the Psychonomic Society, 26(6), 541-53.

Bridgeman, B. & Huemer, V. (1998). A spatially orientated decision does not induce consciousness in a motor task. Consciousness and Cognition, 7, 454-464.

Bridgeman, B. (1992). Conscious Vs unconscious processes. Theory & Psychology, 2(1), 73-88.

Bridgeman, B., Peery, S. & Anand, S. (1997). Interaction of cognitive and sensorimotor maps of visual space. Perception and Psychophysics, 59(3), 456-469.

Bridgeman, B.C., Van der Heijden, A.H.C. & Velichkovsky, B.M. (1994). A theory of visual stability across saccadic eye movements. Behavioral and Brain Sciences, 17, 247-292.

Brouwer, R.T.F. & Van der Heijden, A.H.C. (1997). Identity and position: dependence originates from independence. Acta Psychologica, 95, 215-237.

Chun, M.M. & Jiang, Y. (1998). Contextual cueing: implicit learning and memory of visual context guides spatial attention. Cognitive Psychology, 36, 28-71.

Cohen, J.D., MacWhinney, B., Flatt, M. & Provost, J. (1993). Psyscope: a new graphic interactive environment for designing psychology experiments. Behavioral Research Methods, Instruments, and Computers, 25(2), 257-271.

Cohen, N.J., Ryan, J. & Althoff, R.R. (1999). The eye movement-based relational manipulation effect: Evidence for detailed representations of the world. Paper presented at the Tenth European Conference on Eye Movements, Utretch University.

Colby, C.L., Goldberg,, M.E., (1999). Space and attention in parietal cortex. Annual Review of Neuroscience. 22, 319-349.

Corbetta, M., Akbudak, E., Conturo, T. E., Snyder, A. Z., Ollinger, J. M., Drury, H. A., Linenweber, M. R., Petersen, S. E., Raichle, M. E., Van Essen, D. C., & Shulman, G. L. (1998). A common network of functional areas for attention and eye movements. Neuron, 21, 761-773.

Deubel, H., Schneider, W.X. & Paprotta, I. (1998). Selective dorsal and ventral processing: evidence for a common attentional mechanism in reaching and perception. Visual Cognition, 5 (1/2), 81-107.

Dijkerman, H.C., Milner, A.D. & Carey, D.P. (1998). Grasping spatial relationships: failure to demonstrate allocentric visual coding in a patient with visual form agnosia. Consciousness and Cognition, 7, 424-437.

Fendrich, D.W. (1998). Recognition benefits from the reinstatement of a spatial representation of motoric processing. Psychological Research, 61, 125-134.

Findlay , J.M.& Walker, R., (1999). A framework for saccadic eye movement control based on parallel processing and competitive inhibition. Behavioral and Brain Sciences, 22(4), 661-721.

Glenberg, A.M., Schroeder, J.L. & Robertson, D.A. (1998). Averting the gaze disengages the environment and facilitates remembering. Memory and Cognition, 26(4), 651-658.

Gnadt, J.W., Bracewell, R.M. & Andersen, R.A. (1991). Sensorimotor transformation during eye movements to remembered visual targets. Vision Research, 31(4), 693-715.

Godden, D. R. & Baddeley, A. D. (1975). Context-dependent memory in two natural environments: On land and underwater. British Journal of Psychology, 66(3), 325-331.

Goodale, M.A. & Humphrey, G.K. (1998). The objects of action and perception. Cognition, 67(1-2), 181-2.

Goodale, M.A. & Milner, A.D. (1992). Separate visual pathways for perception and action. Trends in Neuroscience, 15(1), 20-25.

Hasher, L. & Zacks, R.T. (1979). Automatic and effortful processes in memory. Journal of Experimental Psychology: General, 108, 356-388.

Hayhoe, M.M., Bensinger, D.G. & Ballard, D.H. (1998). Task constraints in visual working memory. Vision Research, 38(1), 125-137.

Hebb, D.O. (1968). Concerning imagery .Psychological Review, 75, 466-477.

Hommel, B (submitted) Automatic integration of spatial information.

Hommel, B., & Knuf, L. (in press). Action related determinants of spatial coding in perception and memory. In C. Freksa, C. Habel, & K. F. Wender (Eds.), Spatial cognition II (pp. ). Berlin: Springer.

Howard Jr., J.H., Mutter, S.H. & Howard, D.V. (1992). Serial pattern learning by event observation. Journal of Experimental Psychology: Learning Memory and Cognition, 18(5), 1029-1039.

Kennedy, A. & Murray , W.S. (1987) Spatial coordinates and reading: comments on Monk. The Quarterly Journal of Experimental Psychology 39A, 649-656.

Keysar, B., Barr, D.J., Balin, J.A. & Paek, T.S. (1998). Definite reference and mutual knowledge: Process models of common ground in comprehension. Journal of Memory and Language, 39(1), 1-20.

Lachter, J., Hayhoe, M. (1995). Capacity limitations in memory for visual locations. Perception. 24(12), 1427-1441

Levin, D.T. & Simons, D.J. (1997). Failure to detect changes to attended objects in motion pictures. Psychonomic Bulletin & Review, 4(4), 501-506.

Logan, G.D. (1994). Spatial attention and the apprehension of spatial relations. Journal of Experimental Psychology: Human Perception and Performance, 20(5), 1015-1063.

Mayr, U. (1996). Spatial attention and implicit sequence learning: evidence for independent learning of spatial and non spatial sequences. Journal of Experimental Psychology: Learning Memory and Cognition, 22(2), 350-364.

Milner, A.D. & Goodale, M.A. (1995). The visual brain in action. Oxford, UK: Oxford Univ. Press.

Mishkin, M., Ungerleider, L.G. & Macko, K.A. (1983). Object vision and spatial vision: two cortical pathways. Trends in Neuroscience, 6, 414-417.

Naveh-Benjamin, M. (1988). Recognition memory of spatial location information: another failure to support automaticity. Memory and Cognition, 16(5), 437-445.

O’Regan, J.K. (1992). Solving the ‘real’ mysteries of visual perception: The world as an outside memory. Canadian Journal of Psychology, 46, 461-488.

O’Regan, J.K., Rensink, R.A. & Clark, J.J. (1999). Change-blindness as a result of "mudsplashes." Nature, 398(6722), 34.

Pezdek, K., Roman, Z. & Sobolik, K.G. (1986). Spatial memory for objects and words. Journal of Experimental Psychology: Learning Memory and Cognition, 12(4), 530-537.

Pollatsek, A., Rayner, K. & Henderson, J.M. (1990). Role of spatial location in integration of pictorial information. Journal of Experimental Psychology: Human Perception and Performance, 16(1), 199-210.

Pulvermüller, F. (1999). Words in the brain's language. Behavioral and Brain Sciences, 22, 253-279.

Pylyshyn, Z.W. (1989). The role of location indexes in spatial perception: a sketch of the FINST spatial index model. Cognition, 32, 65-97.

Pylyshyn, Z.W. (1994). Some primitive mechanisms of spatial attention .Cognition, 50, 363-384.

Rossetti, Y. (1998). Implicit short-lived motor representations of space in brain damaged and healthy patients. Consciousness and Cognition, 7, 520-558.

Ruchkin, D.S., Johnson, R. Jr., Grafman, J., Canoune, H. & Ritter, W. (1997). Multiple visuospatial working memory buffers: evidence from spatiotemporal patterns of brain activity. Neuropsychologia, 35(2), 195-209.

Scholl, B.J. & Pylyshyn, Z.W. (1999). Tracking multiple items through occlusion:

clues to visual objecthood. Cognitive Psychology, 38, 259-290.

Sinclair, G.P., Healy, A.F. & Bourne Jr., L.E. (1997). The acquisition and long term retention of temporal, spatial and item information. Journal of Memory and Language, 36, 530-549.

Smith, E.E., Jonides, J.M., Koeppe, R.A., Awh, E., Schumacher, E.H. & Minoshima, S. (1995). Spatial versus Object Working Memory: PET investigations Journal of Cognitive Neuroscience, 7(3), 337-356.

Spivey, M.J. & Geng, J. (submitted). Perceptual-motor mechanisms in visual memory:

saccades to objects in memory.

Spivey, M.J. & Marian, V. (1999). Cross talk between native and second languages: Partial activation of an irrelevant lexicon. Psychological Science, 10(3), 281-284.

Spivey, M.J., Tyler, M.J., Richardson, D.C., Young, E. (2000). Eye movements during comprehension of spoken scene descriptions. Manuscript submitted for publication.

Tanenhaus, M.K., Spivey-Knowlton, M., Eberhard, K. & Sedivy, J. (1995). Integration of visual and linguistic information during spoken language comprehension. Science, 268, 1632-1634.

Van der Heijden, A.H.C. (1993). The role of position in object selection in vision. Psychological Research, 65, 44-58.

Van der Heijden, A.H.C. (1997). Two stages in visual information processing and visual perception? Visual Cognition, 3(4), 325-361.

Winograd, E. & Church, V. (1988). Role of spatial location in learning face-name associations. Memory and Cognition, 16(1), 7-Jan.

Zimmer, H.D. (1998). Spatial information with pictures and words in visual short-term memory. Psychological Research, 61, 277-284.

Metadata

Repository Staff Only: item control page

Cogprints is powered by EPrints 3 which is developed by the School of Electronics and Computer Science at the University of Southampton. More information and software credits.