Cogprints

An introduction to the main principles of emulation: motor control, imagery, and perception

Grush, Rick (2002) An introduction to the main principles of emulation: motor control, imagery, and perception. [Departmental Technical Report] (Unpublished)

Full text available as:

[img]
Preview
 PDF
283Kb
[img] HTML
138Kb

Abstract

Abstract: A framework for understanding representational capacities of nervous systems is developed and explored. The framework is based upon constructs from control theory and signal processing, most prominently forward models (aka emulators) and Kalman filters. The basic idea is that the brain constructs models or emulators for entities with which it interacts, such as the body and environment. During normal sensorimotor behavior these models are run in parallel with the modeled system in order to enhance, supplement and process information from the sensors. These models can also be taken off-line in order to produce imagery, select among possible actions, and solve problems. After introducing the central concepts, the framework is developed in the contexts of motor control, imagery, and perception. Other potential applications, including cognition and language, are briefly explored.

Item Type:Departmental Technical Report
Keywords:imagery, perception, motor control, representation, forward models, emulators, Kalman filters
Subjects:Psychology > Cognitive Psychology
Neuroscience > Computational Neuroscience
Psychology > Perceptual Cognitive Psychology
ID Code:2073
Deposited By: Grush, Rick
Deposited On:12 Feb 2002
Last Modified:11 Mar 2011 08:54

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in cogprints you will be forwarded to the paracite service. Poorly formated references will probably not work.

References:

Alain, C., Arnott, S. R., Hevenor, S., Graham, S., Grady, C. L. (2001). "What" and "where" in the human auditory system. Proceedings of the National Academy of Science USA 98(21):12301-6.

Barsalou, L. (1999). Perceptual Symbol Systems. Behavioral and Brain Sciences 22(4):577-609.

Barsalou, L., Solomon, K. O., & Wu, L. (1999) Perceptual simulation in conceptual tasks. In M. K. Hiraga, C. Sinha, & S. Wilcox (Eds.), Cultural, Typological, and Psychological Perspectives in Cognitive Linguistics: The Proceedings of the 4th Conference of the International Cognitive Linguistics Association, 3, Amsterdam: John Benjamins.

Behrmann, Marlene (2000). The mind’s eye mapped onto the brain’s matter. Trends in Psychological Science 9(2):50-54.

Blakemore, Sarah J., Susan J. Goodbody, and Daniel M. Wolpert (1998). Predicting the Consequences of Our Own Actions: The Role of Sensorimotor Context Estimation. The Journal of Neuroscience 18(18):7511–7518.

Brooks, R. A. (1986). A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation, 2:14-23.

Brooks, R. A. (1991). Intelligence without representation. Artificial Intelligence 47:139-160.

Chen, W., Kato, T., Zhu, X. H., Ogawa, S., Tank, D. W., Ugurbil, K. (1998). Human primary visual cortex and lateral geniculate nucleus activation during visual imagery. Neuroreport 9(16): 3669-74.

Craik, Kenneth (1943) The Nature of Explanation. Cambridge: Cambridge University Press.

Damasio, Antonio (1994). Descartes' error : emotion, reason, and the human brain. New York: G.P. Putnam.

Decety J, and Jeannerod M (1996). Mentally simulated movements in virtual

reality. Does Fitts’ law hold in motor imagery? Behavioral Brain Research 72:127-134.

Deiber, Marie-Pierre, Vicente Ibanez, Manabu Honda, Norihiro Sadato,

Ramesh Raman, and Mark Hallett (1998). Cerebral Processes Related to Visuomotor Imagery and Generation of Simple Finger Movements Studied with Positron Emission Tomography. Neuroimage 7:73–85.

Desmurget, Michel, and Scott Grafton (2000). Forward modeling allows

feedback control for fast reaching movements. Trends in Cognitive Sciences 4(11):423-431.

Farah MJ, Hammond KM, Levine DN, Calvanio R. (1988). Visual and spatial mental imagery: dissociable systems of representation. Cognitive Psychology 20(4):439-62.

Farah, M. J., M. J. Soso, et al. (1992). Visual angle of the mind's eye before and after unilateral occipital lobectomy. Journal of Experimental Psychology: Human Perception and Performance 18(1): 241-6.

Fauconnier, Gilles (1985). Mental spaces: aspects of meaning construction in natural language. Cambridge, MA: MIT Press.

Flavell, J.H. (1999). Cognitive development: children's knowledge about the mind. Annual Review of Psychology 50: 21-45.

Gelb, A. (1974). Applied Optimal Estimation. Cambridge, MA: MIT Press.

Gordon, Robert M. (1986). Folk psychology as simulation. Mind and Language 1:158-171.

Grush Rick (1995). Emulation and Cognition. PhD Dissertation, UC San Diego. UMI.

Grush, Rick (forthcoming). The Machinery of Mindedness.

Ito, Masao (1984). The cerebellum and neural control. New York: Raven Press.

Jeannerod Marc (1995). Mental imagery in the motor context. Neuropsychologia 33:1419-1432.

Jeannerod, Marc (2001). Neural Simulation of Action: A Unifying Mechanism for Motor Cognition. NeuroImage 14, S103–S109.

Jeannerod, Marc, and Victor Frak (1999). Mental imaging of motor activity in humans. Current Opinion in Neurobiology 9:735–739

Johnson, Scott H. (2000). Thinking ahead: the case for motor imagery in

prospective judgements of prehension. Cognition 74 (2000) 33-70.

Kalman, R.E. (1960). A New Approach to Linear Filtering and Prediction Problems. Journal of Basic Engineering, 82(d):35-45.

Kalman, R., and Bucy, R.S. (1961) New results in linear filtering and prediction theory. Journal of Basic Engineering 83(d):95-108.

Kawato, Mitsuo (1999). Internal models for motor control and trajectory planning. Current Opinion in Neurobiology 9:718–727.

Kosslyn, S. M., Alpert, N. M., Thompson, W. L., Maljkovic, V., Weise, S. B., Chabris, C. F., Hamilton, S. E., Rauch, S. L., & Buonanno, F. S. (1993). Visual-mental imagery activates topographically-organized visual cortex: PET investigations. Journal of Cognitive Neuroscience, 5, 263–287.

Kosslyn, S. M., Thompson, W. L., Kim, I. J., & Alpert, N. M. (1995). Topographical representations of mental images in primary visual cortex. Nature, 378, 496–498.

Krakauer, John W., Maria-Felice Ghilardi, and Claude Ghez (1999). Independent learning of internal models for kinematic and dynamic control of reaching. Nature neuroscience 2(11):1026-1031.

Lamm, Claus, Christian Windischberger, Ulrich Leodolter, Ewald Moser, and Herbert Bauer (2001). Evidence for Premotor Cortex Activity during Dynamic Visuospatial Imagery from Single-Trial Functional Magnetic Resonance Imaging and Event-Related Slow Cortical Potentials. NeuroImage 14, 268–283.

Langacker, Ronald W. (1987). Foundations of Cognitive Grammar, Volume I. Stanford: Stanford University Press.

Langacker, Ronald W. (1990). Concept, image and symbol: the cognitive basis of grammar. Berlin; New York: Mouton de Gruyter.

Langacker, Ronald W. (1990). Foundations of Cognitive Grammar, Volume II. Stanford: Stanford University Press.

Langacker, Ronald W. (1999). Grammar and conceptualization. Berlin; New York: Mouton de Gruyter.

Llinas, R., and Pare, D. (1991). On dreaming and wakefulness. Neuroscience 44:3:521-535.

Mel, B. W. (1986). A connectionist learning model for 3-d mental rotation, zoom, and pan. In Proceedings of Eighth Annual Conference of the Cognitive Science Society, 562–571.

Mel, B. W. (1988). MURPHY: A robot that learns by doing. In Neural information processing systems, 544-553. New York: American Institute of Physics.

Pylyshyn, Z.W. (2001). Visual indexes, preconceptual objects, and situated vision. Cognition 80(1-2):127-58.

Redon, Christine, Hay, Laurette, and Velay, Jean-Luc (1991) Proprioceptive control of goal-directed movements in man, studied by means of vibratory muscle tendon stimulation. Journal of Motor Behavior 23(2):101-108.

Richter, W., Somorjai, R., Summers, R. , Jarmasz, M., Menon, R. S., Gati, J. S., Georgopoulos, A. P., Tegeler, C., Ugurbil, K., Kim, S. G. (2000). Motor area activity during mental rotation studied by time-resolved single-trial fMRI. Journal of Cognitive Neuroscience 12(2): 310-20.

Rao, Rajesh P. N., and Dana H. Ballard (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience 2(1):79-87.

Schwartz, Daniel L. (1999). Physical Imagery: Kinematic versus Dynamic Models. Cognitive Psychology 38:433–464.

Stein, Lynn Andrea (1994). Imagination and situated cognition. Journal of Experimental and Theoretical Artificial Intelligence 6:393-407.

Talmy, Leonard (2000). Toward a cognitive semantics (2 volumes). Cambridge, MA: MIT Press.

Ungerleider, L. G., Haxby, J. V. (1994). 'What' and 'where' in the human brain. Current Opinion in Neurobiology 4(2): 157-65.

van der Meulen, J.H.P., Gooskens, R.H.J.M., Dennier van der Gon, J.J., Gielen, C.C.A.M., and Wilhelm, K. (1990) Mechanisms underlying accuracy in fast goal-directed arm movements in man. Journal of Motor Behavior 22(1):67-84.

van Hoek, Karen (1995). Conceptual reference points: A cognitive grammar account of pronominal anaphora constraints. Language 71(2):310-340.

van Hoek, Karen (1997). Anaphora and conceptual structure. Chicago: University of Chicago Press.

Van Pabst, J.V.L., & Krekel, P.F.C. (1993). Multi Sensor Data Fusion of Points, Line Segments and Surface Segments in 3D Space. 7th International Conference on Image Analysis and Processing. (pp.174-182). Capitolo, Monopoli, Italy: World Scientific, Singapore.

Wellman, Henry M. (1990). The child's theory of mind. Cambridge, MA: MIT Press.

Wexler, M., Kosslyn, S.M., & Berthoz, A. (1998). Motor processes in mental rotation. Cognition 68:77-94.

Wolpert, D.M., Ghahramani, Z. and Jordan, M.I. (1995) An internal

model for sensorimotor integration. Science 269:1880–1882.

Wolpert, Daniel M., Zoubin Ghahramani and J. Randall Flanagan (2001). Perspectives and problems in motor learning. Trends in Cognitive Sciences 5(11):487-494.

Yantis, S. (1992). Multielement visual tracking: attention and perceptual organization. Cognitive Psychology 24(3): 295-340.

Metadata

Repository Staff Only: item control page

Cogprints is powered by EPrints 3 which is developed by the School of Electronics and Computer Science at the University of Southampton. More information and software credits.