Cogprints

Connecting Visual and Verbal Space: Preliminary Considerations Concerning the Concept 'Mental Image'

Schirra, Dr. Joerg R.J. (1993) Connecting Visual and Verbal Space: Preliminary Considerations Concerning the Concept 'Mental Image'. [Conference Paper]

Full text available as:

[img] PDF
542b

Abstract

AI research concerning the connection between seeing and speaking mainly employs what is called reference semantics. Within this framework, the notion of `mental image' is often used while explaining how somebody not situated in the same perceptual context is able to anchor his understanding of an utterance describing the scene visually perceived by the speaker. We give a foundation for considering mental images as propositions with respect to a certain field of concepts: these fields have to provide a syntactically dense set of concepts distinguishing locations. The use of such propositions in the reference semantic explanations of understanding utterances about visually perceived scenes is motivated by applying Kant's idea of the introduction of new types of objects: we conceive spatial relations as relations only applicable to sortal objects, i.e., individuated objects which are synthetically introduced on a syntactically dense field providing their potential locations. The concept `mental image' which results from these preliminary studies is applied to two current projects in AI, one dealing with the semantics of particular spatial prepositions, and the other more generally concerned with the logic of the connection between visual and verbal space.

Item Type:Conference Paper
Keywords:imagery, reference theory, spatial language
Subjects:Philosophy > Philosophy of Language
Psychology > Cognitive Psychology
Computer Science > Artificial Intelligence
Linguistics > Pragmatics
ID Code:5373
Deposited By: Schirra, Dr. Joerg R.J.
Deposited On:31 Jan 2007
Last Modified:11 Mar 2011 08:56

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in cogprints you will be forwarded to the paracite service. Poorly formated references will probably not work.

Rudolf Carnap. Meaning and Necessity. Univ. of Chicago Press, Chicago, 1947 (second edition).

H. Dankert. Sportsprache und Kommunikation – Untersuchungen zur Struktur der Fußballsprache und zum Stil der Sportberichterstattung. Tübinger Vereinigung für Volkskunde e.V., Tübingen, 1969.

Hartmut Ehrig and B. Mahr. Fundamentals of Algebraic Specification. Springer, Berlin, 1985.

Nelson Goodman. Languages of Art – An Approach to a Theory of Symbols. Indianapolis, 1968.

Gerd Herzog. Utilizing Interval-Based Event Representations for Incremental High Level Scene Analysis. In M. Borillo, editor, Proc. 4th European Workshop on Time, Space, Movement, and Spatio-temporal Reasoning, Toulouse, 1992. IRIT, UPS. forthcoming.

Gerd Herzog, C.-K. Sung, E. Andre, W. Enkelmann, H.-H. Nagel, T. Rist, W. Wahlster, and G. Zimmermann. Incremental Natural Language Description of Dynamic Imagery. In W. Brauer and C. Freksa, editors, Wissensbasierte Systeme, pages 153-162, Berlin, 1989. Springer.

Philip N. Johnson-Laird. Mental Models. Cambridge, Univ. Press, 1983.

F. Grant Johnson. Referenz und Intersubjektivität – Beitrag zur philosophischen Sprachpragmatik. Suhrkamp, Frankfurt/M., 1976.

Hans Kamp. Belief Attribution and Context: Comments on Robert Stalnaker. Technical Report FNS-Bericht-86-13, Universität Tübingen, FNS, Tübingen, 1986.

Hans Kamp. On the Representation and Transmission of Information: Sketch of a Theory of Verbal Communication Based On Discourse Representation Theory. In E. Klein and F. Veltman, editors, Natural Language and Speech, Symposium Proc., pages 135-158. Springer, Berlin, 1990.

Immanuel Kant. Logik. In W. Weischedel, editor, Werke in 12 Bänden, volume VI. Wiesbaden, 1960.

Immanuel Kant. Critique of Pure Reason. St Martin's Press, New York, 1965. (orig. by Macmillan & Co, Ltd., 1929), Transl.: Norman Kemp Smith.

Wilhelm Kamlah and Paul Lorenzen. Logische Propädeutik – Vorschule des vernünftigen Redens. BI Wissenschaftsverlag, München, Wien, Zürich, 1973.

Dieter Koller. Detektion, Verfolgung und Klassifikation bewegter Objekte in monokularen Bildfolgen am Beispiel von Straßenverkehrsszenen. Infix, St. Augustin, 1992.

Kuno Lorenz. Elemente der Sprachkritik - Eine Alternative zum Dogmatismus und Skeptizismus in der Analytischen Philosophie. Suhrkamp, Frankfurt/M., 1970.

Brian F. McGuinness, editor. Ludwig Wittgenstein und der Wiener Kreis – Gespräche, aufgezeichnet von Friedrich Waismann. Suhrkamp, Frankfurt/M., 1984.

George Herbert Mead. Mind, Self, and Society from the Standpoint of a Social Behaviorist. Univ. of Chicago Press, Chicago, 1962.

Jean Piaget and B. Inhelder. L'image mental chez l'enfant. Presses Universitaires de France, Paris, 1966.

Simone Pribbenow. Zur Verarbeitung von Lokalisierungsausdrücken in einem hybriden System. PhD thesis, Univ. Hamburg, Hamburg, 1991.

Arno Ros. Begründung und Begriff – Wandlungen des Verständnisses begrifflicher Argumentationen. Felix Meiner Verlag, Hamburg, 1990. (3 volumes).

Arno Ros. Kants Begriff der synthetischen Urteile apriori. Kant-Studien, 82(2):146172, 1991.

Gudula Retz-Schmidt. Recognizing Intentions, Interactions, and Causes of Plan Failures. User Modeling and User-Adapted Interaction, 1(1):173-202, 1991.

Jörg R.J. Schirra, G. Bosch, C.K. Sung, and G. Zimmermann. From Image Sequences to Natural Language: A First Step towards Automatie Perception and Description of Motions. Applied AI, 1(3):287-305, 1987.

Jörg R.J. Schirra. A Contribution to Reference Semantics of Spatial Prepositions: The Visualization Problem and its Solution in VITRA. In C. Zelinsky- Wibbelt, editor, The Semantics of Prepositions - From Mental Processing to Natural Language Processing. Mouton de Gruyter, Berlin, 1990. (appeared in 1993, Mouton de Gruyter, Berlin, pp 471-515), also available as VITRA-Report No. 75.

Jörg R.J. Schirra. Zur Verbindung von visuellem und sprachlichem Raum - Eine interdisziplinär orientierte Untersuchung im Rahmen der KI am Beispiel von Bildvorstellungen in einem Hörermodell zur Bildbeschreibung. PhD thesis, Fachbereich Informatik, Universität des Saarlandes, Saarbrücken, 1993. forthcoming.[12]

Oliver R.Scholz. Bild, Darstellung, Zeichen – Philosophische Theorien bildhafter Darstellung. Kolleg Philosophie. Verlag Karl Alber, Freiburg/München, 1991.

Peter F. Strawson. Logico-Linguistic Papers. London, 1971.

C.-K. Sung. Extraktion von typischen und komplexen Vorgängen aus einer langen Bildfolge einer Verkehrsszene. In H. Bunke, O. Kübler, and P. Stucki, editors, Mustererkennung 88, Berlin, 1988. Springer.

Ernst Tugendhat. Vorlesungen zur Einführung in die sprachanalytische Philosophie. Suhrkamp, Frankfurt/M., 1976. (also in English: Traditional and Analytical Philosophy: Lectures on the Philosophy of Language. Cambridge, Univ. Press, 1982).

Laure Vieu. Sémantique des relations spatiales et inférences spatio-temporelles: Une contribution a l'itude des structures formelles de l'espace en Langage Naturel. PhD thesis, Institut de Recherches en Informatique de Toulouse, Univ. Paul Sabatier, Toulouse, 1991.

Ludwig Wittgenstein. Philosophical Investigations. Macmillan, New York, 1953.

Ludwig Wittgenstein. Ursache und Wirkung. Intuitives Erfassen. In J. Schulte, editor, Wittgenstein: Vortrag über Ethik und andere kleine Schriften, pages 101-139. Suhrkamp, Frankfurt/M., 1989.

Metadata

Repository Staff Only: item control page

Cogprints is powered by EPrints 3 which is developed by the School of Electronics and Computer Science at the University of Southampton. More information and software credits.