CONDITIONAL REASONING: SCENARIO OR CONTEXT EFFECTS
Valiña, Mª Dolores, Seoane, Gloria, Ghering, Sonnya,
Ferraces, Mª José y Fernández-Rey, Xosé
University of Santiago de Compostela (Spain)
INTRODUCTION
The ability to solve problems involving conditional relationships (vg. "if p... then g") has a central role not only in the pragmatic reasoning but also in the scientific inference. The aim of this paper is concerned with context effect about conditional human reasoning. The understanding of this effect is a principal phenomenon to be discussed if we are interesed to investigate how people consistently do reason in the daily life.
The question of what is the importance of scenario or the context in everyday reasoning may be answered in many different ways and from many different perspectives. There are a number of theories that argue people use internalized inference logical rules (Braine, 1978; Rips, 1983, 1984; Braine & cols., 1984). These approaches have proposed a syntactic view of human reasoning.
In contrast, other autors have proposed that people reason using pragmatic reasoning schemas or abstract knowledge structures induced from ordinary life experiences, as permissions, obligations and causations schemas (Cheng & Holyoak, 1985, 1989; Cheng & cols., 1986).
Cheng & cols' investigations provide support for the view that people often reason using knowledge structures of intermediate level of abstraction and context sensitives, rather than purely syntactic rules-or domain-specific eperience that cued relevant solutions in memory (Griggs y Cox, 1982; Griggs, 1983).
Most of the recent research for the past twenty years examined pragmatic reasoning in Wason's selection task (Wason, 1966, 1968; Wason & Johnson-Laird, 1972). The previous studies examines many experimental manipulations and this experimental task has generated a larger literature (see Griggs, 1983, Evans, 1989, Johnson-Laird, 1991 for a review). A facilitation content effect was first reported (Wason & Shapiro,1971; Johnson-Laird & cols.,1972) but subsequent research failled to replicate the thematic effect (see Griggs, 1983 and Wason, 1983, for a review). During the past decade the conclusion about the "elusive thematic material effects" in Wason's selection task (Griggs y Cox, 1982) was that the performance on thematic problems can be facilitated, but this facilitation was "more limited than originally thought and brought about by a very different mechanisms than originally proposed" (Jackson & Griggs, 1990, p. 354).
During the 90's Jackson & Griggs (1990) also found the pragmatic reasoning schemas effect to be very "elusive". They examined the pragmatic reasoning schema theory of deduction reasoning and established that the finding of facilitation on abstract versions of the selection task is not the result of evoking pragmatic reasoning schemas, but it was dependent upon two presentation factors. They conclude "the results of the present experiments mirror those observes throughout the past 20 years of researching on the selection task in that a result can be changed dramatically by only a subtle change in problem presentation" (p. 371).
In contrast, this study explore the pragmatic reasoning schemas effect in everyday conditional reasoning, but real world reasoning problems, that hold interest for the subjeets, were used. The conditional arguments were included in narrative texts; these texts represented scenarios of real world. Previous investigations about syllogistic inference (Henle, 1962; Evans & cols., 1983; Valiña & De Vega, 1988) and conditional reasoning (Piper, 1985) used narrative texts.
The experiment reported here have been designed to explore the effects of the type of context (causal and promises/threats), the congruence of the text and the factual relationship between antecedent and consequent on the conditional everyday reasoning.
METHOD
Subjects
120 students (75 females and 45 males; mean age 17 years 1 month) at the college level, in Santiago de Compostela (Spain) participated in this experiment.
The subjects acted as unpaid volunteers. They have no received any instruction in logic.
Design
A 2 x 2 x 3 x 4 (type of content x congruence x degree of factual relationship x type of rule) factorial design with repeated measures on the last two factors was used. The type of context (causal and promises/threats) and the congruence between the factual congruence explicit in the story and the logic conclusion (congruent vs. incongruent) were manipulated between subjects, with 30 subjects randomly assigned to each experimental group.
The last two factors were degree of factual relation between antecedent and consequent of major premise (deterministic, probabilistic and without relation) and type of conditional rule (MP, MT, Ac and DA).
The dependent measures were: (a) correct answers to problems of conditional inference and (b) subjects´certainty in the answer selected.
Material
Eight variations of the 24 conditional reasoning test were used. Tests booklets were constructed, each containing one instruction page, and the conditional reasoning problems presented on separate pages.
There were 24 conditional arguments for each of two different context: (a) Causal (vg. "if you are on diet then you will lose weight") or (b) Promises/Threats (vg."if she is not agree with his pressures then he will lose her work"). Each booklet was prepared containing conditional arguments according to the type of logical rule (MP, MT, AC and DA) and the probability of factual relationship between antecedent and consequent of major premise (deterministic, probabilistic or whithout relation). These conditional sentences were based on previous experimental work (see Valiña & cols., 1992).
In this experiment the conditional reasoning problems were pesented in the context of narrative texts. In general the procedure was the same as that used in previous experimental work about syllogistic reasoning (Valiña & De Vega, 1988). 48 short stories about scenarios of the daily life were described in these texts.
The steps in constructing an everyday scenarios can be outlined as follows: (1) First the principal persons and their situation were presented (vg. "Marta, that is chemistry teacher, teaches laboratory practical classes to her students"), (2) The "if p. . . then q" after that conditional sentences were included in the context of these previous situation (vg. "Before begining the class he noticed her students they were to work with very dangerous substances, in order that they must carefully pay attention her instructions, and also they were advised to put they laboratory coat, but as someone of them did not want do it she noticed them that if sulphuric acid spilled on their clothes then those were burnt") , (3) The "p", "not-p", "q" or "not-q" action is presented (vg. "During the practice the clothes of a student girl, who had not wore laboratory coat, were splashed with sulphuric acid"). Then the MP, MT, AC or DA conditional rules were determined. And, finally (4) the congruence between the factual consequence expicit in the story and the logic conclusion is manipulated. A congruent final (vg."The opinion of that student was changed by the incident, and she resolved to wear her laboratory coat in order to the event did not happen again") or a incongruent final (vg. "The opinion of that student was not changed by the incident and she went on with one's work without to wear her laboratory coat") remated the history.
Finally, a list of alternative conclusions from which the subject must select was presented. An affirmative, negative and non-propositional conclusions were presented for each item.
The length and accesibility of vocabulary of each history was controlled. The order of the 24 conditional problems was randomized and the items were presented in this order and another reverse order.
Task and Procedure
30 subjects were assigned at random to each of four experimental groups. All participants were given one version of the booklets. In conditions (a) and (b) the subjects received 24 reasoning problems presented as a story with causal conditional premises (causal context). In conditions (c) and (d) the subjects received another 24 conditional reasoning problems with promises/threats context in the premises (promises/threats context).
Half of the subjects received a congruent history (groups 1 and 3) and the other half received an incongruent history (groups 2 and 4). Within each of the four main groups half of the subjects received the problems in a randomized order and the remaining ones received in reverse order.
Subject's task was assume that the two premises of each conditional argument are true and to select from a list of three alternatives the conclusion followed from such premises. The subjects were required to rate the security in their selection of the answer; a five-point scale was used.
The experiment was run in four experimental sessions. The instructions were read to the subjects and they were asked to read them to themselves again. Previous to the test problems subjects had two practice items using conditionals arguments.
Questions were solicited and finally they were allowed to work at their own speed. They were given unlimited time to carry out the task.
Results
A) Correct Answers
A 2 x 2 x 3 x 4 (type of context x congruence x degree of factual relation x type of rule) ANOVA with repeated measures for the last two factors was computed. There were significant main effects for congruence (F (1, 116) = 21.68); p < .0001); degree or probability of factual relation between antecedent and consequent (F (2, 232) = 36.25; p < .0001), and type of rule (F (3, 348) = 29.27; p < .0001). There were also significant congruence x type of context (F (1, 116) = 7.05; p < .0091), factual relationship x type of context (F (2, 232) = 7.92; p < .0005), type of context x type of rule (F (3, 348) = 6.71; p < .0002), factual relation x type of rule (F (6, 696) = 56.72; p < .0001) and congruence x type of rule ( F (3,348) = 14.62; p < .0001). There was not main effect involving type of context.
The pattern of results was the predicted by our hypothesis. The congruent version of reasoning problems produced a significantly higher rate of correct responses than the incongruent version with all contexts (causal and promises/threats).
As it was predicted, the conditional inference task is easier to perform when it involves realistic material. Moreover, the probability of factual relation between the two componentes of conditional sentences had effects on subjecs` performance.
There were more correct answers to problems with the deterministic relation between the two components of major premises than those involving a probabilistic relation or whithout-relation between antecedent and consequent. These difference were significant (Tukey's test, p < .05). Inspection of paired comparisons for the factual relationship x type of context interaction.showed that the subjects made more errors in causal content probl.ems than those with promises/threats only the deterministic condition (p < .05).
The congruence x type of context interaction was also explored. Performance on the causal context was significantly better than performance on the promises/threats problems with the congruent version but the Tukey's test comparisons (p < .05) indicated also significantly worse performanceon the incongruent causal context than those with promises/threats content.
For the thematic conditional arguments the mean percentage of correct responses for MP, MT, AC and DA rules were 58.18%, 47.78%, 38.45% and 34.85%. There were no significant differences for problems involving AC and DA rules but post hoc comparisons (Tukey's test) showed that conditional AC and DA arguments were significantly (p < .05) more difficult than the corresponding MP and MT on the other hand, MP arguments were consistently (p <.05) easier than MT arguments.
The comparison (Tukey's test ) of the mean within each type of rule indicated that arguments without factual relationship were significantly easier for AC rules. For MP, and MT rules arguments involving a major premise with deterministic relation were significantly (p < .05) easier those involving a probabilistic or without relation between the components. Finally, the probabilistic relation showed better performance for DA problems.
Inspection of paired comparisons for the congruence x type of rule showed that the subiects made more errors with the incongruent version on theMP and MT inference rules (p < .05). But none of other comparisons were significant.
Finally, Tukey's test comparisons indicated that subjects make more errors with causal context in MT and DA reasoning problems, but they particularly find difficult on the MP and AC problems with proimises /threats context.
B) Subjects´ certainty
There was significant main effect for the congruence (F(1, 216)= 9.36; p < .0028), degree of factual relationship between the two components of mayor premise (F(2, 232)= 9.17; p<.0001) and type of conditional rule ( F(3, 348)= 6.88); p<.0002). It was also significant the interaction Type of content x Degree of factual relation x Type of rule (F(6, 696)= 6.90; p < .0001).
The incongruent items resulted in significantly worse confidence than either of other congruent problems. Tukey's tests comparisons showed that judgements concerning deterministic relation between the two components of conditional sentences are more confidence than judgment concerning probabilistic relation or no relation between antecedent and consequent.
Inspection of paired comparisons for the type of context x probability of factual relationship interaction showed that the subjective certainty in the correct answers are greater for the promises/threats context with deterministic relation; but the subjects have more confidence with the probabilistic sentences on the causal context problems.
Finally, a final area to be briefly examined concerned the degree of factual relation x type of rule interaction. In MP problems, subjects possessed more confidence with the deterministic conditional sentences than with the other relationships. The probabilistic relations had greater confidence scores with MT and AC problems, whereas subjects´certainty with NA arguments improved significantly (p < .05) when these arguments containing ajor premises whithout factual relationship between antecedent and consequent.
REFERENCES
BRAINE, M.D.S. (1978). On the relation between the natural logic of reasoning and standard logic. Psychological Review, 85, 1-21.
BYRNE, R.M.J. (1989). Everyday reasoning with conditional sequences. The Quarterly Journal of Experimental Psychology, 41A(1) , 141-166.
CHENG, P.W. & HOLYOAK, K.J. (1985). Pragmatic reasoning schemas. Cognitive Psychology, 17, 391-416.
CHENG, P.W. & HOLYOAK, K.J. (1989). On the natural selection of reasoning theories. Cognition, 33, 285-313.
CHENG, P.W., HOLYOAK, K.J., NISBETT, R.E. & OLIVER, L.M. (1986). Pragmatic versus syntactic approaches to training deductive reasoning. Cognitive Psychology, 18, 293-328.
CHROTOWSKI, J.J. & GRIGGS, R.A. (1985). The effects of problem content, instructions, and verbalization procedure on Wason's selection task. Current Psychological Research and Reviews, 4(2), 99-107.
COX, J.R. & GRIGGS, R.A. (1982). The effects of experience on performance in Wason's selection task. Memory and Cognition, 10(5), 496-502.
EVANS, J.St.B.T. (1982). The Psychology of Deductive Reasoning. London, Routledge and Kegan Paul.
EVANS, J.St.B.T. (1984). Heuristics and analytic processes in reasoning. British Journal of Psychology, 75(4), 541-568.
EVANS, J.St.B.T. (1989). Bias in human reasoning: Causes and consequences. London: Lawrence Erlbaum Associates Ltd.
GALOTTI, K.M. (1989). Approaches to studying formal and everyday reasoning. Psychological Bulletin, 105(3), 331-351.
GILHOOLY, K.J. & FALCONER,W.A. (1974). Concrete and abstracts terms and relations in testing a rule. Quarterly Journal of Experimental Psychology, 26, 355-359.
GRIGGS, R.A. (1983). The role of problem content in the selection task and in the THOG problem. En J.St.B.T. EVANS (Ed.), Thinking and Reasoning Psychological Approaches. London: Routledge and Kegan Paul.
GRIGGS, R.A. (1984). Memory cuing and instructional effects on Wason's selection task. Current Psychological Research and Reviews, 3(4), 3-10.
GRIGGS, R.A. (1989). To "see" or not to "see": that is the selection task. Quarterly Journal of Experimental Psychology, 41A(3), 517-529.
GRIGGS, R.A. & COX, J.R. (1982). The elusive thematic materials effect in Wason's selection task. The British Journal of Psychology, 73(3), 407-426.
HENLE, M. (1962). On the relation between logic and thinking. Psychological Review, 69, 366-378.
JACKSON, S.L. & GRIGGS, R.A. (1990). The elusive pragmatic reasoning schemas effect. The Quarterly Journal of Experimental Psychology, 42A(2), 353-373.
JOHNSON-LAIRD, P.N. (1983). Mental Models. Toward a Cognitive Science of Language Inference and Consciousness. Cambridge: Cambridge University Press.
JOHNSON-LAIRD, P.N. (1985). Logical thinking: does it occur in daily life? Can it be tought?. In S.F. CHIPMAN; J.W. SEGAL & R. GLASER (Eds.), Thinking and Learning Skills, 2. N.J.: LEA.
JOHNSON-LAIRD, P.N. (1986). Conditionals and mental models. En J. S. MEULEN; J. S. REILLY & C.A. FERGUSON (Eds.), On conditionals. Cambridge: Cambridge University Press.
JOHNSON-LAIRD, P.N. & BYRNE, R.M.J. (1991). Deduction. N.J.: L.E.A.
JOHNSON-LAIRD, P.N.; LEGRENZI, P. & SONINO LEGRENZI, M.(1972). Reasoning and a sense of reality. British Journal of Psychology, 63, 395-400.
MANKTELOW, R.I. & EVANS, J.St.B.T. (1979). Facilitation of reasoning by realism: Effect or non-effect?. British Journal of Psychology, 70, 477-488
PIPER, D. (1985). Syllogistic reasoning in varied narrative context: Aspects of logical and linguistic development. Journal of Psycholinguistic Research 14 (1), 19-44.
POLLARD, P. (1981). The effect of thematic content on the "Wason selection task". Current Psychological Research, 1, 21-29.
POLLARD, P. (1982). Human reasoning: Some Possible effects of availability. Cognition, 12, 65-96.
POLLARD, P. & EVANS, J.St.B.T. (1980). The influence of logic on conditional reasoning performance. The Quarterly Journal of Experimental Psychology, 32, 605-624.
POLLARD, P. & EVANS, J.St.B.T. (1987). Content and context effects in reasoning. American Journal of Psychology, 100 (1), 41-60.
REICH, S.S. & RUTH, J. (1982). Wason's selection task: Verification, falsification and matching. Britisth Journal of Psychology, 73, 395-405.
RIPS, L.J. (1983). Cognitive processes in propositional reasoning. Psychological Review, 90 (1), 38-71.
SEOANE, G. & VALIÑA, M.D. (1988). Efecto del contenido y microgénesis de la tarea en inferencia condicional. Cognitiva, 1(3), 217-298.
VALIÑA, M.D. & DE VEGA, M. (1988). Un estudio experimental del razonamiento cotidiano en tareas de silogismos: Una aproximación pragmática. Cognitiva, 1, 33-62.
VALIÑA, MªJ, SEOANE, G., MARTIN, M., FERNANDEZ-REY, J. & FERRACES, MªJ. (1992). The role of content and context in pragmatic reasoning. Fifth Conference of the European Society for Cognitive Psychology, Paris, France.
WASON, P.C. (1968). Reasoning about a rule. The Quarterly Journal of Experimental Psychology, 20, 273-281.
WASON, P.C. (1983). Realism and rationality in the selection task. En J.St.B.T. EVANS (Ed.), Thinking and Reasoning. Psychological approaches. Londres: Routledge and Kagan Paul.
WASON, P. C. & JOHNSON-LAIRD, P.N. (1972). Psychology of reasoning: Structure and content. Harvard: Harvard University Press.
WASON, P.C. & SHAPIRO, D. (1971). Natural and contrived experience in a reasoning problem. Quarterly Journal of Experimental Psychology, 23, 63-71.
YACHANIN, S.A. (1986). Facilitation in Wason's selection task: Content and instructions. Current Psychological Research and Reviews, 5(1) 20-29.
YACHANIN, S.A. & TWENEY, R.D. (1982). The effect of thematic content on cognitive strategies in the four card selection task. Bulletin of the Psychonomic Society, 19(2), 87-90.