creators_name: Chow, Siu L. type: journalp datestamp: 2003-04-21 lastmod: 2011-03-11 08:55:15 metadata_visibility: show title: Issues in Statistical Inference ispublished: pub subjects: cog-psy subjects: phil-sci full_text_status: public keywords: Statistical inference, Experimental control, Significance tests, Statistical power, Effect size, Experimenter's expectancy effects, Meta-experiment, Meta-analysis, Sample size abstract: The APA Task Force’s treatment of research methods is critically examined. The present defense of the experiment rests on showing that (a) the control group cannot be replaced by the contrast group, (b) experimental psychologists have valid reasons to use non-randomly selected subjects, (c) there is no evidential support for the experimenter expectancy effect, (d) the Task Force had misrepresented the role of inductive and deductive logic, and (e) the validity of experimental data does not require appealing to the effect size or statistical power. date: 2002 date_type: published publication: History and Philosophy of Psychology Bulletin volume: 14 number: 1 pagerange: 30-41 refereed: TRUE referencetext: Boring, E. G. (1954). The nature and history of experimental control. American Journal of Psychology, 67, 573-589. Boring, E. G. (1969). Perspective: Artifact and control. In R. Rosenthal, & R. L. Rosnow (Eds.), Artifacts in behavioral research (pp. 1-11). New York: Academic Press. Campbell, D. T., & Stanley, J. L. (1966). Experimental and quasi-experimental designs for research. Chicago: Rand McNally. Chow, S. L. (1987). Meta-analysis of pragmatic and theoretical research: A critique. Journal of Psychology, 121, 259-271. Chow, S. L. (1991). Some reservations about statistical power. American Psychologist, 46, 1088-1089. Chow, S. L. (1994). The experimenter's expectancy effect: A meta-experiment. German Journal of Educational Psychology, 8, 89-97. Chow, S. L. (1996). Statistical significance: Rationale, validity and utility. London: Sage. Chow, S. L. (1998). A précis of "Statistical Significance: Rationale, Validity and Utility." Behavioral and Brain Sciences, 21, 169-194. (http://www.cogsci.soton.ac.uk/bbs/Archive/bbs.chow.html) Cohen, J. (1987). Statistical power analysis for the behavioral sciences (Revised Edition). New York: Academic Press. Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45, 1304-1312. Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49, 997-1003. Cohen, M. R., & Nagel, E. (1934). An introduction to logic and scientific method. London: Routledge & Kegan Paul. Feigl, H. (1970). The “orthodox” view of theories: Remarks in defense as well as critique. In M. Radner, & S. Winokur (Eds.), Analyses of theories and methods of physics and psychology. Minnesota studies in the philosophy of science (pp. 3-16). Vol. IV. Minneapolis: University of Minnesota Press. Garner, W. R., Hake, H. W, &Eriksen, C. (1956). Operationism and the concept of perception. Psychological Review, 63, 149-159. MacCorquodale, K., Meehl, P. E. (1948). On a distinction between hypothetical constructs and intervening variables. Psychological Review, 55, 95-107. Meehl, P. E. (1967). Theory testing in psychology and physics: A methodological paradox. Philosophy of science, 34, 103-115. Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806-834. Mill, J. S. (1973). A system of logic: Ratiocinative and inductive. Toronto: University of Toronto Press. Popper, K. R. (1968a). The logic of scientific discovery (2nd edition, originally published in 1959). New York: Harper Row. Popper, K. R.(1968b). Conjectures and refutations.: The growth of scientific knowledge (originally published in 1962). New York: Harper Row. Rosenthal, R., & Fode, K. L. (1963a). Three experiments in experimenter bias. Psychological Reports, 12, 491-511. Rosenthal, R., & Fode, K. L. (1963b). The effect of experimenter bias on the performance of the albino rat. Behavioral Science, 8, 183-189. Rosenthal, R. (1976). Experimenter effects in behavioral research (Enlarged edition). New York: Irvington Publishers. Tukey, J. W. (1960). Conclusions vs. decision. Technometrics, 2, 1-11. Wilkinson & Task Force on Statistical Inference, APA Board of Scientific Affairs. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54(8), 594-604. citation: Chow, Dr. Siu L. (2002) Issues in Statistical Inference. [Journal (Paginated)] document_url: http://cogprints.org/2892/1/CritAPA.pdf