creators_name: Richters, John E. type: other datestamp: 2000-10-15 lastmod: 2011-03-11 08:54:24 metadata_visibility: show title: National Institute of Mental Health Roundtable Discussion: Promissory Notes and Prevailing Norms in Social and Behavioral Sciences Research ispublished: unpub subjects: dev-psy subjects: soc-psy full_text_status: public keywords: Paradigm Reform, Scientific Retooling. Research Methods abstract: Most workshops convened by the National Institute's of Health are devoted to the puzzle-solving activities of normal science, where the puzzles themselves and the strategies available for solving them are determined largely in advance by the shared paradigmatic assumptions, frameworks, and priorities of the scientific community's research paradigm. They are designed to facilitate what Thomas Kuhn referred to as elucidating topological detail within a map whose main outlines are available in advance. And apparently for good reason. Historical studies by Kuhn and others reveal that science moves fastest and penetrates most deeply when its practitioners work within well-defined and deeply ingrained traditions and employ the concepts, theories, methods, and tools of a shared paradigm. No paradigm is perfect and none is capable of identifying, let alone solving, all of the problems relevant to a given domain of inquiry. Thus, the essential day-to-day business of normal science is not to question the limits or adequacy of a given paradigm, but rather to exploit the presumed virtues for which it was adopted. As Kuhn cautioned in his discussion of paradigms, re-tooling, in science as in manufacture, as an extravagance to be reserved for the occasion that demands it. Well, as the marketing people say --- this is not your father's Oldsmobile. We are breaking with tradition today by stepping outside the map to initiate and pursue a long-overdue dialogue about paradigm reform and scientific retooling. Our warrant for prosecuting this agenda is a Kuhnian occasion that demands it--- is a protracted paradigm crisis, the neglect of which has hurt us terribly and the resolution of which will determine the viability and fate of the social and behavioral sciences in the 21st century. Since the details of the crisis are well know within and outside our ranks, a brief sketch of its main outlines will suffice as a framework for our dialogue today. They include, (a) widespread dissatisfaction with the meager theoretical progress and practical yield of more than a century of social and behavioral sciences research in many substantive domains, (b) long-neglected yet widely recognized deficiencies in the epistemological assumptions, discovery practices and justification standards of the dominant paradigm on which the social and behavioral sciences have relied --- and rely--- to conceptualize, interpret, and guide their empirical research, (c) a broadly based consensus among leading scholars and scientists about the need for fundamental paradigm reforms, and (d) institutional incentive structures that not only encourage and reinforce the status quo but discourage constructive reform efforts. Our objective for the next eight hours is to formulate strategies and recommendations for leveraging the resources and influence of the National Institute of Mental Health to foster a climate of constructive reforms where they are needed by freeing investigators in from the oppressive constraints of existing paradigms and facilitating, encouraging, and funding their retooling their efforts date: 1997-12 date_type: published refereed: FALSE referencetext: Bhaskar, R. (1997). A realist theory of science (2nd ed). London: Verso Classics. Cairns, R. B. (1986). Phenomena lost: Issues in the study of development. In J. Valsiner (Ed.), The individual subject and scientific psychology (pp. 97-112). New York: Plenum Press. Cartwright, N. (1997). What is a causal structure?. In V. R. McKim & S. P. Turner (Eds.) Causality in crisis?: Statistical methods and the search for causal knowledge in the social sciences (pp. 343-357). Indiana: University of Notre Dame Press Dar, R. (in press). Null hypothesis tests and theory corroboration: Defending NHSTP out of context. Behavioral and Brain Sciences. Dar, R., Serlin, R. C., & Omer, H. (1994). Misuse of statistical tests in three decades of psychotherapy research. Journal of Consulting and Clinical Psychology, 62, 75-82. Dar, R. (1990). Theory corroboration and football: Measuring progress. Psychological Inquiry, 1, 149-151. Dar, R. (1987). Another look at Meehl, Lakatos, and the scientific practices of psychologists. American Psychologist, 42, 145-151. Freedman, D. A. (1997). From association to causation via regression. In V. R. McKim & S. P. Turner (Eds.) Causality in crisis?: Statistical methods and the search for causal knowledge in the social sciences (pp. 113-161). Indiana: University of Notre Dame Press. Freedman, D. A. (1997). Rejoinder to Spirtes and Scheines. In V.R. McKim & S. P. Turner (Eds.) Causality in crisis?: Statistical methods and the search for causal knowledge in the social sciences (pp. 177-182). Indiana: University of Notre Dame Press. Hinshaw, S. & Park, T. (in press). Research problems and issues: Toward a more definitive science of disruptive behavior disorders. In H. C. Quay & A, E. Hogan (Eds.), Handbood of disruptive behavior disorders. New York: Plenum Press. Kagan, J. (1997). Conceptualizing psychopathology: The importance of developmental profiles. Development and Psychopathology, 9, 321-334. Kagan, J. (1992). Yesterday's premises, tomorrow's promises. Developmental Psychology, 28, 990-997. Kuhn, T. S. (1977). The essential tension: Tradition and innovation in scientific research. .In T. S. Kuhn (Ed.), The essential tension: Selected readings in scientific tradition and change. Chicago, IL.: University of Chicago Press. Loftus, G. R. (in press). Why psychology will be a much better science when we change the way we analyze data. Current Directions in Psychological Science. Loftus, G. R. & Masson, M. E. J. (1994) Using confidence intervals in within-subjects designs. Psychonomic Bulletin & Review, 1, 476-490 Loftus, G. R. (1993). Editorial Comment. Memory & Cognition, 21, 1-3. Loftus, G. R. (1991). On the tyranny of hypothesis testing in the social sciences. Contemporary Psychology, 36, 102-105. Lykken, D. T. (1991). What's wrong with psychology anyway? In D. Cicchetti & W. M. Grove (Eds.), Thinking clearly about psychology (Vol. 1) (pp. 3-39). Minneapolis, MN: University of Minnesota Press. Lykken, D. T. (1968). Statistical significance in psychological research. Psychological Bulletin, 70, 151-159. Maltz, M. D. (1995). Criminality in space and time: Life course analysis and the micro-ecology of crime. In J. E. Eck & D. Weisburd (Eds.), Crime and place (pp. 315-347). New York: Criminal Justice Press. Maltz, M. D. (1994). Deviating from the mean: The declining significance of significance. Journal of Research in Crime and Delinquency, 31, 434-436. Manicas, P. T., & Secord, P. F. (1983). Implications for psychology of the new philosophy of science. American Psychologist, 4, 399-413. McGuire, W.J. (1997). Creative hypothesis generating psychology: Some useful heuristics. Annual Review of Psychology, 48, 1-30. McGuire, W.J. (1989). A perspectivist approach to the strategic planning of programmatic scientific research. In B. Gholson, W. R. Shadish, R. A. Neimeyer, & A. C. Houts (Eds.), Psychology of science: Contributions to metascience (pp. 214-245). New York: Cambridge Uiniversity Press. McGuire, W. J. (1983). A contextualist theory of knowledge: Its implications for innovation and reform in psychological research. Advances in Experimental Social Psychology, 16, 2-47. McKim, V. (1997). Introduction. In V. R. McKim & S. P. Turner (Eds.) Causality in crisis?: Statistical methods and the search for causal knowledge in the social sciences (pp. 1-19). Indiana: University of Notre Dame Press. Meehl, P. E. (1990). Appraising and amending theories: The strategy of Lakatosian defense and two principles that warrant it. Psychological Inquiry, 1, 108-141. Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806-834. Overton, W. E., & Horowitz, H. A. (1991). Developmental psychopathology: Integrations and differentiations (pp. 1-42). In D. Cicchetti & S. Toth (Eds.), Rochester Symposium on Developmental Psychopathology, Vol. 3: Models and integrations. Richters, J. E. (1997). The Hubble hypothesis and the developmentalist's dilemma. Development and Psychopathology, 9, 193-229. Richters, J. E. & Cicchetti, D. (1993). Mark Twain meets DSM-III-R: Conduct disorder, development, and the concept of harmful dysfunction. Development and Psychopathology, 5, 5- 29. Robinson, D. N. (1995). The logic of reductionistic models. New Ideas in Psychology, 13, 1-8. Robinson, D. N. (1993). Is there a Jamesian tradition in psychology? American Psychologist, 48, 638-643. Robinson, D. N. (1984). The new philosophy of science: A reply to Manicas and Secord. American Psychologist, 39, 920-921. Turner, S. (1997). "Net Effects": A short history. In V. R. McKim & S. P. Turner (Eds.) Causality in crisis?: Statistical methods and the search for causal knowledge in the social sciences (pp. 23-45). Indiana: University of Notre Dame Press. citation: Richters, John E. (1997) National Institute of Mental Health Roundtable Discussion: Promissory Notes and Prevailing Norms in Social and Behavioral Sciences Research. (Unpublished) document_url: http://cogprints.org/1018/3/Transcript_of_NIMH_Paradigm_Roundtable_Discussion_-_Promissory_Notes_and_Prevailing_Norms_in_Social_and_Behavoral_Sciences_Research.pdf