creators_name: Hubbard, Raymond
creators_name: Armstrong, J. Scott
type: journalp
datestamp: 2006-10-05
lastmod: 2011-03-11 08:56:38
metadata_visibility: show
title: Replications and Extensions in Marketing – Rarely Published But Quite Contrary
ispublished: pub
subjects: behanal
full_text_status: public
abstract: Replication is rare in marketing. Of 1,120 papers sampled from three major marketing journals, none were replications. Only 1.8% of the papers were extensions, and they consumed 1.1% of the journal space. On average, these extensions appeared seven years after the original study. The publication rate for such works has been decreasing since the 1970s. Published extensions typically produced results that conflicted with the original studies; of the 20 extensions published, 12 conflicted with the earlier results, and only 3 provided full confirmation. Published replications do not attract as many citations after publication as do the original studies, even when the results fail to support the original studies.
date: 1994
date_type: published
publication: International Journal of Research in Marketing
volume: 11
pagerange: 233-248
refereed: FALSE
referencetext: AMA Task Force on the Development of Marketing Thought (1988), “Developing, disseminating, and utilizing marketing knowledge,” Journal of Marketing, 52, 1-25.

Anderson, P.F. (1983), “Marketing, scientific progress, and scientific method,” Journal of Marketing, 47, 18-31.

Armstrong, J.S. and R. Hubbard (1992), “Importance of empirical research on consumer behavior: Expert opinions,” Working Paper, Marketing Department, The Wharton School, University of Pennsylvania.

Arndt, J. (1973), “Haire's shopping list revisited,” Journal of Advertising Research, 13, 57-61.

Bangert-Drowns, R.L. (1986), “Review of developments in meta-analytic method,” Psychological Bulletin, 99, 388-399.

Bozarth, J.D. and R.R. Roberts, Jr. (1972), “Signifying significant significance,” American Psychologist, 27, 774-775.

Brinberg, D. and J.E. McGrath (1985), Validity and the Re search Process. Beverly Hills, CA: Sage Publications.

Brown, S.W. and K.A. Coney (1976), “Building a replication tradition in marketing,” in: K.L., Bernhardt. (ed.). Marketing 1776-1976 and Beyond, Chicago, IL: American Marketing Association, pp. 622-625.

Brown, S.W. and C.F. Gaulden, Jr. (1980), “Replication and theory development,” in C.W. Lamb. Jr. and P.M. Dunne (eds.), Theoretical Developments in Marketing, Chicago, IL:
American Marketing Association, pp. 240-243.

Bullock, R.J.. and D.J. S,vyantek (1985), “Analyzing meta-analysis: Potential problems, an unsuccessful replication, and evaluation criteria,” Journal of Applied Psychology, 70. 108-115.

Campbell, K.E. and T.T. Jackson (1979), “The role of and need for replication research in social psychology,” Replications in Social Psychology, 1, 3-14.

Chase, J.E. (1971), “Normative criteria for scientific publications,” American Sociologist, 5, 262-265.

Churchill, G.F. (1988), “Comments on the AMA Task Force study,” Journal of Marketing, 52, 26-31.

Close, F. (1991), Too Hot to Handle: The Race for Cold Fusion. Princeton. NJ: Princeton University Press.

Cohen, J. (1960), “A coefficient of agreement for nominal scales,” Educational and Psychological Measurement, 20. 37-46.

Cohen, J. (1988), Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: Lawrence Erlbaum Associates.

Collins, H.M. (1985), Changing Order: Replication and Induction in Scientific Practice. Beverly Hills, CA: Sage Publications.

DeFleur. M.L. and R.M. Petranoff (1959), “A television test of subliminal persuasion,” Public Opinion Quarterly, 23, 170180.

Dewald, W.G., J.G. Thursby and R.G. Anderson (1986), “Replication in empirical economics:
The Journal of Money, Credit and Banking project.” American Economic Review, 76. 587-603.

Ehrenberg, A.S.C. (1990), “A hope for the future of statistics: MSOD,” American Statistician, 44, 195-196.

Ehrenberg, A.S.C., G.J. Goodhardt and T.P. Barwise (1990), “Double jeopardy revisited,” Journal of Marketing, 54, 82-91.

Feige, E.L. (1975), “The consequences of journal editorial policies and a suggestion for revision,” Journal of Political Economy, 83, 1291-1296.

Franke, R.H. and J.D. Kaul (1978), “The Hawthorne experiments: First statistical interpretations,” American Sociological Review, 4, 623-643.

Furse, D.H. and D.W. Stewart (1982), “Monetary incentive versus promised contribution to charity: New evidence on mail survey response,” Journal of Marketing Research, 19,
375-380.

Ghosh, A. and S.L. McLafferty (1987), Location Strategies for Retail and Service Firms. Lexington, MA: D.C. Heath and Company.

Gorn, G.J. (1982), “The effects of music in advertising on choice behavior: A classical conditioning approach,” Journal of Marketing, 46, 94-101.

Greenwald, A.G. (1975), “Consequences of prejudice aga inst the null hypothesis,” Psychological Bulletin, 82, 1-20.

Greenwald. A.G. (1976), “An editorial,” Journal of Personality and Social Psychology, 33, 1-7.

Haire, M. (1950), “Projective techniques in marketing research,” Journal of Marketing, 14, 649-656.

Hubbard, R. and J.S. Armstrong (1992), “Are null results becoming an endangered species in marketing?” Marketing Letters, 3, 127-136.

Hubbard, R. and E.L. Little (1988), “Promised contributions to charity and mail survey responses: Replication with extension,” Public Opinion Quarterly, 52, 223-230.

Hubbard, R. and D.E. Vetter (1991), “Replication in the finance literature: An empirical study,” Quarterly Journal of Business and Economics, 30, 70-81.

Jacoby, J. (1978), “Consumer research: A state of the art review,” Journal of Marketing, 42, 87-96.

Kane, E.J. (1984), “Why journal editors should encourage the replication of applied econometric research,” Quarterly Journal of Business and Economics, 23, 3-8.

Kellaris, J.J. and A.D. Cox (1989), “The effect of background music in advertising: A reassessment,” Journal of Consumer Research, 16, 113-118.

Kerr, S., J. Tolliver and D. Petree (1977), “Manuscript characteristics which influence acceptance for management and social science journals,” Academy of Management
Journal, 20, 132-141.

Kollat, D.T., R.D. Blackwell, and J.F. Engel (1972), “The cur rent status of consumer behavior research: Development during the 1968-1972 period,” in M. Venkatesan (ed),
Proceedings of the Third Conference of the Association for Consumer Research. Chicago, IL: Association for Consumer Research, pp. 576-585.

Lane, G.S. and G.L. Watson (1975), “A Canadian replication of Mason Haire's ‘shopping list’ study,” Journal of the Academy of Marketing Science, 3, 48-59.

Leone, R.P. and R.L. Schultz (1980), “A study of marketing generalizations,” Journal of Marketing, 44, 10-18.

Madden, C.S., L.S. Franz and R.A. Mittelstaedt (1979), “The replicability of research in
marketing: reported content and author cooperation,” in O.C. Ferrell, S.W. Brown and C.W. Lamb (eds.), Conceptual and Theoretical Developments in Marketing. Chicago, IL:
American Marketing Association, pp. 76-85.

Mayer, T. (1980), “Economics as a hard science: Realistic goal or wishful thinking?” Economic Enquiry ,18, 165-178.

McGrath, J.E. and D. Brinberg (1983). “External validity and the research process: A comment
on the Calder/Lynch dialogue,” Journal of Consumer Research, 10. 115-124.

Mittelstaedt, R.A. and T.S. Zorn (1984), “Econometric replication: Lessons from the experimental sciences,” Quarterly Journal of Business and Economics, 23, 9-15.

Monroe, K. (1991), “Editorial,” Journal of Consumer Research, 18, preface.

Moore, T.E. (1982), “Subliminal advertising: What you see is what you get,” Journal of Marketing, 46, 38-47.

Neuliep, J.W. and R. Crandall (1990), “Editorial bias against replication research,” Journal of Social Behavior and Personality, 5, 85-90.

Oakes, M. (1986), Statistical Inference: A Commentary for the Social and Behavioral Sciences. New York, NY: Wiley.

Reid, L.N., L.C. Soley and R.D. Wimmer (1981), “Replication in advertising research: 1977,
1978, 1979,” Journal of Advertising, 10, 3-13.

Reid, L.N., H.J. Rotfeld and R.D. Wimmer (1982), “How researchers respond to replication requests,” Journal of Consumer Research, 9, 216-218.

Robertson. T.S. (1971), Innovative Behavior and Communication. New York, NY: Holt, Rinehart and Winston.

Robertson, D.H. and D.N. Bellenger (1978), “A new method of increasing mail survey responses: Contributions to charity,” Journal of Marketing Research, 15, 632-633.

Rosenthal, R. and R.L. Rosnow (1984), Essentials of Behavioral Research: Methods and Meta Analysis. New York, NY: McGraw-Hill.

Rosnow, R.L. and R. Rosenthal (1989), “Statistical procedures and the justification of knowledge in psychological science,” American Psychologist, 44, 1276-1284.

Rowney, J.A. and T.J. Zenisek (1980), “Manuscript characteristics influencing reviewers' decisions,” Canadian Psychology, 21, 17-21.

Salsburg, D.S. (1985), “The religion of statistics as practiced in medical journals,” American Statistician, 39, 220-223.

Samelson, F. (1980), “J.B. Watson's Little Albert, Cyril Burt's twins, and the need for a critical science,” American Psychologist, 35, 619-625.

Sawyer, A.G. and A.D. Ball (1981), “Statistical power and effect size in marketing research,” Journal of Marketing Research, 18, 275-290.

Sawyer, A.G. and J.P. Peter (1983), “The significance of statistical significance tests in marketing research,” Journal of Marketing Research, 20, 122-133.

SSCI (Social Science Citation Index), Institute for Scientific Information, 3501 Market Street, Philadelphia, PA 19104, USA.

Sterling, T.D. (1959), “Publication decisions and their possible effects on inferences drawn from tests of significance – or vice versa,” Journal of the American Statistical Association, 54, 30-34.

Tversky, A. and D. Kahneman (1971), “Belief in the law of small numbers,” Psychological Bulletin, 76, 105-110.

Walster, G.W. and T.A. Cleary (1970), “A proposal for a new editorial policy in the social sciences,” American Statistician, 24, 16-19.

Webster, Jr., F.E. and F. von Pechmann (1970), “A replication of the ‘shopping list’ study,” Journal of Marketing, 34, 61-63.

Wilkie, William L. (1986), Consumer Behavior. New York, NY: Wiley.
citation:   Hubbard, Raymond and Armstrong, J. Scott  (1994) Replications and Extensions in Marketing – Rarely Published But Quite Contrary.  [Journal (Paginated)]     
document_url: http://cogprints.org/5199/1/Replications-and-Extensions-in-Marketing.pdf