Hypotheses in Marketing Science: Literature Review and Publication Audit

Armstrong, J. Scott and Brodie, Roderick J. and Parsons, Andrew G. (2001) Hypotheses in Marketing Science: Literature Review and Publication Audit. [Journal (Paginated)]

Full text available as:



We examined three approaches to research in marketing: exploratory hypotheses, dominant hypothesis, and competing hypotheses. Our review of empirical studies on scientific methodology suggests that the use of a single dominant hypothesis lacks objectivity relative to the use of exploratory and competing hypotheses approaches. We then conducted a publication audit of over 1,700 empirical papers in six leading marketing journals during 1984-1999. Of these, 74% used the dominant hypothesis approach, while 13 % used multiple competing hypotheses, and 13% were exploratory. Competing hypotheses were more commonly used for studying methods (25%) than models (17%) and phenomena (7%). Changes in the approach to hypotheses since 1984 have been modest; there was a slight decrease in the percentage of competing hypotheses to 11%, which is plained primarily by an increasing proportion of papers on phenomena. Of the studies based on hypothesis testing, only 11 % described the conditions under which the hypotheses would apply, and dominant hypotheses were below competing hypotheses in this regard. Marketing scientists differed substantially in their opinions about what types of studies should be published and what was published. On average, they did not think dominant hypotheses should be used as often as they were, and they underestimated their use.

Item Type:Journal (Paginated)
Subjects:Psychology > Behavioral Analysis
ID Code:5186
Deposited By: Armstrong, J. Scott
Deposited On:25 Sep 2006
Last Modified:11 Mar 2011 08:56

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in cogprints you will be forwarded to the paracite service. Poorly formated references will probably not work.

Agarwal, M. K. and V. R. Rao (1996), “An empirical comparison of consumer-based measures of brand equity,” Marketing Letters, 7, 237-248.

Bult, J. R. and T. Wansbeek (1995), “Optimal selection for direct mail,” Marketing Science, 14 (4) 378-394.

Fockens, E. W., P. S. H. Leefiang, and D. R. Wittink (1997), “Hierarchical versus other market share models for

markets with many items;” International Journal of Research in Marketing, 14, 359-378.

Johnson, M. D., E. W, Anderson, and C, Fornell (1995), “Rational and adaptive performance expectations in a customer satisfaction framework,” Journal of Consumer Research, 21, 695-707.

Kmffi, M. (1999), “An empirical investigation of the antecedents of sales force control systems,” Journal of Marketing, 63, 120-134.

Mittal, V., P. Kumar, and M. Tsiros (1999), “Attribute-level performance, satisfaction, and behavioral intentions

over time: A consumption system approach,” Journal of Marketing, 63, 88-101.

Naik, P. A., M. Mantrala, and A. G. Sawyer (1998), “Planning media schedules in the presence of dynamic advertising quality,” Marketing Science, 17, 214-235.

Pechmann, C. and C. Shih (1999), “Smoking scenes in movies and antismoking advertisements before movies: effects on youth,” Journal of Marketing, 63, 1-13.

Szymanski, D. M., L. C. Troy, and S. G, Bhamadwaj (1995). “Order of entry and business performance: An

empirical synthesis and reexamination,” Journal of Marketing, 59, 17-33.

Abramowitz, S. I., B. Games, and C. V. Abramowitz (1975), “Publish or politic: Referee bias in manuscript review” Journal of Applied Social Psychology, 5, 187-200.

AMA Task Force on the Development of Marketing Thought (1988), “Developing, disseminating, and utilizing

marketing knowledge,” Journal of Marketing, 52, 1-25.

Anderson, L. M. (1994), “Marketing science: Where's the beef?” Business Horizons, (Jan-Feb), 8-16.

Armstrong, J. S. (1979), “Advocacy and objectivity in science,” Management Science, 25, 423-428.

Armstrong, J. S. (1980), “Advocacy as a scientific strategy: The Mitroff myth, Academy of Management Review, 5, 509-511.

Armstrong, J. S. (1988), “Research needs in forecasting,” International Journal of Forecasting, 4, 449-465.

Armstrong, J. S. (1991), “Prediction of consumer behavior by experts and novices," Journal of Consumer Research, 18, 251-256.

Armstrong, J. S. and R. Hubbard, (1991), “Does the need for agreement among reviewers inhibit the publication of

controversial findings?” Behavioral and Brain Sciences, 14, 136-137.

Bass, F. M. (1993), “The future of research in marketing: marketing science,” Journal of Marketing Research, 30, 1-


Begg, C. B. and J. A. Berlin (1989), “Publication bias and dissemination of clinical research,” Journal of the National Cancer Institute, 81 (2), 107-115.

Ben-Shakar, G., M, Bar-Hillel, Y. Bilu, and G. Sheller (1998), “Seek and ye shall find: Test results are what you

hypothesize they are,” Journal of Behavioral Decision Making, 11, 235-249.

Betmann, J. R., N. Capon, and R. J. Lutz (1975), “Cognitive algebra in multi-attribute attitude models,” Journal of Marketing Research, 12, 151-164.

Bloom. P. N. (1987), Knowledge Development in Marketing. Lexington, MA: Lexington Books.

Burger, J. M. and R. Petty (1981), “The low-ball compliance technique: Task or person commitment?” Journal of Personality and Social Psychology, 40, 492-500.

Broad, W. and N. Wade (1982), Betrayers of the Truth: Fraud and Deceit in the Halls of Science. New York: Simon

and Schuster.

Bruner, J. and M. C. Potter (1964), “Interference in visual recognition,” Science, 144, 424-425.

Chamberlin, T. C. (1965), “The method of multiple working hypotheses,” Science, 148, 754-759. (Reprint of an 1890 paper).

Chapman, W. and J. P. Chapman (1969), “Illusory correlation as an obstacle to the use of valid psychodiagnostic signs,” Journal of Abnormal Psychology, 74, 271-280.

Cialdini, R. B., J. T. Cacioppo, R. Bassett, and J. A. Miller (1978), “Low-ball procedure for producing compliance: Commitment then cost,” Journal of Personality and Social Psychology, 36, 463-476.

Cohen, J. (1994), “The earth is round (p < 0.05),” American Psychologist, 49, 997-1003.

Coursol, A. and E. E. Wagner (1986), “Effect of positive findings on submission and acceptance rates: A Note on meta-analysis bias,” Professional Psychology: Research and Practice, 17, (2), 137.

Demsetz, H. (1974), “Two systems of belief about monopoly,” in H. J. Goldschmid, H. M. Mann, and J. F. Weston (eds.), Industrial Concentration: The New Learning. Boston: Little, Brown, pp. 164-184.

Dunbar, K. (1993), “Concept discovery in a scientific domain,” Cognitive Science, 17, 397-434.

Dunbar, K. (1995), “How scientists really reason: Scientific reasoning in real-world laboratories,” in R. J. Steinberg and J. E. Davidson (eds.), The Nature of Insight. Cambridge, MA: MIT Press, pp. 365-395.

Fluid, E., A. Ginter, and G. Ben-Shakhar (1994), “The effects of prior expectations and outcome knowledge or. polygraph examiners' decisions,” Journal of Behavioral Decision Making, 7, 279-292.

Farris, H. and R. Revlin (1989), “The discovery process: A counterfactual strategy," Social Studies of Science, 19, 497-513.

Goldfarb, R. S. (1995), “The economist-as-audience needs a methodology of plausible inference,” Journal of Economic Methodology, 2, 201-222.

Goodstein, L. D. and K. L. Brazis (1970), “Credibility of psychologists: An empirical study," Psychological Reports, 27, 835-838.

Gorman, M E. and M. E. Gorman. (1984), “A comparison of disconfirmatory, confirmatory and control strategies on

wason's 2-4-6 task,” The Quarterly Journal of Experimental Psychology, 36A, 629-648.

Greenwald, A, G., A. R. Pratkanis, M. R. Leippe, and M. H. Baumgardner (1986), “Under what conditions does theory obstruct progress?” Psychological Review, 93, 216-229.

Hogarth. R. M. (1978), “A note on aggregating opinions," Organizational Behavior and Human Performance, 21,406.

Hubbard, R. and J. S. Armstrong (1994), “Replications and extensions in marketing: Rarely published but quite contrary,” International Journal”of Research in Marketing, 11, 233-248.

Hubbard, R. and J. S. Armstrong (1992), “Are null results becoming an endangered species!" Marketing Letters, 3,


Jones, W. H. and D. Russell (1980), “The selective processing of belief discontinuing information,” European Journal of Social Psychology, 10, 309-312.

Klayman, J. and Y. Ha (1987), “Confirmation, disconfirmation, and information in hypothesis testing,”

Psychological Review, 94, 211-228.

Klayman, J. and Y. Ha (1989), “Hypothesis testing in rule discovery: Strategy, structure, and content,” Journal of Experimental Psychology, 15, 596-604.

Koehler, J. J. (1993), “The influence of prior beliefs on scientific judgments of evidence quality," Organizational Behavior and Human Decision Processes, 56, 28-55.

Leone, R. P. and R. Schultz (1980), “A study of marketing generalizations," Journal of Marketing, 44, 10-18.

Libby, R. and R. K. Blashfield (1978), “Performance of a composite as a function of the number of judges,” Organizational Behavior and Human Performance, 21, 121-129.

Lord, C. G., L. Ross, and M. R. Lepper (1979), “Biased assimilation and attitude polarization: The effects of prior theories on subsequently considered evidence," Journal of Personality and Social Psychology, 37, 2098-2109.

Mahoney, M. J. (1977), “Publication prejudices: An experimental study of confirmatory bias in the peer review

system,” Cognitive Therapy and Research, 1, 161-175.

McCloskey, D. N. and S. T. Ziliak (1996), “The standard error of regressions,” Journal of Economic Literature, 34, 97-114.

McDonald, J. (1992), “Is strong inference really superior to simple inference," Synthese, 92, 261-282.

McKenzie, C. R. M. (1998), “Taking into account the strength of an alternative hypothesis,” Journal of Experimental Psychology, 24, 771-792.

Mitroff, I. (1972), “The myth of objectivity, or, why science needs a new psychology of science,” Management Science, 18, B613-B618.

Mynatt, C., M. E. Doherty, and R. D. Tweney (1978), “Consequences of confirmation and disconfirmation in a simulated research environment,” Quarterly Journal of Experimental Psychology, 30, 395-406.

Platt, J. R. (1964), “Strong inference,” Science, 146, 347-353.

Pollay, R. W. (1984), “Lydiametrics: Applications of econometrics to the history of advertising,” Journal of Advertising History, 1 (2), 3-I5.

Rodgers, R. and I. F. Hunter (1994), “The discard of study evidence by literature reviewers,” Journal of Applied Behavioral Science, 30, 329-345.

Rust, R. T., D. R. Lehmann, and J. U. Fancy (1990), “Estimating the publication bias of meta-analysis,” Journal of Marketing Research, 27, 220-226.

Sawyer, A. G. and J. P. Peter (1983), “The significance of statistical significance tests in marketing research,” Journal of Marketing Research, 20, 122- 133.

Wason, P. C. (1960), “On the failure to eliminate hypotheses in a conceptual 'task,” Quarterly Journal of

Experimental Psychology, 12, 129 -140.

Wason, P. C. (1968), “Reasoning about a rule,” Quarterly Journal of Experimental Psychology, 20, 273-281.

Wells, W. D. (1993), “Discovery-oriented consumer research,” Journal of Consumer Research, 19, 489-504.


Repository Staff Only: item control page