1773
14
1487
2
5842
document
1487
compsciA4.ps
application/postscript
1279754
20091208 20:38:22
http://cogprints.org/1773/1/compsciA4.ps
1773
1
application/postscript
application/postscript
public
compsciA4.ps

http://eprints.org/relation/hasVolatileVersion
http://cogprints.org/id/document/5173

http://eprints.org/relation/haspreviewThumbnailVersion
http://cogprints.org/id/document/5173

http://eprints.org/relation/hasVersion
http://cogprints.org/id/document/5173
11327
3
44248
document
11327
compsci.pdf
application/pdf
627933
20091208 20:38:23
http://cogprints.org/1773/5/compsci.pdf
1773
5
5
application/pdf
application/pdf
public
compsci.pdf

http://eprints.org/relation/hasVolatileVersion
http://cogprints.org/id/document/5174

http://eprints.org/relation/haspreviewThumbnailVersion
http://cogprints.org/id/document/5174

http://eprints.org/relation/hasVersion
http://cogprints.org/id/document/5174

http://eprints.org/relation/hasVolatileVersion
http://cogprints.org/id/document/9594

http://eprints.org/relation/hasVersion
http://cogprints.org/id/document/9594

http://eprints.org/relation/hasIndexCodesVersion
http://cogprints.org/id/document/9594
archive
192
disk0/00/00/17/73
20010830
20110311 08:54:46
20070912 16:40:10
journalp
show
0
There have been many attempts at formulating measures of complexity of physical processes. Here we reject this direct approach and attribute complexity only to models of these processes in a given language, to reflect its "difficulty". A framework for modelling is outlined which includes the language of modelling, the complexity of models in that language, the error in the model's predictions and the specificity of the model. Many previous formulations of complexity can be seen as either: a special case of this framework; attempts to "objectify" complexity by considering only minimally complex models or its asymptotic behaviour; relativising it to a fixed mathematical structure in the absence of noise; misnamed in that they capture the specificity rather than the complexity. Such a framework makes sense of a number of aspects of scientific modelling. Complexity does not necessarily correspond to a lack of simplicity or lie between order and disorder. When modelling is done by agents with severe resource limitations, the acceptable tradeoffs between complexity, error and specificity can determine the effective relations between these. The characterisation of noise will emerge from this. Simpler theories are not a priori more likely to be correct but sometimes preferring the simpler theory at the expense of accuracy can be a useful heuristic.
 http://www.cpm.mmu.ac.uk/cpmrep23.html

Edmonds
Bruce

Aerts
Diederik
pub
complexity, modelling, representation, specificity, noise, error rate, simplicity, language, order, disorder, randomness
3
379390
FALSE
Foundations of Science
Kluwer Academic
TRUE
Cambridge.
[2] Chaitin, G.J. 1966. On the Length of Programs for Computing Finite Binary Sequences, Journal of the Association of
Computing Machinery, 13, 547569.
[3] Crutchfield, J.P. 1994. The Calculi of Emergence: Computation, Dynamics and Induction. Physica D, 75, 1154.
[4] Edmonds, B. 1995. A Hypertext Bibliography of Measures of Complexity.
[5] Edmonds, B. (forthcoming). What is Complexity?: the philosophy of Complexity per se with application to some
examples in evolution. In F. Heylighen & D. Aerts (eds.): The Evolution of Complexity, Kluwer, Dordrecht.
[6] Grassberger, P. 1986. Towards a Quantitative Theory of SelfGenerated Complexity. International Journal of
Theoretical Physics, 25, 907938.
[7] Kauffman, S.A. 1993. The Origins of Order. Oxford University Press, New York.
[8] Kolmogorov, A.N. 1965. Three Approaches to the Quantitative Definition of Information, Problems of Information
Transmission, 1, 117.
[9] Murphy, P.M. and Pazzani, M.J. 1994. Exploring the Decision Forest: An Empirical Investigation of Occam's Razor in
Decision Tree Induction, Journal of Artificial Intelligence Research, 1, 257275.
[10] Pearl, J.P. 1978. On the Connection Between the Complexity and Credibility of Inferred Models, International Journal
of General Systems, 4, 255264.
[11] Popper, K.R. 1968. Logic of Scientific Discovery, Hutchinson, London.
[12] Quine, W.V.O. 1960. Simple Theories of a Complex World, in The Ways of Paradox, Eds., Random House, New
York, pages 242246.
[13] Rissanen, J. 1990. Complexity of Models. In Zurek,W.H. (ed.). Complexity, Entropy and the Physics of Information.
AddisonWesley, Redwood City, California, 117125.
[14] Sober, E. 1975. Simplicity. Clarendon Press, Oxford.
[15] Solomonoff, R.J. 1964. A Formal theory of Inductive Inference. Information and Control, 7, 122, 224254.
 compscimachlearn
 philsci
Complexity and Scientific Modelling
5
published
2000
public