All models are wrong, unless you have limited data, in which case most models are right

I am very fond of the quote by the statistician George Box: “essentially, all models are wrong, but some are useful”. It is true, all our models are wrong if you look carefully enough. For example, Newton’s model of gravity is pretty good for calculating our orbit around the Sun, but if you look carefully enough you will see it is wrong. Careful measurements and general relativity have told us that it is an approximation. The same thing applies to pretty much every model we have.

Continue reading