Everipedia Logo
Everipedia is now IQ.wiki - Join the IQ Brainlist and our Discord for early access to editing on the new platform and to participate in the beta testing.
Goodhart's law

Goodhart's law

Goodhart's law is an adage named after economist Charles Goodhart, which has been phrased by Marilyn Strathern as "When a measure becomes a target, it ceases to be a good measure."[1] One way in which this can occur is individuals trying to anticipate the effect of a policy and then taking actions that alter its outcome.[2]

Formulation

Goodhart first advanced the idea in a 1975 article, which later became used popularly to criticize the United Kingdom government of Margaret Thatcher for trying to conduct monetary policy on the basis of targets for broad and narrow money. His original formulation was:[3]

Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes.

However, some parts of the concept considerably pre-dates Goodhart's statement in 1975.[4] Shortly after Goodhart's publication, others suggested closely related ideas, including Campbell's law (1976) and the Lucas critique (1976).

As applied in economics, the law is implicit in the economic idea of rational expectations, a theory in economics that states that entities who are aware of a system of rewards and punishments will optimize their actions within said system to achieve their desired results. E.g. employees whose performance in a company is measured by some known quantitative measure (cars sold in a month etc.) will attempt to optimize with respect to that measure regardless of whether or not their behavior is profit-maximizing. While it originated in the context of market responses, the law has profound implications for the selection of high-level targets in organizations.[5] Jón Danı́elsson quotes the law as "Any statistical relationship will break down when used for policy purposes" and suggests a corollary to the law for use in financial risk modelling: "A risk model breaks down when used for regulatory purposes."[6] Mario Biagioli has related the concept to consequences of using citation impact measures to estimate the importance of scientific publications:[7]

All metrics of scientific evaluation are bound to be abused. Goodhart's law (named after the British economist who may have been the first to announce it) states that when a feature of the economy is picked as an indicator of the economy, then it inexorably ceases to function as that indicator because people start to game it.

The law is richly illustrated in the 2018 book The Tyranny of Metrics by Jerry Z. Muller.[8] An enunciation of the law preceding both Goodhart's and Campbell's works is due to Jerome R. Ravetz. In his 1971 Scientific Knowledge and Its Social Problems,[9] pp. 295–296, Ravetz discusses how measurement systems can be gamed. For Ravetz, when the goals of a task are complex, sophisticated, or subtle, then crude systems of measurements can be played exactly by those persons possessing the skills to execute the tasks properly, who thus manage to achieve their own goals to the detriment of those assigned.

See also

  • Campbell's law

  • Reflexivity (social theory)

  • Reification (fallacy)

  • Overfitting

  • Cobra effect

  • McNamara fallacy

References

[1]
Citation Link//doi.org/10.1002%2F%28SICI%291234-981X%28199707%295%3A33.0.CO%3B2-4Strathern, Marilyn. "Improving Ratings: Audit in the British University System" (PDF). European Review. 5 (3): 305–321. doi:10.1002/(SICI)1234-981X(199707)5:33.0.CO;2-4.
Sep 29, 2019, 10:30 PM
[2]
Citation Link//arxiv.org/archive/cs.AIManheim, David; Garrabrant, Scott (2018). "Categorizing Variants of Goodhart's Law". arXiv:1803.04585 [cs.AI].
Sep 29, 2019, 10:30 PM
[3]
Citation Linkbooks.google.comGoodhart, Charles (1981). "Problems of Monetary Management: The U.K. Experience". In Courakis, Anthony S. (ed.). Inflation, Depression, and Economic Policy in the West. pp. 111–146. ISBN 978-0-389-20144-1.
Sep 29, 2019, 10:30 PM
[4]
Citation Linkwww.ribbonfarm.com"Overpowered Metrics Eat Underspecified Goals". Ribbonfarm. Accessed 26 January 2017.
Sep 29, 2019, 10:30 PM
[5]
Citation Linkopenlibrary.orgGoodhart, C. A. E. (1975). "Problems of Monetary Management: The U.K. Experience". Papers in Monetary Economics. I. Reserve Bank of Australia.
Sep 29, 2019, 10:30 PM
[6]
Citation Link//doi.org/10.1016%2FS0378-4266%2802%2900263-7Daníelsson, Jón (July 2002). "The Emperor Has No Clothes: Limits to Risk Modelling". Journal of Banking & Finance. 26 (7): 1273–1296. CiteSeerX 10.1.1.27.3392. doi:10.1016/S0378-4266(02)00263-7.
Sep 29, 2019, 10:30 PM
[7]
Citation Link//www.ncbi.nlm.nih.gov/pubmed/27411599Biagioli, Mario (12 July 2016). "Watch out for cheats in citation game" (PDF). Nature. 535 (7611): 201. Bibcode:2016Natur.535..201B. doi:10.1038/535201a. PMID 27411599.
Sep 29, 2019, 10:30 PM
[8]
Citation Linkbooks.google.comMuller, Jerry Z. (2018). The Tyranny of Metrics. Princeton University Press. ISBN 978-0-691-19126-3.
Sep 29, 2019, 10:30 PM
[9]
Citation Linkbooks.google.comRavetz, Jerome R. (1971). Scientific Knowledge and Its Social Problems. Transaction Publishers. ISBN 978-1-4128-3378-3.
Sep 29, 2019, 10:30 PM
[10]
Citation Linkcyberlibris.typepad.com"Goodhart's Law: Its Origins, Meaning and Implications for Monetary Policy"
Sep 29, 2019, 10:30 PM
[11]
Citation Link//arxiv.org/abs/1803.045851803.04585
Sep 29, 2019, 10:30 PM
[12]
Citation Linkui.adsabs.harvard.edu2018arXiv180304585M
Sep 29, 2019, 10:30 PM
[13]
Citation Linkwww.ribbonfarm.com"Goodhart's Law and Why Measurement is Hard'"
Sep 29, 2019, 10:30 PM
[14]
Citation Linkwww.npr.orgEpisode 877: "The Laws Of The Office"
Sep 29, 2019, 10:30 PM
[15]
Citation Linkconferences.asucollegeoflaw.com"Improving Ratings: Audit in the British University System"
Sep 29, 2019, 10:30 PM
[16]
Citation Linkdoi.org10.1002/(SICI)1234-981X(199707)5:33.0.CO;2-4
Sep 29, 2019, 10:30 PM
[17]
Citation Linkarxiv.org1803.04585
Sep 29, 2019, 10:30 PM
[18]
Citation Linkarxiv.orgcs.AI
Sep 29, 2019, 10:30 PM
[19]
Citation Linkbooks.google.com"Problems of Monetary Management: The U.K. Experience"
Sep 29, 2019, 10:30 PM
[20]
Citation Linkwww.ribbonfarm.comOverpowered Metrics Eat Underspecified Goals
Sep 29, 2019, 10:30 PM