Everipedia Logo
Everipedia is now IQ.wiki - Join the IQ Brainlist and our Discord for early access to editing on the new platform and to participate in the beta testing.
nat (unit)

nat (unit)

The natural unit of information (symbol: nat),[1] sometimes also nit or nepit, is a unit of information or entropy, based on natural logarithms and powers of e, rather than the powers of 2 and base 2 logarithms, which define the bit. This unit is also known by its unit symbol, the nat. The nat is the coherent unit for information entropy. The International System of Units, by assigning the same units (joule per kelvin) both to heat capacity and to thermodynamic entropy implicitly treats information entropy as a quantity of dimension one, with 1 nat = 1. Physical systems of natural units that normalize the Boltzmann constant to 1 are effectively measuring thermodynamic entropy in nats.

When the Shannon entropy is written using a natural logarithm,

it is implicitly giving a number measured in nats.

One nat is equal to 1/ln 2 shannons (or bits) ≈ 1.44 Sh or, equivalently, 1/ln 10 hartleys ≈ 0.434 Hart.[1] The factors 1.44 and 0.434 arise from the relationships

, and.

One nat is the information content of an event if the probability of that event occurring is 1/e.

History

Boulton and Wallace used the term nit in conjunction with minimum message length[2] which was subsequently changed by the minimum description length community to nat to avoid confusion with the nit used as a unit of luminance.[3]

Alan Turing used the natural ban.[4]

References

[1]
Citation Linkwww.iso.org"IEC 80000-13:2008". International Electrotechnical Commission. Retrieved 21 July 2013.
Sep 30, 2019, 1:15 AM
[2]
Citation Linkopenlibrary.orgBoulton, D. M.; Wallace, C. S. (1970). "A program for numerical classification". Computer Journal. 13 (1): 63–69.
Sep 30, 2019, 1:15 AM
[3]
Citation Linkwww.csse.monash.edu.auComley, J. W. & Dowe, D. L. (2005). "Minimum Message Length, MDL and Generalised Bayesian Networks with Asymmetric Languages". In Grünwald, P.; Myung, I. J. & Pitt, M. A. (eds.). Advances in Minimum Description Length: Theory and Applications. Cambridge: MIT Press. sec. 11.4.1, p271. ISBN 0-262-07262-9.
Sep 30, 2019, 1:15 AM
[4]
Citation Link//www.worldcat.org/oclc/10020685Hodges, Andrew (1983). Alan Turing: The Enigma. New York: Simon & Schuster. ISBN 0-671-49207-1. OCLC 10020685.
Sep 30, 2019, 1:15 AM
[5]
Citation Linkwww.iso.org"IEC 80000-13:2008"
Sep 30, 2019, 1:15 AM
[6]
Citation Linkwww.csse.monash.edu.au"Minimum Message Length, MDL and Generalised Bayesian Networks with Asymmetric Languages"
Sep 30, 2019, 1:15 AM
[7]
Citation Linkmitpress.mit.eduAdvances in Minimum Description Length: Theory and Applications
Sep 30, 2019, 1:15 AM
[8]
Citation Linkwww.csse.monash.edu.ausec. 11.4.1, p271
Sep 30, 2019, 1:15 AM
[9]
Citation Linkwww.worldcat.org10020685
Sep 30, 2019, 1:15 AM
[10]
Citation Linken.wikipedia.orgThe original version of this page is from Wikipedia, you can edit the page right here on Everipedia.Text is available under the Creative Commons Attribution-ShareAlike License.Additional terms may apply.See everipedia.org/everipedia-termsfor further details.Images/media credited individually (click the icon for details).
Sep 30, 2019, 1:15 AM