We use bits to tell things.
We use bits to count facts.
We use different ways to measure information.
We use different tools to measure information.
How does a nat actually work? It uses powers of e to find its value. One nat represents a specific amount of information. This happens when an event has a chance of 1/e to occur. This math makes the nat a natural choice for some tasks. One nat is larger than a shannon. In fact, one nat is about 1.44 shannons. It is also about 0.434 hartleys. These different units all help us measure information in different ways.
People have used different names for this idea over time. Boulton and Wallace once used the name nit. They used it when talking about minimum message length. Later, people changed the name to nat. They did this to avoid a big mix-up. A nit is also a unit used for luminance. This means it measures how bright light is. Using nat keeps the information unit separate from light.
Famous thinkers have also looked at this math. Alan Turing used a name for this too. He called it a natural ban. He meant the same thing as the nat.
You can see how these ideas connect to the world.
Information is something we can measure with mathematical precision.
To understand how a nat works, we must look at the probability of an event. The nat measures the information content found in a specific occurrence. One nat represents the information content of an event when its probability is exactly 1/e. This specific value links the unit directly to the properties of the natural logarithm. Because it uses this base, the nat functions differently than other common information units. It provides a unique way to quantify the uncertainty or the surprise found in data.
There are several ways to compare the nat to other established units of information. One nat is larger than a shannon. Specifically, one nat is equal to approximately 1.44 shannons. You can also compare it to a unit called the hartley. One nat is equivalent to about 0.434 hartleys. These conversions allow scientists to move between different mathematical frameworks. They can switch from base 2 systems to natural logarithm systems using these specific ratios.
The history of the term shows how scientists avoid confusion in their work. Boulton and Wallace originally used the term nit. They applied this term when discussing the concept of minimum message length. However, the minimum description length community later decided to change the name to nat. They made this change to prevent a mix-up with another unit. In science, a nit is also a unit used to measure luminance, which is brightness. Changing the name ensured that information science and light science remained distinct.
Great thinkers have contributed different names to this same mathematical concept. The famous mathematician Alan Turing used a different term for this idea. He referred to it as a natural ban. Even though the name was different, he intended the same mathematical meaning. This shows that the concept of natural logarithmic information has long been recognized. Whether called a nat or a natural ban, the underlying math remains the same. It provides a consistent way to describe how information is structured.
Information entropy is closely tied to the physical world through thermodynamics. Information entropy is the expected value of the information of an event. It is a quantity that shares a dimension with thermodynamic entropy. The International System of Units assigns the unit joule per kelvin to both heat capacity and thermodynamic entropy. This assignment implies that information entropy is a quantity of dimension one. This connection helps scientists bridge the gap between pure math and physical heat.
In many advanced systems, the nat is used to measure thermodynamic entropy directly. This happens in systems that normalize the Boltzmann constant to 1. When the Boltzmann constant is set to this value, the nat becomes the effective unit of measurement. Furthermore, if a scientist writes Shannon entropy using a natural logarithm, they are using nats. This mathematical choice implicitly treats the resulting quantity as being measured in nats. This shows how deeply the nat is embedded in the study of both information and energy.
🖼️ Images & Media (1)
More to explore
✨ What else?
Related topics you might enjoy
🔬 Go deeper
More advanced topics to explore
🪜 Step back
Simpler topics to build understanding
What is Nepedia?
A free, ad-free encyclopedia for children. Every article is written at five reading levels, so the same page works for a five-year-old and a fifteen-year-old — use the level switcher above to see this one change. No account needed to read.