Nepedia
Back to Discover
Advanced Reader
🔢

Kurtosis

math Maturity 7-9 Next article →

Kurtosis is a statistical term used to describe the degree of "tailedness" in a probability distribution. In probability theory, a distribution represents how values are spread out for a random variable. While many people mistakenly believe kurtosis measures how pointy or peaked a distribution is, it actually describes the behavior of the tails. The tails are the extreme ends of the distribution where rare, outlying values occur.

Standard symmetric pdfs
Standard symmetric pdfs

By measuring kurtosis, statisticians can understand the likelihood of encountering extreme outliers compared to a standard model.

To understand the mechanism, we must look at how kurtosis is calculated using moments. The standard measure, originating with Karl Pearson, is the fourth standardized moment. This involves taking the fourth central moment and dividing it by the fourth power of the standard deviation. The underlying logic relies on the mathematical property of exponents. When you raise a standardized value less than 1 to the fourth power, the result becomes very small. These values represent data points near the mean or the peak.

Pearson type VII distribution log-PDF
Pearson type VII distribution log-PDF

Conversely, values greater than 1 are raised to the fourth power and grow significantly. These large values represent the outliers. Therefore, the calculation is dominated by the extreme tails rather than the central peak.

Statisticians often use a specific version called excess kurtosis to simplify comparisons. Excess kurtosis is calculated by taking Pearson's kurtosis and subtracting 3. This subtraction is done so that a standard normal distribution has an excess kurtosis of exactly 0. This provides a clear baseline for identifying different types of distributions. Using excess kurtosis is also helpful because it relates to the extensive property of cumulants. This makes mathematical formulas for sums of independent random variables easier to express.

Pearson type VII distribution PDF
Pearson type VII distribution PDF

There are three distinct regimes of kurtosis based on the excess value. The first is mesokurtic, which describes a distribution with zero excess kurtosis. The most famous example is the normal distribution family. The second regime is leptokurtic, which occurs when excess kurtosis is positive. These distributions have "fat" tails, meaning they produce more extreme outliers than a normal distribution. Examples include the Laplace, Student's t, and exponential distributions.

Three probability density functions
Three probability density functions

The third regime is platykurtic, which occurs when excess kurtosis is negative. These distributions have "thin" tails and produce fewer outliers. The uniform distribution is platykurtic, as is the Bernoulli distribution, which represents a single coin toss.

1909 US Penny
1909 US Penny

History shows that the interpretation of these values has evolved. Karl Pearson developed the systematic use of these moments to describe data shapes. For a long time, the exact meaning of kurtosis was a subject of debate among scholars. However, modern consensus, supported by researchers like Westfall in 2014, clarifies that it relates specifically to tail extremity. This means kurtosis tells us about the tendency to produce outliers. It does not provide information about the configuration of data near the mean or the "shoulders" of the distribution.

Mathematical bounds provide further detail for advanced study. The kurtosis of a distribution is always bounded below by the squared skewness plus 1. This lower limit is reached by the Bernoulli distribution. Interestingly, there is no upper limit to kurtosis; it can be infinite. This is visible in certain families like the Pearson type VII, where the shape parameter can lead to infinite kurtosis.

Pearson type VII distribution log-PDF
Pearson type VII distribution log-PDF

In these cases, the tails decay so slowly that the fourth moment does not exist.

Kurtosis connects to broader fields like information theory and entropy. In the study of entropy, the normal distribution is unique because it has the largest entropy for a given mean and covariance. This connects the concept of "randomness" to the specific shape of the distribution. By studying how probability mass moves from the shoulders of a distribution into the center or the tails, scientists can model complex systems. Whether studying finance or physics, understanding the tails helps predict rare but impactful events.

636 words

Where will your curiosity go next?

Keep exploring at your chosen reading level.

🖼️ Images & Media (8)
File:Three probability density functions.png
Three probability density functions.png
File:1909 US Penny.jpg
1909 US Penny.jpg
File:Pearson type VII distribution PDF.svg
Pearson type VII distribution PDF.svg
File:Pearson type VII distribution log-PDF.svg
Pearson type VII distribution log-PDF.svg
File:Standard symmetric pdfs.svg
Standard symmetric pdfs.svg
File:Standard symmetric pdfs logscale.svg
Standard symmetric pdfs logscale.svg
File:Platykurtic.png
Platykurtic.png
File:Leptokurtic.png
Leptokurtic.png
More to explore

What is Nepedia?

A free, ad-free encyclopedia for children. Every article is written at five reading levels, so the same page works for a five-year-old and a fifteen-year-old — use the level switcher above to see this one change. No account needed to read.