Heavy Tails and Infinite Variance

Not every distribution is well-behaved. The Cauchy Distribution looks like a Normal curve at first glance, but it has "Heavy Tails." It is notorious in statistics as the classic counterexample to many standard theorems, including the Law of Large Numbers.

f(x)=1πγ[1+(xx0γ)2]f(x) = \frac{1}{\pi \gamma \left[1 + \left(\frac{x-x_0}{\gamma}\right)^2\right]}

The Cumulative Density Function (CDF) is:

F(x)=1πarctan(xx0γ)+12F(x) = \frac{1}{\pi} \arctan\left(\frac{x-x_0}{\gamma}\right) + \frac{1}{2}

Parameters and Properties

  • x0x_0 (Location): The peak of the distribution (similar to the median).
  • γ\gamma (Scale): The spread of the distribution (half-width at half-maximum).
  • Mean (E[X]E[X]): Undefined!
  • Variance (Var(X)Var(X)): Undefined!
Intuition
Black Swans and Infinite Variance

In a Normal world, a 7-foot tall person is a miracle. In a Cauchy world, extreme events (market crashes, massive floods) happen much more often than standard statistics would predict. Because the tails stay so high, the mathematical integral used to calculate the mean (xf(x)dx\int x f(x) dx) does not converge. It oscillates infinitely. It is the ultimate model for "chaotic" or "unpredictable" systems.

Normal vs. Cauchy

The Normal distribution (blue) dies out quickly. The Cauchy distribution (green) has 'Fat Tails' that stay significantly above zero even far from the center.

-0.040.080.1990.3190.439-4.16-2.496-0.8320.8322.4964.16xy
Normal (Predictable)Cauchy (Chaotic)

Advanced Practice

Example 1: Using the CDF

medium

For a Standard Cauchy distribution (x0=0,γ=1x_0 = 0, \gamma = 1), what is the probability of an outcome falling exactly between -1 and 1?

Example 2: The Fat Tail Probability

hard

Compare the probability of seeing an extreme event X>10X > 10 in a Standard Cauchy distribution (x0=0,γ=1x_0=0, \gamma=1) versus a Standard Normal distribution (μ=0,σ=1\mu=0, \sigma=1). (Assume P(Z>10)P(Z > 10) for Normal is approx 7.6×10247.6 \times 10^{-24}).