The Enigma of Normality: Unraveling a Century-Old Statistical Mystery

Finance Published: May 14, 2005
EEMQUALBAC

Have you ever wondered why, despite its shortcomings, the normal distribution remains the workhorse of statistics? This isn't just a case of 'if it ain't broke, don't fix it'. There's a deeper tale to tell. Augustus de Morgan, back in 1838, was already scratching his head over this 'curiously ubiquitous' success. Fast forward to today, we're still grappling with the same question: why does the Gaussian distribution reign supreme?

The Gaussian Distribution: A Universal Force

Imagine probability distributions as celestial bodies. The Gaussian distribution is like a black hole at the center of our statistical universe. It's not just that everything gets pulled into it; once there, things remain stable under a wide variety of operations. This isn't mere coincidence. There's a reason why the Central Limit Theorem tells us that the sum of many independent random variables tends towards a Gaussian distribution. But what is this reason?

Herschel–Maxwell Derivation: A Two-Dimensional Perspective

John Herschel, in 1850, considered two-dimensional errors in measuring star positions. He found that even if the longitudinal and declination errors were independently distributed but not necessarily Gaussian, their joint distribution would still be Gaussian. This isn't because of any magical properties of the normal curve; it's due to the symmetry and simplicity of the Gaussian function.

The Bayesian Interpretation: Information Over Entropy

Now, let's switch gears a bit. Instead of thinking about frequencies, imagine probability distributions as containers of information. The Gaussian distribution is special because it minimizes entropy under certain constraints. This means it maximizes our information given some uncertainty. It's like having the largest possible 'knowledge footprint' within a given 'error radius'.

Investment Implications: Diversification and Risk Management

In the realm of finance, this translates into diversification being rewarded with lower risk (volatility). Consider tech-heavy ETFs like EEM or QUAL. They're more volatile than the broader market because they're heavily concentrated in a few sectors. Now, BAC, a large-cap bank stock, might seem less risky on its own, but its correlation with the market could make it a risky addition to an already diversified portfolio.

Navigating the Gaussian World: Embracing Uncertainty

So, what should investors do? Embrace uncertainty and diversify. Don't rely too heavily on any single strategy or asset class. Remember, the Gaussian distribution is our best friend when it comes to managing risk, but it's not a panacea. It works best with large sample sizes and independent events.