Seminar Details

Seminar Details


Friday

May 5

3:30 pm

Yule's "Nonsense Correlation" Solved!

Philip Ernst

Faculty host Thomas Richardson
Seminar

Rice University - Statistics

In this talk, I will discuss how I recently resolved a longstanding open statistical problem. The problem, formulated by the British statistician Udny Yule in 1926, is to mathematically prove Yule's 1926 empirical finding of ``nonsense correlation.” We solve the problem by analytically determining the second moment of the empirical correlation coefficient of two independent Wiener processes. Using tools from Fredholm integral equation theory, we calculate the second moment of the empirical correlation to obtain a value for the standard deviation of the empirical correlation of nearly .5. The ``nonsense'' correlation, which we call ``volatile'' correlation, is volatile in the sense that its distribution is heavily dispersed and is frequently large in absolute value. It is induced because each Wiener process is ``self-correlated'' in time. This is because a Wiener process is an integral of pure noise and thus its values at different time points are correlated. In addition to providing an explicit formula for the second moment of the empirical correlation, we offer implicit formulas for higher moments of the empirical correlation. The full paper is currently in press at The Annals of Statistics and can be found at http://www.imstat.org/aos/AOS1509.pdf.