Building a Better CAPE Ratio
October 5, 2022
After a bit of a hiatus from the blog – thanks to our ambitious summer travel schedule – it’s time for another post. Over the years, I’ve gotten a lot of questions about the Shiller CAPE Ratio and if it’s still relevant. If you’re a regular reader of my blog, you’ll likely be familiar with the CAPE concept, but just as a refresher, Prof. Robert Shiller, economist and Nobel Laureate, came up with the cool idea of calculating a Price-Earnings (PE) ratio based not just on 1-year trailing earnings, which can be very volatile, but on a longer-term average to iron out the corporate earnings fluctuations over the business cycle. Hence the name Cyclically-Adjusted Price Earnings (CAPE) Ratio. If we use a 10-year moving average of inflation-adjusted earnings as the denominator in the PE ratio, we get a measure of market valuations that’s more informative in many instances. For example, historically the CAPE ratio has been significantly negatively correlated with subsequent equity returns. It’s not useful for the very short-term equity outlook, but over longer horizons, say 10+ years, the CAPE ratio has been highly informative. Especially retirees should take notice because your retirement success hinges a lot on those first 10 or so retirement years due to Sequence of Return Risk. In fact, all failures of the 4% Rule occurred when the CAPE was above 20! A high initial CAPE ratio signals that retirees should probably be more cautious with their withdrawal rate!
But the CAPE has been elevated for such a long time, people wonder if this measure is still relevant. In the comments section, people ask me all the time what kind of adjustments I would perform to “fix” the CAPE. Can we make the Shiller CAPE more comparable over time, to account for different corporate tax environments and stock buybacks and/or dividend payout ratios over the decades? Yes, I will present my ideas here today. And even better, I will post regular updates (potentially daily!) in my Google Drive for everyone to access for free.
So, what do I find? The adjustments certainly lower the CAPE, but don’t get your hopes too high. Even after the adjustments, the CAPE is still a bit elevated today! Let’s take a look at the details…
Before we even get started with the tax and dividend payout ratios, here are two additional and crucial adjustments I always like to perform when calculating the Shiller CAPE. I might have mentioned these adjustments in a previous post, but never delved much into the details. But today is a good excuse to do so…
Fixing Shiller’s data lags
First, Shiller operates with woefully outdated data, especially earnings data. That may not be too much of a problem in typical macroeconomic research projects studying many decades worth of data. But the average retiree likes to have a timely and accurate estimate of the CAPE Ratio. Below is a screenshot from the Shiller Excel Sheet posted on his website. I downloaded this file on October 3, 2022. The first thing we notice is that the data are crazy outdated. The rows only go to July 2022 and the index level not even the month-end but July 5, so almost 3 months outdated. Of course, we can still derive a pretty decent estimate of the October 3 Shiller CAPE. For example, if we use an SPX quote of 3678.43 (=index level as of 10/3/2022, market close) and we rescale the 28.90 CAPE to 28.90/3831.39*3678.43 we get a CAPE of 27.75. But that’s not really precise because the July 2022 CAPE ratio uses the average real earnings over the 120 months of July 2012 to June 2022. But for the October 2022 CAPE, we have to use October 2012 to September 2022 average real earnings. We are using 3 months of data we shouldn’t use and are missing 3 months worth of data that we should be using.
But the data lag problem is even worse. Shiller’s earnings data go only up to March 2022. So, even back in July, he was 3 months short of earnings data. So, we are inadvertently underestimating the “E” part of the CAPE calculation because we’re putting a weight of 1/117 instead of 1/120 on the (significantly lower) earnings numbers from ten years ago. And using Shiller’s data for an October 2022 CAPE ratio estimate we’re now missing 6 months’ worth of earnings data. Excuse me for being pedantic, but that’s not acceptable.
So, how do I deal with the missing data in the Shiller Sheet? The first problem is easy to solve: I simply download the additional SPX index data for the other months. But what about the earnings data? The problem is that even as of October 3, 2022, the earnings for Q2 are not 100% finalized. According to the index provider, DJ SP Global, that Q2 number is “only” 99.8% final, so there are still 0.2% of the index members that haven’t finalized their number (link to their Excel Sheet).
Well, 99.8% is obviously good enough. And remember, the 99.8% refers to the current quarter. Shiller uses the 4-quarter moving average, so the estimate for the annual trailing earnings per share (EPS) is really 99.95% finalized as of 10/3/2022. So, I can certainly use the $192.26 estimate for June 2022. (also notice that, just as a quick check, the 197.91 and 197.87 figures for 2022Q1 and 2021Q4 exactly match the Shiller numbers, so he’s getting his numbers from the same source.)
And while we’re at it, I am also using the subsequent earnings forecasts for Q3 as the September EPS number in my table. And just like Shiller, I linearly interpolate the EPS for the months in between. And I concede that these are only forecasts, and sure, the forecasts may be off. But not using the SP Global estimates and effectively using the average over the 114 past months as an estimate for the six missing months is also a forecast and likely one with an even greater error!
In any case, I wrote a little Python program to perform the Shiller CAPE calculations, but instead of using the outdated Shiller EPS data, I access the SP Global data and fill in the missing earnings data and use the earnings estimates of the index provider instead. See the output below:
And here’s a time series chart since 1970, when the adjustments are really the most noticeable. Instead of plotting the CAPE, though, I transform this into an earnings yield (one divided by the CAPE), so this would be a series with a positive correlation with future earnings.
(LEFT) BLUEBERRY PECAN BREAD, (RIGHT) SOUR CREAM BLUEBERRY BUNDT CAKE. EXCERPTED FROM BLUEBERRY LOVE (C) BY CYNTHIA GRAUBART, PHOTOGRAPHY…