Backtesting at the Factor & Subfactor Level
Following on from the Reviewing the Market Decline & Overall System Performance article which detailed the performance of the system at the top level, this article presents a breakdown of backtested performance at the factor and subfactor level.
Looking at the table below, it's no surprise to see subfactors associated with safety, cash and value at the top end of the scale. Financial Strength was the only factor that consistently outperformed, while Buybacks and Debt were it for the subfactors. Clearly the credit problems and financial turmoil favoured companies with excess cash and steady business models - the kind of companies who tend to buy back their own stock. For the same reasons, companies free of debt and interest expenses were rewarded also. Growth related factors were punished, the worst of which was Organic Business Growth which predominantly favours expanding sales estimates. The rapidly shifting economic outlook shattered the confidence investors had in companies who had been expecting to grow revenue and operations. Obviously success in those areas requires economic confidence and often a credit supply to the companies themselves plus their customers.
Looking at the performance across the periods, it seems there was a flight to quality and value in the first period with Earnings Yield the leading subfactor. During the next period, as problems in the financial system grew more serious, healthy balance sheets were what investors were after - Liquidity, Cash, Buybacks and Low Debt were strongly in favour. During the 3rd period, as equity prices crumbled, economic data weakened and recession fears intensified, similar stock characteristics performed better, but overall the system's performance was quite poor. Even though 4 out of 5 system factor performed ok, the poor result and higher weighting of Price vs Earnings and Growth dragged the system down. Predictability of earnings and growth performed best, suggesting any available money in the market went to defensive stocks with predictable earnings. Although everything sold off in a big way, anything levered to economic growth caught the worst of it.
The table below details the performance of the factors and subfactors. Note that these numbers are based on the complete universe of stocks (the top 1500 US stocks by capitalisation, minus financials and utilities) whereas the previous backtesting article mentioned above uses numbers based only on the primary universe (S&P500 - financials and utilities). For this reason the total score and universe return numbers differ.
| Period 1 | Period 2 | Period 3 | Average | Positively | |
| 27th-Dec-07 | 18th-Apr-08 | 24th-Aug-08 | corelated | ||
| 18th-Apr-08 | 24th-Aug-08 | 10th-Oct-08 | periods | ||
| S&P 500 Return | -5.82 | -7.06 | -30.14 | -14.34 | n/a |
| Universe Return | -7.16 | -0.09 | -32.02 | -13.09 | n/a |
| Ratings Performance | |||||
| Top 5 minus Bottom 5 decile returns | |||||
| Total Score | 0.17 | 0.88 | -0.60 | 0.15 | 2 |
| Factors | |||||
| Financial Strength | 1.09 | 4.48 | 0.98 | 2.19 | 3 |
| Technical Strength | 2.09 | -0.65 | 1.70 | 1.05 | 2 |
| Predictability of Earnings & Growth | -1.38 | 0.30 | 2.22 | 0.38 | 2 |
| Quality of Earnings & Growth | -3.91 | 1.42 | 1.60 | -0.30 | 2 |
| Price vs Earnings & Growth | 3.93 | -1.91 | -4.61 | -0.86 | 1 |
| Subfactors | |||||
| Buybacks & Share Supply | 1.42 | 3.22 | 2.82 | 2.48 | 3 |
| Debt & Solvency | 1.96 | 3.37 | 1.16 | 2.17 | 3 |
| Liquidity | -1.31 | 3.88 | 1.54 | 1.37 | 2 |
| Estimates Variability | -1.95 | 0.58 | 4.29 | 0.98 | 2 |
| Earnings Yield | 5.26 | -1.07 | -2.18 | 0.67 | 1 |
| Cash & Cashflow | -0.61 | 3.87 | -1.31 | 0.65 | 1 |
| Internal Rate of Return | -1.48 | -0.15 | 2.82 | 0.40 | 1 |
| Insider Movement | 0.83 | 0.89 | -1.23 | 0.16 | 2 |
| Earnings Surprises | -0.60 | -0.79 | 1.08 | -0.10 | 1 |
| Historical Trends & Consistency | -0.13 | -0.89 | -0.99 | -0.67 | 0 |
| Price Momentum | -0.13 | -3.55 | 0.86 | -0.94 | 1 |
| PEG Metrics | 1.24 | -3.07 | -5.81 | -2.55 | 1 |
| Growth Rates | -5.88 | 1.77 | -4.59 | -2.90 | 1 |
| Organic Business Growth | -5.25 | -1.08 | -2.89 | -3.08 | 0 |
tags: system, backtesting, factors, subfactors
posted: December 3, 2008
Related articles and posts...
An UpdateAfter falling behind with the updates for about 3 months, I've finally made the effort to catch up. As well as stayin...more
posted: April 6, 2009
Portfolios Updated for March (plus Jan, Feb)
After falling well behind in keeping the model portfolio trades up to date, I've finally caught up... The 20/20 portf...more
posted: April 6, 2009
Ratings Updated Finally - 2009-03-20
After a long delay due to a number of factors (losing a job and finding/starting a new one, plus preparing for a wedding...more
posted: April 6, 2009
Portfolios Updated, bug fixed for December
The model portfolios have been updated for December. There was a bug to do with missing prices in the 20/20 portfolio wh...more
posted: January 1, 2009
Ratings Updated - 2008-12-27
After some delay due to the holidays etc., the stock ratings have been updated for December 27th. See the Ratings sectio...more
posted: January 1, 2009
Ratings Updated - 2008-12-07
The Stock ratings have been updated as at the close, December 5th. See the Ratings section for details......more
posted: December 8, 2008
Backtesting at the Factor & Subfactor Level
Following on from the Reviewing the Market Decline & Overall System Performance article which detailed the performan...more
posted: December 3, 2008
Ratings Updated - 2008-11-30
A complete set of new stock ratings has been produced as at November 30th. See the Ratings section for details......more
posted: December 1, 2008
Portfolios Updated for November
The model portfolios have been updated for November. Both portfolios turned over approximately half their holdings. S...more
posted: November 11, 2008
Ratings Updated - 2008-11-09
The stock ratings have been updated for the 9th of November. For more information see the ratings section......more
posted: November 10, 2008