Broad Diversification vs Concentrated Index: The Question That Never Goes Away
“To make money they didn’t have and didn’t need, they risked what they did have and did need. That’s foolish. That is just plain foolish. If you risk something that is important to you for something that is unimportant to you, it just does not make any sense.”
— Warren Buffett, on the collapse of Long-Term Capital Management, 1998
For years I have held the total market index and not looked back. Broad, cheap, boring. It has returned approximately 15% annually over the last decade. I have no complaints.
And yet every year the same question surfaces. QQQ - the NASDAQ-100 ETF - has returned approximately 21% annually over the same period. On a $500,000 position, that gap compounds to the difference between $2 million and $3.3 million over ten years. That is not a rounding error. That is a different life.
I have been genuinely tempted. More than once. What kept me from switching wasn't conviction that the total market would outperform — nobody has that conviction honestly. Here is how I actually think about it: three things that matter more than the historical return statistics.
One. Nobody knows. Act accordingly.
Markets have always attracted confident predictions in both directions. Today the debate centers on AI. The bulls will tell you it is just getting started - the infrastructure investment is real, the chip demand is real, and the revenue will follow. The bears will tell you the valuations have run ahead of reality and a correction is coming. Both arguments are coherent. Both have intelligent people behind them. Both cannot be right.
And here’s the thing - neither side knows. As a friend put it recently - and I thought this was sharp - overconfidence in market predictions is usually explained by one of three things: not knowing enough, not thinking clearly, or having something to sell. This applies equally to the AI optimists and the correction predictors. The people calling the market with conviction, on either side, are exhibiting one of the three.
Ignore the noise. Think clearly.
Two. The return gap is an insurance premium.
This is the reframe that changed how I think about the whole question.
The difference in return between the total market index and NASDAQ is not money you’re leaving on the table. Think of it as an insurance premium. You give up some return in exchange for protection against the kind of correction that concentrated indices experience when they fall. It is no different from the health, home, or umbrella insurance you pay every year for peace of mind. It is no different from the managed funds that use hedging strategies to cushion against market corrections - the hedge always has a cost. The broad index is your hedge. The return gap is what you pay for it.
In 2022, QQQ fell 32.6%, while VTSAX fell 19.5% - a 13-point difference on the way down. Looking back at the dot-com crash, the difference was even more dramatic: the NASDAQ-100 plunged roughly 83% from its peak in March 2000 to its October 2002 bottom, while the total market index declined by approximately 50% over the same period.
Like any insurance, the premium varies by time period. Over the last ten years, the performance gap between QQQ and the total market has been exceptionally wide. As you zoom out to twenty years, that gap narrows. And if you go all the way back to QQQ’s inception in 1999 - a period that includes the grueling dot-com crash - the massive volatility of the early years acted as a significant drag. While the NASDAQ-100 has still outperformed the total market over the full cycle, the gap is much tighter than the recent decade suggests.
The recent premium is historically large. That could mean NASDAQ is due for mean reversion. It could mean AI genuinely changes the long-run growth trajectory. Nobody knows which. What you can know is how much premium you’re paying and whether it’s worth it for you specifically.
For someone close to retirement, with a smaller asset base, who needs every dollar of their liquid portfolio to fund their life - the insurance is probably worth the premium. A large correction at the wrong moment is unrecoverable. For someone with a large core position, decades of runway, and money they genuinely don’t need to touch - there is more latitude to carry concentration risk.
The size of the premium depends on when you measure it. How much insurance you need depends on where you are in life. Both questions are worth answering honestly before making any move.
Three. Know when is enough.
This is by far the hardest part of any financial decision. Not the math. Not the market analysis. Knowing what you actually need — and being honest enough to stop once you have it.
Establish a goal. It can be ambitious. A stretch goal is fine. But it has to be a concrete goal, not a direction. Most investors don’t have a specific number. They have a direction — more. As much as possible. Maximum return. That feels like ambition. It is actually a trap.
Without a number, every performance gap becomes a crisis. NASDAQ outperforms for three years and you question your strategy. It crashes and you feel vindicated, then watch it recover and question yourself again. You are not investing. You are reacting to every market move.
A goal is the thing that cuts through the noise. It is the portfolio size at which your life is funded — your retirement, your obligations, the margin you need to sleep at night. Once you have it, the broad index versus concentrated index question becomes irrelevant. And once you reach it, stop chasing more. At that point, reaching for higher returns means risking what you need for what you don’t need — exactly what Buffett has warned against.
So what would I do?
My core position stays in the total market index. I know my goal - what I need my portfolio to be to fund my life and retirement. It is ambitious but not out of reach. And my current trajectory gets me there comfortably with the broad index alone. At that point, the insurance premium is worth paying at any level. I am not leaving money on the table because it is not the money I need anyway. I am buying peace of mind I can actually afford.
Nobody is perfect of course. Sometimes a higher return is hard to resist even when you know you are fine without a more aggressive investment. If the NASDAQ returns keep calling and I want to scratch that itch, there is nothing wrong with a small position - call it play money, call it a controlled bet. But no more than 10% of my portfolio. And if I do, I put it in the retirement account I am least likely to touch — the one I think of as the legacy bucket, the one my kids will inherit, not the one I am drawing from in retirement.
That account has the longest time horizon of anything I own - long enough that even a significant correction becomes a temporary setback rather than permanent damage. There are no tax consequences to switching if the bet stops making sense. And I don’t need the money, which means I can hold through volatility without being forced to sell at the wrong moment.
If I were in early retirement and drawing from my portfolio for living expenses, I would skip the speculative position entirely - a correction hits my spending directly and forces me to sell at the worst possible moment.
And if my core position were not large enough to fund my life comfortably in the first place, this would not be the time for a bet. The hardest part is being honest about this. It is easy to tell myself the position is small enough not to matter, that I can afford to lose it, that it is truly play money. The real question is whether I would actually be fine if it loses 80% of its value tomorrow.
The questions worth asking
Every time the temptation surfaces - and it always does, again, and again - I come back to the same questions:
One: What is my specific goal - the portfolio size at which my life is funded and I am done?
Two: Does my current trajectory reach that goal with the broad index alone? If yes, stay where I am. It does not make sense to risk what I need for what I don’t.
Three: If I want to play for fun, could I lose this entire position without it affecting how I live or retire? If no, it stays in the broad index.
Two key insights changed how I think about the choice between broad diversification and concentrated index:
The first: knowing what I need made the NASDAQ return gap irrelevant - I do not need it to get where I am going.
The second: the return I give up is not money left on the table. It is a premium I pay willingly for protection on the downside.
Once you see it that way, the question stops feeling like a dilemma.
I am not a financial advisor. Nothing in this newsletter is investment or tax advice. Fine Print Investing publishes weekly.