In the first post of this series, we introduced the idea of a disciplined, evidence-based framework for investing. That framework begins with a simple question:
How do markets actually work?
Before deciding what to buy, when to buy, or how to structure a portfolio, it helps to understand the environment in which all investing decisions take place.
One of the most important realities is this:
Markets are highly competitive — and that makes them very difficult to consistently outperform.
Understanding why can change the way you think about investing.
What “Beating the Market” Really Means
When investors talk about “beating the market,” they usually mean earning returns higher than a broad benchmark, such as the S&P 500 index.
But that benchmark isn’t passive or uninformed.
It represents the collective decisions of:
- Professional portfolio managers
- Institutional investors
- Pension funds
- Hedge funds
- Insurance companies
- Individual investors
- Algorithmic trading systems
All of them are analyzing information, adjusting expectations, and competing to buy undervalued assets and sell overvalued ones.
When you buy or sell an investment, there is someone on the other side of that trade. That person believes the opposite of what you believe — and is often just as informed.
In some cases, the counterparty may be a sophisticated institution such as Renaissance Technologies, founded by mathematician Jim Simons, whose firm became known for applying advanced quantitative methods to financial markets.1
That is what makes markets competitive.
Prices Already Reflect Widely Known Information
Public markets incorporate new information quickly.
Earnings reports, economic data, interest rate decisions, geopolitical events — all of this becomes reflected in prices as investors react in real time.
By the time a news headline reaches you, thousands of market participants have already processed it.
This idea is consistent with academic research associated with Eugene Fama and the efficient market hypothesis, which suggests that market prices incorporate widely available information rapidly.2
This doesn’t mean markets are perfectly efficient or never make mistakes. It does mean that consistently identifying and exploiting mispricings is extremely difficult — especially after accounting for costs and taxes.
Skill, Luck, and the Long Run
It’s important to distinguish between short-term outcomes and long-term evidence.
In any given year, some investors will outperform the market. Over a few years, some may continue to do so. But over longer time horizons, the number of managers who consistently outperform shrinks dramatically.
This doesn’t imply that skill doesn’t exist. It does suggest that:
- Skill is rare
- It is difficult to identify in advance
- It is difficult to access at low cost
- It often disappears after fees
In competitive markets, excess returns tend to get competed away.
The challenge is separating genuine skill from random variation — a problem explored extensively by Nassim Taleb in Fooled by Randomness.3
Independent research, such as the S&P Dow Jones SPIVA Scorecards, has historically shown that many active managers have underperformed their stated benchmarks over longer time horizons, and that persistence of outperformance has been limited.4
The Arithmetic of Active Management
There’s also a simple mathematical reality.
Before costs, the average actively managed dollar must earn the market return. After costs, the average actively managed dollar must underperform.
This isn’t an opinion — it’s arithmetic.
William Sharpe formalized this logic in his paper The Arithmetic of Active Management.5 The insight is straightforward: because active managers collectively make up the market, their aggregate return before costs equals the market return. After fees and trading expenses, the aggregate must lag.
Jack Bogle frequently reinforced this same point in his writing and speeches: in aggregate, investors cannot all beat the market because they collectively are the market — and costs matter.6
Fees, trading costs, and taxes all reduce investor outcomes. In a highly competitive environment, those frictions compound over time.
Why This Matters for Individual Investors
If markets are difficult to consistently beat, that has implications.
It suggests that long-term success may depend less on:
- Predicting economic events
- Identifying the next winning stock
- Moving in and out of markets at the right time
And more on:
- Designing a sound portfolio
- Controlling costs
- Diversifying effectively
- Maintaining discipline through uncertainty
In other words, understanding market competitiveness supports the disciplined framework introduced earlier.
What This Does Not Mean
Recognizing that markets are difficult to beat does not mean:
- Markets are perfectly rational
- Prices are always correct
- Active management is impossible
- Investors should never make adjustments
It means only that consistent outperformance is rare and difficult — particularly after costs.
That reality should inform how we design portfolios and set expectations.
Where We Go From Here
If markets are competitive and difficult to consistently outperform, the next logical question is:
What risks are investors actually compensated for taking?
In the next installment, we’ll explore the relationship between risk and return — and why higher expected returns require accepting uncertainty.
Understanding that relationship is central to building a disciplined, long-term investment framework.
There is no guarantee that a diversified portfolio will enhance overall returns or outperform a non-diversified portfolio. Diversification does not protect against market risk.
- Gregory Zuckerman, The Man Who Solved the Market (2019). ↩︎
- Eugene F. Fama, “Efficient Capital Markets: A Review of Theory and Empirical Work,” Journal of Finance, 1970. ↩︎
- Nassim Nicholas Taleb, Fooled by Randomness (2001). ↩︎
- S&P Dow Jones Indices, SPIVA U.S. Scorecard (various editions). ↩︎
- William F. Sharpe, “The Arithmetic of Active Management,” Financial Analysts Journal, 1991. ↩︎
- John C. Bogle, The Little Book of Common Sense Investing (2007). ↩︎
