A $10,000 investment made in 1980, left alone through every crash, every scare, every “this time it’s different” headline, would have grown to roughly $1.082 million by 2022. Miss just the 30 best trading days over that stretch, and you’re sitting on $173,695 instead. Same starting money. Same time frame. Nearly a million dollars vanished — not because of a crash, but because of bad timing and panic.

That number comes from a Fidelity model that AARP recently spotlighted, and it tells you almost everything you need to know about the biggest threat to your retirement savings. It’s not the market. It’s you.

The Early Withdrawal Trap

Fidelity is reminding workers about something that catches more people than you’d think: pull money out of your 401(k) or traditional IRA before age 59-and-a-half, and you’re hit with a 10% federal penalty on top of regular income taxes. That’s real money walking out the door.

“Will you need access to funds before age 59-and-a-half?” Fidelity asks. “While you should strive to keep your retirement savings earmarked for retirement, sometimes life throws a curveball.”

Here’s what that actually means for you: if you withdraw $50,000 early from a traditional 401(k) and you’re in the 22% tax bracket, you could lose $16,000 between taxes and the penalty. That’s not a rounding error. That’s a year of groceries.

Fidelity points out one key distinction worth knowing. Roth IRA contributions — money you already paid taxes on — can come out tax-free and penalty-free anytime. But touch the earnings too early, and you’re back in penalty territory.

“Contributions to Roth IRAs, including those rolled over from a Roth 401(k), can be accessed tax-free and penalty-free at any time,” Fidelity added. “If you withdraw more than your contributions, you may be subject to taxes and penalties.”

Roth accounts also dodge required minimum distributions, so your money keeps compounding as long as you let it. Traditional accounts force you to start pulling funds at 73 whether you need them or not.

The Real Danger When Markets Drop

With stocks getting choppy lately, AARP is waving a flag at anyone tempted to bail on their 401(k) strategy. Their message is blunt.

“Don’t make knee-jerk decisions regarding your 401(k) when the market plunges,” wrote AARP. “Stay calm and keep up with your contributions. That may not sound very exciting, but it is generally your best option for lasting wealth, research shows.”

CFRA Research chief investment strategist Sam Stovall backs that up with data: stock market drops of 5% to 9.9% typically recover in about six weeks. Corrections between 10% and 19.9% bounce back in under four months. The market has a long memory for growth and a short one for dips — if you stay in the chair.

But staying in the chair is the hard part, especially if your entire 401(k) is riding on stocks. AARP says that’s a recipe for panic selling.

“One way to avoid that emotional response is with proper asset allocation, with your portfolio spread out between asset classes,” AARP suggested.

“Have some stable things in your portfolio like certificates of deposit, cash and bonds,” said Rob Williams, managing director of financial planning at the Schwab Center for Financial Research. “(A diversified portfolio) will provide a cushion, so you have some money that won’t move around in value as much. That knowledge will keep you from any extreme reactions.”

What Smart Money Does During a Downturn

“Short-term blips can be buying opportunities,” said Dan Egan, director of behavioral finance at investing platform Betterment. “It’s a good time to get stuff on sale.”

“In the short-term, things feel scary,” he added. “But it is actually a nice moment to take advantage of other people’s panic.”

That’s the part most headlines skip. A down market only destroys wealth if you lock in the losses by selling. If you’re still contributing to a 401(k), a dip means you’re buying shares cheaper. That’s not spin — it’s arithmetic.

Two things to keep straight: don’t raid your retirement accounts early and hand the IRS a bonus, and don’t let a rough quarter talk you into abandoning a strategy that works over decades. The difference between $1.082 million and $173,695 wasn’t the market’s fault. It was 30 days of missing out because someone flinched.