Susan Taylor
Most people have no idea how much money they’re quietly sitting on inside their 401(k). According to Vanguard’s 2025 How America Saves report, the average 401(k) balance for participants in their 40s is around $132,000. That’s a meaningful down payment on a house, locked inside a retirement account. No surprise, then, that I watched dozens of borrowers come through the door wanting to crack it open.
Here’s the thing I wish someone had told them upfront: using your 401(k) for a down payment isn’t one move. It’s two very different moves with completely different consequences, and confusing them is how people end up with a five-figure tax bill they didn’t see coming.
- You have two options: a 401(k) loan (borrow and repay) or an early withdrawal (take it and pay taxes + penalty).
- Early withdrawals before age 59½ trigger ordinary income tax PLUS a 10% penalty on the full amount withdrawn.
- A 401(k) loan lets you borrow up to $50,000 (or 50% of your vested balance, whichever is less) with no tax hit if repaid on time.
- If you leave your job while a 401(k) loan is outstanding, you may owe the full balance back in 60-90 days or face taxes and penalties.
- The long-term cost of pulling money from retirement can be 2-3x the withdrawn amount in lost compound growth over 20+ years.
The Two Paths, and Why They’re Not Equal
A 401(k) loan and a 401(k) withdrawal sound like variations on the same thing. They’re not.
With a loan, you’re borrowing from yourself. The IRS lets you take up to $50,000 or 50% of your vested account balance, whichever is smaller. You pay yourself back, typically over five years, with interest (that interest goes back into your own account, which is one of the nicer quirks of this option). No tax hit, no penalty, as long as you repay it according to the terms.
With an early withdrawal, you’re taking the money out permanently before age 59½. That triggers ordinary income tax on every dollar pulled, plus a 10% early withdrawal penalty on top. So if you’re in the 22% federal bracket and you pull $40,000, you’re looking at roughly $12,800 gone before you buy a single doorknob. Some states add their own income tax on top of that.
I had a client once, Maria, who withdrew $45,000 from her 401(k) thinking she’d “worry about taxes later.” Her tax bill the following April was $14,400 in federal taxes plus a $4,500 penalty. She was genuinely blindsided. The IRS doesn’t give you a grace period to feel surprised.
The loan path is almost always the better option if your plan allows it. But it comes with a trap most people don’t see coming.
The Hidden Trap in a 401(k) Loan
Helpful resource: The Total Money Makeover by Dave Ramsey is a top-rated option for this. (As an Amazon Associate this site earns from qualifying purchases.)
Here’s what most people don’t realize until it’s too late: if you lose your job or quit while your 401(k) loan is outstanding, the remaining balance typically becomes due within 60 to 90 days. If you can’t pay it back in that window, the IRS treats the unpaid balance as a distribution, which means taxes and the 10% penalty kick in retroactively.
I’ve seen this happen. Someone takes a $35,000 401(k) loan to buy a house, then gets laid off eight months later. Suddenly they owe back $32,000 in under three months or face a tax bill they weren’t expecting. Owning a home doesn’t make that easier to absorb.
This is the part that the mortgage officer at the closing table won’t walk you through. They’re thinking about the deal in front of them.
What the Numbers Actually Look Like
Let me show you the real cost comparison side by side, because the math is where opinions get replaced by facts.
| Option | Upfront Cost | Tax/Penalty | Repayment Required | Job-Loss Risk | Long-Term Retirement Impact |
|---|---|---|---|---|---|
| 401(k) Loan (repaid on time) | None | None | Yes, ~5 years | High (balance due if you leave) | Moderate (lost growth during loan period) |
| Early Withdrawal (under 59½) | Tax + 10% penalty | ~22-32% of amount, depending on bracket | No | None | Severe (money is gone permanently) |
| Roth IRA Contributions Withdrawal | None | None on contributions | No | None | Low (contributions only, not earnings) |
| Regular Taxable Savings | None | Capital gains tax possible | No | None | Minimal |
The Roth IRA row deserves a moment. If you’ve been contributing to a Roth IRA, you can pull out your contributions (not earnings) at any time, for any reason, with zero taxes or penalties. This is one of the most underused options in the down payment conversation. The Consumer Financial Protection Bureau flags this distinction in their homebuying guides, and it’s worth reading if you have a Roth sitting around.
These figures assume federal tax only. Add your state income tax rate for the real number.
The Compound Growth You’re Walking Away From
This is the part of the conversation that makes me a little uncomfortable to deliver, because the math is genuinely painful.
Fidelity’s retirement research suggests that $1 invested at 30 grows to roughly $7.61 by age 65, assuming a 7% average annual return. So when you pull $40,000 out of your retirement account in your early 30s, you’re not giving up $40,000. You’re giving up somewhere in the range of $304,000 in future value. That’s not a hypothetical meant to scare you. It’s just what compound interest does over 30-plus years.
A 401(k) loan is less damaging because the money eventually goes back. But during the repayment period, those funds aren’t invested, so you still lose some growth. For a $50,000 loan paid back over five years, you’re probably missing out on $15,000 to $20,000 in compounding, depending on market conditions. That’s meaningful, though far more recoverable than a permanent withdrawal.
Worked example 1: James, 34, takes a $40,000 early withdrawal to put 10% down on a $400,000 home. After taxes and penalty (22% bracket), he nets about $27,200. His actual down payment purchasing power: $27,200, not $40,000. He also permanently removes $40,000 from his retirement account. At 7% average return over 31 years, that’s roughly $305,000 in lost future retirement savings.
Worked example 2: Priya, 36, takes a $40,000 401(k) loan instead. She nets the full $40,000. She repays it over five years at 6% interest (back to herself). She loses roughly $18,000 in estimated foregone growth during the repayment period. Net cost: far more manageable, and her retirement account is whole again by 41.
Worked example 3: David, 38, realizes he has $28,000 in Roth IRA contributions. He withdraws $25,000 of that, pays zero taxes or penalties, and uses it as part of his down payment. His 401(k) stays fully intact. This is the cleanest path, and it surprises a lot of people that it’s even available.
Before You Touch It, Talk to Someone Who Isn’t Selling You Anything
I want to be protective of you here. The mortgage lender wants to close your loan. The real estate agent wants to close the deal. Neither of them has a financial incentive to tell you to wait, save more, or find a different source for your down payment.
HUD-approved housing counselors offer free or low-cost guidance, and they’re not selling you a mortgage or a house. If you’re seriously considering pulling from your 401(k), an hour with one of them, plus a conversation with a fee-only financial advisor, could save you from a decision you can’t undo.
Also worth knowing: some first-time buyer programs, including certain state housing finance agency loans and FHA options, allow down payment assistance that could reduce or eliminate the need to touch retirement funds at all. As of July 2026, programs vary significantly by state, and eligibility requirements change. I don’t have good, current data on all fifty states’ programs, so I’d encourage you to check your state’s housing finance agency website directly.
If you want to run your own numbers first, a solid home affordability calculator or mortgage workbook (Amazon link, site may earn a commission) can help you map out whether a different down payment amount changes your monthly payments enough to justify the retirement account math.
Sources
- Vanguard, “How America Saves 2025”: Annual report on 401(k) participant behavior and average balances by age cohort.
- IRS Publication 575, Pension and Annuity Income: Authoritative source on early withdrawal rules, exceptions, and the 10% penalty.
- IRS Retirement Topics: Loans: IRS guidance on the $50,000 loan limit and repayment rules.
- Consumer Financial Protection Bureau, Owning a Home: Plain-language guides to down payments, mortgage options, and Roth IRA rules for homebuyers.
- Fidelity Investments, Retirement Research: Compound growth projections and retirement savings benchmarks.
Photo: Pavel Danilyuk via Pexels
This article is for educational purposes only and does not constitute financial or mortgage advice. Mortgage rates change daily and vary by lender, loan type, credit profile, and property details. Consult a HUD-approved housing counselor (find one at hud.gov) or licensed mortgage professional for guidance specific to your financial situation.
Recommended Resources
Disclosure: As an Amazon Associate, we earn a small commission from qualifying purchases at no extra cost to you. We only recommend products that genuinely support the topics covered in this article.
- First-Time Home Buyer: The Complete Playbook (~$18), The #1 Amazon bestseller in homebuying, covers down payment strategies, mortgage pre-approval, and avoiding rookie mistakes.
- 100 Questions Every First-Time Home Buyer Should Ask (~$17), Nearly a million copies sold, covers every question to ask your lender, agent, and inspector before signing anything.
