In most cases, you can’t withdraw money from your tax-advantaged retirement accounts without penalty until you turn age 59 ½. One exception to this rule is funding a home down payment.