If it is required for retirement or the kids' college, it may perhaps make additional sense to invest—a payoff is a lot more specific down the road, even if it does not quantity to a sexy six-figure check.