Since mortgage rates are at all-time lows, refinancing should be a no-brainer for just about everyone—or so you would think.

But not everyone has refinanced or even will.

Are there times or situations where refinancing isn’t worth doing, even to get lower rates? There are at least a few, and here are some of them.

7 Reasons You Shouldn’t Refinance Your Mortgage

1. When you have credit problems



A few years ago, you’d be able to refinance your home even if you had bad credit.

Your rate would have been adjusted higher due to the credit issues, but you would have been able to complete your refinance.

Today, you might get a loan if your credit is slightly impaired, and at that you’ll pay a higher rate. But if it’s anything worse then that a refinance will be out of the question.

You may have an option under some sort of streamline refinance where the lender only looks at your recent mortgage payment history. But if you’ve had a couple of late mortgage payments in the past year, that option will likely be out as well.

2. Closing costs exceed the benefit of a lower payment

Closing costs for a mortgage can amount to several thousand dollars, and this can sometimes call the wisdom of a refinance into question.

This is especially true if your loan is small, say under $50,000. Paying $3,000 or $4,000 in closing costs to lower the payment on your loan by one percent probably won’t be worth the cost.

Closing costs are usually handled in one of two ways, either they’re added to the new loan balance, or you pay them out of pocket. If you were to add the closing costs to a small mortgage, you’d be adding a substantial amount of principal to the new loan. If you were to pay it out of pocket, it would take years to recover the costs through lower payments.

3. Mortgage has only a few years left

If you have less than ten years to go on your mortgage, you might be better off to leave the loan as it is and continue to pay it off. Any money you would pay for closing costs under a refinance could instead be paid toward the existing loan to pay it off sooner.

Much will depend on how much you’ll save on the rate too. If you can drop your rate by at least two points it might still be worth refinancing on a short term loan. But on a single point drop—probably not.

4. Rates don’t justify a refinance

Some people have become serial refinancers, refinancing their loans at every drop of interest rates.

If you have a 4.50% rate, and rates have fallen to 3.75%, it may not be worth paying several thousand dollars in closing costs to get it.

5. Your income can’t be verified

Like mortgages for the credit impaired, it’s close to impossible to get any sort of mortgage without having to verify your income.

Until about five years ago it was quite common to get a mortgage without any income verification, and if that’s how you bought your home, you won’t be able to do again with a refinance. Lenders want to know your income now. Believe me, they will go through your records with a fine tooth comb making sure everything is in order.

Once again, a streamline refinance may offer some hope (but not always). Streamline refinances are mortgages you take with the same lender, and if you’ve been making your house payments on time, a new loan at a lower rate may be granted without all of the traditional loan documentation requirements.

Some of these programs may allow you to do a refinance without verifying income, but if you do, it will usually be strictly a rate and term refinance. You won’t be able to take out additional cash, nor will you be able to consolidate a second mortgage into the new loan.

6. You don’t plan on staying in the house

If you’re pretty certain that you won’t be in the house two or three years from now you probably don’t want to refinance.

The primary benefit of refinancing is in the years of savings you get from a lower interest rate. After two or three years you’ll roughly break even. That probably isn’t worth paying several thousand dollars in closing costs for.

7. Insufficient equity

This is a problem for a lot of homeowners today.

It’s not just the problem of being underwater on your mortgage (owing more than the house is worth) but also of diminished equity. If your loan was 80% of the purchase price of the home when you bought it, and declines in property values have caused the loan to now be 90% of the value, you’re looking at a different loan situation. Now you will need private mortgage insurance, and that will remove much or all of the benefit that a lower rate will bring.

There are programs that will allow you to refinance your mortgage without mortgage insurance, even if you have less than 20% equity. But many of those programs depend on your circumstances, such as income level or being in a distressed situation.

Related: If you still think a mortgage refinance is for you then check out local rates.]

Finally

As you can see, refinancing doesn’t work for everyone despite what look to be obvious benefits. Don’t think you have to refinance because rates are low. Make sure you understand your circumstances before you jump into a mortgage refinance.

Sometimes you just shouldn’t refinance your mortgage!

Can you think of any other reason why you shouldn’t refinance your mortgage? Tell us in the comments!