Yes, you can. There is no penalty if you pay off your SBA 504 loan at any time in the second half of the loan’s term. The prepayment penalty in the first half of the term begins at the debenture rate and declines by 10% annually, calculated at six-month intervals.