What's the difference between penalties and interest?

Penalties encourage timely filing and payment.

Interest compensates the State for the late payment of tax and continues to accrue until the liability has been paid in full.