The IRS has what is called a first time abatement of penalties. So if this is the first time in a 3 year span you owe you can have the penalties (not interest) waived.
It's the failure to file and failure to pay penalties. The tools we have do a 3 year lookback from the tax year in question for these two penalties and if they don't exist in those three years we can abate any and all of those penalties that would accrue for that tax year.
I believe it was my 2021 taxes (meaning I filed in 2022). Think I still have a shot? I don't remember how much it was but it was definitely more than zero.