I think the most realistic option for an instance would be to have toggleable ads (off by default). And if you turn it on, maybe you get a supporter badge on your profile page.
There are a ton of ways to detect ad blockers. They could detect an adblocker, but instead of requesting they turn it off like most websites, just take away the badge.