A lot of these people went out and committed crimes during the pandemic and would not wear masks, even when masks would have helped in evading recognition by security cameras and the police. Pettiness or personal inconvenience or a skewed cost benefit analysis may not be the real problem: they're polarized in a completely opposite direction from us, and at their worst, they actively seek to harm society and the people in it.
From what I have gathered in conversations over the years, during the next pandemic, if and when a biological threat emerges that is severe enough that we will actually have to mandate masks or vaccination or quarantine, that many will start shooting or committing other acts of stochastic terrorism, or interfere with public health in other malicious ways. I've heard enough threats amounting to the same already. A lot of them are far fucking gone, and only going to get worse.