Can you separate the artist as a person from the music?
For example, I personally can't listen to Guns and Roses without immediately thinking "that Axl sure is an asshole", and that sours the entire experience.
Generally I don't have a hard time separating the art from the artist. And it's probably bad and selfish, but if I had to stop listening to David Bowie, Eric Clapton, and John Lennon, I'd be so depressed. The world is deeply shitty, so I'm hanging on to whatever happiness I can find. ¯\_(ツ)_/¯
I had to look this up, didn't know about Bowie. He had underage groupies, at least as young as 15 (Lori Mattix). Apparently she remembers that time fondly, but today we would rightly call it coercion and pedophilia. She was treated kindly, probably given all the drugs she "wanted", but that's still a child.
There's a counter argument about how later in life, he refused a kissing scene between him and Jennifer Connelly during Labyrinthe, and that shows he understands the age gap is wrong.
I don't regularly listen to David Bowie. I can sometimes separate the art from artist, but I'm now gonna have trouble knowing he was having sex with (raping) a 15 year old girl.