I have to admit the same too. I'm a huge fan of Nintendo and other Japanese gaming giants but I don't watch anime or read manga regularly. I have watched something like Hayao Miyazaki's movies, Evangelion, Berserk, Dragon Ball and some popular others as it's "common knowledge of popular culture".
To be fair, most Western shows are trash these days, too. There's a few standouts, and plenty of them are still the stupid kind of enjoyable in spite of being trash, but that's true of anime, too. Most modern media has just unfortunately become a vehicle for making money, not a vehicle for making art.
Anime is often very mind numbing, with some exceptions of course. I have a much better time reading manga when I get the urge every few years, when I try to watch "normal" animes (not critically acclaimed/advanced stuff), I cannot get into it.