I feel you, I am also one of those poor bastards constantly being corrected about what color something is, however that doesn't mean they're missing, they're just hiding from us.
My partner is tetrachromatic so I see way less colours than them. Apparently. Maybe it's all a big joke by paint companies and only a couple of colours exist.