Sure, but the further you move toward the tails of the distribution the stronger the competition. All men will date short women, but short men can only date shorter women and they're still at a disadvantage. Tall women have a similar problem - they only want men who are taller than them, which just happen to be the most attractive men for every other woman they're competing with, too.
I'm 5'3 every woman I've been with has been the same height or taller than me. I never found my height to be that much of a limiting factor. Sure a lot of women aren't interested in me because of it but there's a lot of women not interested in a lot of dudes for a lot of reasons and vice versa. I, for instance, am not into heavy women or women with kids. It's a numbers game and getting in your own head about it and being an asshole when someone doesn't vibe with you is far worse for your chances than height itself.