I don't know the terminology, but I think it's because it's a direct indirect. It's like saying, "you there" instead of referring by name or using like, "excuse me sir/ma'am" or even skipping the direct call out altogether and saying, "could I get some help"
Basically it skips all formal addressing and is like using slang to people unfamiliar. If you are familiar then it's rude because you should know their names. I think the main time something like that is used is in an informal setting where nobody is actually familiar with each other, or in a scenario where immediate direction is required without prior familiarity.
I guess I was trying to frame my question as hearing someone say to a couple “you two” feels like they don’t view them as a couple but as 2 individuals or 2 people not as a couple. Just my feeling.