What does "upstate" mean in the US?

I hear it in movies so the time. We're going upstate. I went upstate. Etc

I never hear downstate, or similar. Does it just mean going north?