But arent the ones from the circle 90 degrees on the inside of the circle as well? The squares could've just as well been placed on the other side of the (circle) lines.
No, the two angles are not equal. Outside/inside angles add up to two π radians. A square has four interior angles of 1/2 π radians, and four exterior angles of 3/2 π radians.