That's because you haven't seen it going the other way. It is totally convincing in all aspects in both directions. As I mentioned, if you look at the individual frames of the gif, she actually alternates doing both, going 90 deg one way, 90 back (facing backward), 180 deg one way (to face forward), 90 deg back (still facing forward), etc. Looking at that, you can see how the silhouettes would be/are the same.
It is very difficult for me to get it to switch at will with both eyes but guess what -- it is very easy* if you cover you one eye at a time (with my right eye I see it counter clockwise, with my left clockwise). So it really is "the hemispheres".
* but not quite automatic