Yes, that is the 'native' position for a correctly orientated landscape pic, on an iPhone, anyway. Camera is then top left.
It gets bit trickier if you want to upload a pic taken with the button at the bottom for a 'portrait' orientation, as the camera is then top right.
The upload pics software does not seem to like pics taken in portrait, so tends to turn them over to an on-the-side landscape orientation, as you found - corrected by our own Mod Shrew.
Maybe Shrew might come in here with a clear explanation as to how he corrects pics that appear on their side..?
'cos I'm not completely sure I know how to do that myself, and I'm a mod as well. Hey, we don't claim to know everything.