When inserting an image into a post, you can set the alignment and even add a caption.  Unfortunately, when you view the page/post preview, it looks nothing like it does in the WYSIWYG editor.  This is due to some CSS being left out of your theme’s stylesheet.

WordPress generates classes for alignment and position of your image captions.  Insert these classes into your theme’s CSS to get the full effect: