Finally got around to googling this and luckily there is a way to get rid of that ugly WordPress admin bar that sticks itself to the top of your WP site.
[Updated: 3.8.11 at 10:24 AM]
Twitter follower @Preshit wrote to tell me you can disable this in your user options (in your user profile). I had no clue, that is way easier.