Completing errands by bike is the perfect way to go. Pull up near the front door of any establiment, lock the bike to a pole or—if you're lucky—a bike rack. If I'm away from the bike for five minutes or less, no sense removing the helmet. As for bike gloves, well, let's just say they're like a second skin.
What are your rules for bike attire?