I never wear flip-flops b/c I think they just look super messy. Of course, this doesn't apply to all flip-flops. I'm mostly thinking of the cheap rubber ones from Old Navy. I suppose the Tory Burch ones are quite cute, though...
I would wear flats, skimmers, or sandals that have more aesthetics than flip-flops. Flip flops are only necessary for water activities.