The town I live in is infested with fratboys.
When I'm carrying, and they start to give me a hard time (which is a pretty common occurrence with these neanderthals), I just smile and walk away.
When I'm not carrying, I occasionally give them a hard time right back.