I agree with your friend, but you do have to be careful. What is right and what is legal or convenient are not always the same thing. I still have not gotten a permit yet, but I plan to before it gets cold enough for me to carry on a regular basis again.
If I had to defend myself and did not have a permit it could make me look like the bad guy. Given how the legal system works I really don't need anything else going against me after I shoot someone. Plus it would increase the odds of me spending a night in jail even though unlicensed carry is only a gross misdemeanor.
The only time in my life I have ever been searched or patted down was when I told an officer that I was heading to a shooting range after he asked where I was headed. He had stopped me for riding a motorcycle with my helmet's visor up (I was only going a few mph up to a stop sign). He then asked if I had a CCW permit, which I replied not yet, he then asked if I had any weapons on me. Luckily I had just met some THR members a bit earlier and one of them had put my rather heavy backpack in his car so I was legal at that moment. That could of been bad, it also could have been completely avoided had I either obeyed the silly traffic rule that should not apply at low speeds, or had not said anything incriminating.
Sorry for rambling, anyway. If you are careful or do not carry often in my opinion you do not really need one if you look at it from a practical sense. You could also argue that the more people we have with permits out there the better it makes our side look.