Don't be overly worried or paranoid about cops not caring for CCF citizens.. most don't care. If he had an issue with it, he would have likely removed it from within your reach for the duration of the stop, had you do so, or had you at least clear it.
As far as his "tone" goes, I can't comment on it, since you cannot replicate it here for us to try to interpret. You heard what you heard, and took it as it came across to you.
Before I was ever a LEO, I was involved in a traffic accident, and the responding officer somehow guessed I had a gun in my truck. When she leaned in to record my odometer reading, she asked "where's your gun?" (It was holstered, and in the glovebox.) I told her, and she retrieved it. She asked if I minded if she unloaded it. I didn't, and suggested she put the rounds (.357) in the ashtray, which she did. She then put the re-holstered magnum back in the glovebox, and not another word on it was said. I took no offense. I never did figure out how she knew I had one, though I was delivering pizza at the time. Maybe it was common knowledge in LE circles that pizza guys carry.
(In my state of Florida, containered carry, such as in a glovebox, whether or not locked or holstered, of a loaded handgun without a CCF permit is permitted by law.)