I've been hearing for a while that carrying your firearm concealed "off hours" in NYS isn't that big of a deal if you have a "target and hunting" restriction.
Apparently the worst that can happen is, if you're caught, your permit can be revoked, which is actually quite unfortunate, because it's a permit to own the handguns as well, so you can lose the firearms themselves (although your long guns aren't in any peril).
I've been given "advice" from the guys at my shooting club that it's no big deal to carry off hours, that if you conceal skillfully no one will ever know, and if you're discovered, most cops will give you a pass unless their reason for checking you out was related to something blatantly criminal.
However, I'd rather not take that sort of risk. Why subject yourself to an officer's whim? Perhaps the vast majority of police feel that "Hey, this guy with the suspicious bulge in his clothes has a pistol permit, which requires a class and lots and lots of paperwork and background checking, so I'm sure he's a good guy" - but what about the one officer that feels that he has to follow the exact letter of every law, rule and regulation? Or perhaps worse yet, doesn't like the idea of non-LEO carrying, and decides to stick on a BS charge, like "disorderly conduct?"