You bet!
At 37 years old, I've got moderate hearing loss in my left ear and slight hearing loss in my right. If more than one person is talking near me, I have a heck of a time picking out individual words. It sucks. My kids get fed up with me for having to say "Say again?!" constantly.
While I'm sure some of it is from listening to too-loud music, most is from firearms (and other Army-issued pyrotechnics). Whenever feasible, I've always worn hearing protection... with the major exception of being in the field.
Well, last year I started noticing my hearing was worsening... tinnitus getting louder... normal sounds muffled.
So, I now wear hearing protection each and every time I'm shooting. When hunting, I've got some Peltor Tactical 7 Surrounds, which do a pretty good job of letting me hear. However, they are cumbersome. The last few times I've been out, I've worn some custom-molded plugs, and that's worked well.
In fact, I now carry those plugs with me almost all of the time, and put them in anytime the noise-level goes up too much (mowing the lawn, at a bar/restaurant with a live band, the kids singing in the car
).
You only get one chance to keep your hearing intact. If it gets damaged, then it can't really be fixed. Use pro every chance you get!