These people sound like the kind of "friends" I once had when I was into "partying."
A number of years later, when I looked back on our "friendship" - the folks that I once considered to be 'my friends' weren't, in reality, friends at all - but instead were simply people I could party with. I never had a motorcycle, but I suppose, if I had, then the only difference in this 'equation' would have been that we also "rode together."
I think you are seeing immature people doing immature things. To me, you sound like you are much more mature than any of these people who seem as though they have nothing better to do than see how much they can get you riled up.
I would not hang out with them.
I would be polite, but I would give them the cold shoulder.
I would not go anywhere they invite me to go and I would start hanging out with people who have a sincere respect for both shooting sports and for me (and my safety).
In time, either you will never see them again, or they will ask you what happened.
That is the time when you can be honest and tell them how serious you take guns and shooting sports.
If they don't get it, then they have a LOT more growing up to do (in which case you will know for certain that you made the RIGHT DECISION when you did)!