I've used my punch set to remove some tight sights in my day.
Until today, the biggest pain in the rear were the sights on my XDM 5.25.
I beat on that thing for probably 15 minutes before I could get it to budge,
I bent a punch and said some things I shouldn't have said, but finally...