Welcome to THR!
The moving of dovetail sights CAN be a chore. A good penetrating oil like Kroil can help but the sights fit tightly in their dovetail and can take significant force to move.
Remember, if it was pressed in there, you can move it. You just need to have a secure method of holding the slide....like a strong padded vise, and a non-marring drift to transfer the large hammer impact to the sight.
Yes, some of them seem immoveable but they WILL move if you hit them hard enough.
One other thought...Are you sure the sight needs moved? Most Rugers are pretty spot-on from the factory. If your shots are hitting far from the POA, you might want to check your grip and trigger finger placement.