Yes
In Fact if you break/damage the draw bar spring (ya know, the extra one they gave you) you have to remove the grips.
If you remove them first take note of how screwed down the screw is so you know how far to go when you reassemble it. Unscrew and the draw bar spring cover will probably come loose (its OK), and the draw bar should stay along with the drawbar spring. The other side of the grip (right side) may or may not just fall off by its self. Also make sure the little notches are equal length on both sides when you put it back together, I believe there are two of them.