Move the rear sight in the direction you want the grouping to go, move the front sight in the opposite direction. Generally your adjustment is done with the rear sight, but there is room to play with the front, e.g., moving it sideways in the dovetail (if equipped), swapping for one of a different height, or even removing/adding material or bending it, as you might find on some fixed-sight revolvers.
