New front sight for a mossberg 835

[simonstough]

So I traded an old .22 for a mossberg 835 for duck, turkey and deer hunting with occasional trap shooting. I know I need a new barrel for deer since the stock one is overbored and can't shoot slugs. But I'm looking at replacing that junky white dot for birds, I found a dead ringer duck buster/turkey buster combo that has pretty good reviews I like it a lot and the price isn't bad, around 25 bucks, but if I take the rear sight off to shoot trap will I be able to put it back on and keep a similar point of impact? Or would I be better with a fiber optic light pipe and no rear?