KMKeller,
When are you planning on moving? Just a word of caution to add. . . if you plan on looking for housing in Davis County (most of which is close to your workplace), stay away from the refineries at the southern end of the county. I worked for an agency that received air quality complaints because of the refineries. There can be some pretty obnoxious odors coming from the refineries quite often. Often people will look at homes on "good" days, decide to buy, then find out too late that their new neighborhood stinks. . .literally.
Bountiful, Centerville, Farmington, North Salt Lake, Kaysville, Layton, Syracuse, etc. would all be good choices IMHO.
As far as the entire "mormon" issue, don't sweat it. I am "LDS", but have no problem at all with those who are not. The only two people I'd call close friends are not LDS and it simply isn't an issue. Your son will do fine here. He'll find friends. My closest friend actually grew up in Provo (sometimes referred to as "Happy Valley" - high percentage of LDS) in a family of eight, graduated from BYU, etc. and managed to stay sane while NOT being LDS. Had a great experience.
Your place of work would actually be very close to mine (still working for a government agency located on North Temple). If you do live in Davis County, check out the bus system. I ride every day and love it, extra hour of sleep every day. . . .
Good luck. . .
Shake