My deer hunting rifle is a Browning BAR in .270 Winchester and I like it very much, but if only one rifle is to be owned, wrong choice.
I prefer bolt guns for target shooting. Easier to keep clean in the perspective of some volume shooting.
In OP's situation, I would take a good look at a Tikka Hunter in 6.5 Creedmoor or a X-bolt Hunter in the same caliber. It is modern (efficient), sufficient for deer, available, and both target and hunting ammunitions are commercially available. Looks like it is here to stay. Recoil seems soft from what I read.
If recoil was not that much of a concern, I would maintain my usual recommandation for the venerable 30-06 in the lonely rifle scenario, just because I like it and it can do so much.
I used to think one rifle is enough, but I changed my mind as my taste in firearms developed and money became a tad more available to me. If I had more, I would buy more guns, I am pretty sure. Not because I need more, but I enjoy different weapons for specific or specialized uses. A long range hunting rifle is not the same as a battue rifle, a hunting shotgun not the same as a trap shotgun, and so on. Some models are generalists, some are more specialized.