I can only add to what has been said with my own limited experiences.
My first and only factory 25-06 is of the Rem 700 BDL version sporting the factory 24" barrel. I picked it out of several the LGS had on the shelf back in the mid 80's. From the first rounds until now it has been simply amazing at how accurate it has stayed through the years shooting a variety of bullets, and weights, from most any manufacturer. If I could offer any one suggestion it would be to start off using RL-22 as your powder, I highly doubt you will be disappointed.
That said mine has changed stocks simply due tot he factory wood began to warp over time and I ran out of elevation in my scope to adjust for it. I considered simly going with the Remington wood again, but found a Fajen laminate for a good price and haven't looked back. I shot it for around 20yrs and passed it over to my daughter. She had already more or less taken it over anyway. She along with her oldest son have taken several very nice deer with it over the years. Here it is pictured with the oldest grandson and his first buck taken on the day after his 9th birthday,
I had it out early last fall to check the zero on it and we had the target set at 250yds. We had been doing some load work ups on another rifle and had just finished cleaning this one. I fired one fouler and two for group with a stiff breeze. Due to it being zeroed for 200yds I didn't feel the need to mess with the scope one bit,
I know that groups are not considered much in most cases unless they contain umteen shots. With this rifle however I have no need to waste barrel life or components to shoot 5 or more shots for group anymore. I know the loads it likes, and has shot so well for a LONG time, and the multi shot groups have been identical to this one time and time again if only having more holes. If it spreads them out, it simply means it is time for a cleaning, then it's right back to business as usual.
To be honest, I would suggest you might do as I did for my AI version. I picked up a donor action, then a stock, and barrel, and other items a piece at a time until I had exactly what I wanted. Then I had it all put together into a total package which up till now is still amazing me with the accuracy I get out of it with even the lowly bulk Rem bullets. It will easily throw the 120gr Rem CL's into 1" groups at 300yds, usually better if I do my part, with decent conditions. Depending on just how you go about it and what your exact wants are you might could stay at your listed number or possibly just a touch over, but you would have exactly what you wanted when your done in the exact configuration you chose.
Good luck, either way it's hard to be a good shooting 25-06 any way you slice it.
I kick myself for selling my "quarter bore". 
