Like many here, I have a fair amount of experience loading cast bullets in rifle cartridges, including the .308. There are obviously a number of avenues you can take to get there, but here is my highway to success...
Pick a powder that will get you good case fill, efficient burn, and reasonable velocity. For me, that would be powders in the IMR4198/H4198/AA5744/RL7 range. You can load everything from .22's to big .45's with that powder, all within a reasonable velocity envelope for cast bullets. No fillers, no worry about double-charging with tiny charges of pistol powders, no worry about irregular burn characteristics trying to download a slower powder (the caveat to that would be, as was mentioned, H4895, because of it's ability to be downloaded, per Hodgdon.)
Personally, I don't cast... I am at the mercy of commercially cast bullets. Having said that, I have no problems with leading, accuracy, or poor performance... mostly because I have matched the bullet diameter to the bore of the firearm it's going into, and because I keep my velocities reasonable for the hardness and alloy of the cast bullet.
IMR4895 is a great .308 powder, no doubt... I use it, too. It would not be my first choice for cast bullets. For that matter, I'd rather have IMR3031 than IMR4895 for cast. I use IMR3031 in the .348WCF because I need the additional velocity IMR3031 provides to get my 200grn bullet out past 500yds, it works very well in that manner. My concern with IMR4895 is you would be driving your bullets fast, right off the bat... maybe too fast. If one of the factors is off... think alloy and hardness, bullet diameter, base obturation, etc... you could wind up with a shotgun rather than a rifle. That very same thing happened to me with a pre-war Savage 99 in .30-30, where my standard cast bullet (the same one I used successfully in my Savage 99 in .308...) wouldn't hit the paper at 50yds. As soon as I ciphered out the bore diameter, and used an appropriately sized bullet, everything fell into place.
One other item... I would suggest you look into the Lyman M-die, or similar products, for loading cast bullets. The M-die opens up the case neck a specific amount, and flares the case mouth slightly... this allows you to seat the cast bullet without shaving lead, and the properly sized neck won't swage the cast bullet down as it's being seated.