I'd not use .32-20 load data. Get a good manual or check on line for .32 H&R data. Ken Waters did an article in Handloader years ago, then republished it in his great loading book, Pet Loads. Most of my experimentation with that caliber came from his article. It's first rate and was done with a Ruger Single Six. I was working up loads for a S&W M-16 in that caliber.
I've had good luck with my 4" S&W .32 H&R M16-?...with the following powders: Win 231, Bullseye, 2400 and Unique in that order of success, but all gave me less than 2" gps at 25 yds. Bullets included Sierra's 90 gr JHP, Hornady's 100 gr XTP, Bull-X 100 LSWC at .312" dia., and Lyman's 311008 Cast lead FP at .312" dia.
For the lead alloy bullets both Win 231 and Bullseye worked extremely well. I started at 3.0 gr of either and worked up. 2400 gave me 1" gps with the Bonus 100 gr LSWC with magnum primers starting at 7.5 gr and working up. It's a good cartridge for woods loafing but I didn't have any luck getting JHP's to open up in a water medium.
One caution with .32 H&R brass...fully 30% of the Federal brass that I tried to reload cracked down the middle of the case lengthwise. Federal wanted me to ship it to them on my dime and they'd examine...BS obviously. I"ve not used Federal brass since in that caliber. Starline makes great brass for it, and I've not lost a single case for any reason since switching. Word on the street was that Federal had some annealing problems at that time, but I don't know if they've sorted that out since and Starline has always been first rate.
Good luck...Rod