Nice to hear that the Brown Bess loading technique is still with us - drop ball in, bounce ramrod on it, or if the ramrod is already on the other side of nomansland
just bounce butt on the ground... and never ever fire downhill! Works a treat if theres enough of you do it at the same time!
The .54 calibre almost certainly refers to the diameter measured between the lands. Do yourself a favour and find out the groove diameter of the barrel. It will probably be something like 20thou bigger! You only need to measure it at the muzzle, and if your working at home you could use a good pair of vernier calipers.
What you need is a ball and patch combination that adds up to just over the groove diameter. To be more exact, the ball diameter and twice the patch thickness shoulds be not more than 5 thou greater than the groove diameter. Any bigger and its just too hard to get the load into the barrel and you risk deforming it with all the hammering!
The precise combination is a matter for experiment, but for example, I have a .50 cal ML rifle in which I have successfully used a .490 ball with 15 thou patches and a .495 ball with 10 thou patches. Yes, the total diameters are different. The thicker patches are squashier! The thinner patches ought to be more accurate, and I'm still testing that point!
HTH
Just noticed I'm not a new member anymore! Is that a clock thing or a number of posts thing?