Make no mistake, it IS dangerous. How do I know that? I got to chatting with a fellow at the range last year while loading a .54 smooth rifle. The ball was hung up 2/3rds of the way down, but since I was not paying attention I felt it stop and didn't check my rod mark. As a consequence there was a space between the 75 grains of 3F and the PRB. Did it make a difference? Well the recoil was enough to bruise *MY* ribs and leave me hurting for a week. I've shot some brutal bear guns over the years, and none of them ever did that to me. Thankfully the barrel held, but it was a heck of a way to proof check the barrel.
Exactly why this happens I do not know. But it does happen, and can cause a serious KB.