I've used a 300blk/300 whisper with a 220 gr bullet. Taken several deer with one, at 50yrds its a "no brainer" for shot placement.
mine is more of a rifle platform but it makes you wonder, seems a 230gr 45ACP at 1050fps would do the same damage. except the 300 bullet is a lot longer and tends to yaw once hitting the animal. does a surprising amount of damage. Ive known plenty of guys in years past who have taken down deer with a 22lr and "earholed" them. i'd say its mostly about shot placement. I would not feel comfortable with a 9mm but I cant hit a deer head sized target at 50yards with it.
if you are concerned about neighbors and don't have a can, consider a crossbow if legal.