Previously, I didn't clean the pockets of my handgun brass either. Lately, with two young granddaughters who like to be at my side constantly, I've decided that I didn't want the dust floating around from dry tumbling with the primers in place. So I now decap and wet tumble with ss pins, hot water from the tap, a bit of citric acid and Dawn. Aside from the occasional nicks and dings, the brass looks like new, even the primer pockets. I couldn't care less about impressing others with shiny brass, and even though my goal was different, having them come out pristine is just a side benefit that I can live with.
As an aside - I finally found a use for that loadmaster that's been collecting dust under the bench. With the case feeder and a universal decapping die, it's great for decapping a large amount of brass in short time.
For the OP, even though they're not crimped, I always run s&b brass through the pocket swager because they are always tight (the first time).