One of the least expensive places to buy 41 mag rounds is Georgia Arms.
Overall, the price of factory loads does bug me. But not enough to shift to 44 mag. For comparable ammo, 41's and 44's are about the same price. Harder to find 41 mag ammo. The big difference is you can't buy 41 mag (Winchester White Box) at Walmart.
The $79 price tag at Gander had to be Remington ammo. It was not cheap last year although I bought a couple boxes at Gander because I "knew" the price was going to be going up. I don't recall the price, but it was something like $40/box of 50 (Remington).
Hand loading is the way to go really with either the 41 or 44 mag. I have quite a bit of 41 mag ammo cached away. Replacement cost is high though.
Try shooting factory loaded 500 S&W if you want to see "expensive". Unfortunately, you are going to have to get used to the $1/round kind of number unless you reload.