Belt and cover!!
Second vote for checking your belt and cover garment. If this is the kind of holster you want to carry, then two things are essential: a stiff, thick belt (preferably designed for concealed carry; just about every manufacturer of holsters offers one style or another) and a cover garment that effectively covers the pistol and holster fully, yet allows accessiblity should you need to get to your pistol.
Many gunbelts are not cheap, but you can find good stiff, quality belts out there for reasonable prices. I recently saw some stiff leather belts made by 5.11 Tactical for $35 at a gun shop. While I've never tried their belts, they seemed well made as most 5.11 gear is. If you're wearing a simple trouser belt or one that's not wide enough, your pistol won't hug up against your body. It'll feel like you're carrying a brick in a sock on your side. Also, I find pancakes are best worn behind my hipbone (around 4 o'clock). Most comfortable and the gun just blends in better back there, rather than sticking out because my pelvis pushes it out.
My experience with cover garments has been to get something patterned. Living in Washington is easy to do with flannel and/or a parka, but for the warm days, get yourself a plaid short sleeve shirt as the pattern tends to break up the lines of the holster and pistol underneath. If you're in a Magnum PI kind of mood, go Hawaiian. I've found the busier the shirt, the better it hides everything.