I actually have thought about this before, and it's a good point--for CCW. For CCW, I do believe that a shinier or lighter gun could be a disadvantage in terms of stealth. That's why so far I won't CCW a stainless gun. I prefer matte black. My wife likes the look of stainless, so she'd probably prefer that. But I'm more concerned with the maximum capacity for stealth should I ever need it.
But, that said.... for HD I think it's irrelevant. If a BG breaks into your home, he probably knows you're there, anyway. I would call the cops and grab whatever gun I had near me. I don't care if it had pearl grips and pink flowers on it (though I'd never buy a gun like that). I'd tell the guy I called the cops and if he doesn't leave I'm going to shoot him. If he came near my loved ones or myself, I'd shoot him. In reality, he doesn't deserve a warning, but in court it looks better (though it's ridiculous that we have to think about these legal things with self defense!!).
It's hard to think of a circumstance where I'd be sneaking around my house trying to sneak up on an intruder. If I happened to not noticed a 2nd or 3rd intruder, that could be dangerous and could get me killed, which would leave my wife a widow and any kids I have would be w/o a dad. Why stick your neck out further than you have to? You're better off calling the cops ASAP and going to the safest point in your house with your loved ones (armed, of course, in case the SHTF) until the cops come. You have better odds with more backup (armed cops). Plus, telling the BG you called the cops and are armed will likely get him out of your house. If I were the BG, I sure as heck wouldn't hang around to find out if the homeowner was telling the truth.
But, all that said, I do agree that it's good to have a few matte black guns in case you're ever in a situation where stealth is of vital importance. HD just doesn't seem to be one of them, IMO.