My comments have somewhat upset the OP, so let me explain in detail:
Generally, I don't think that storing a loaded gun in the same space with unloaded ones is a good idea, but that is just me. Because we, as humans, tend to forget. We forget important, life or death issues (like our wedding anniversary...) let alone if the gun is loaded or not. My friends call me "a..l" about gun safety, but every time my gun lefts my sight, when I take it back I check to see if loaded, or not. Because I might forget. I might forget that I unloaded it 5 minutes before that - stuff happens, no one is insured against "brain farts". So I don't advise in just taking your holstered carry gun and putting it in your pants without checking it first.
Secondly, if you treat all your guns the same, like "Unloaded guns DO NOT exist, period", than holstered or no holstered does not make a difference - just keep your finger off the trigger and pointed in a safe direction until you need to do otherwise, no exceptions.
And last, if your holster becomes sweaty from your gym activity, than a simple drying is not sufficient - the salt contained in the sweat will stay there, and as being hygroscopic it will attract humidity and soon or later it will cause rust, even on a stainless gun. If that is the case, than a cheap Fobus holster mounted on the safe's door for instance might be a better idea.
In a nutshell - always check your guns, a holstered gun isn't good indicator about it's condition at all.