Just let the leather dry out, and then oil it. You're not going to get any shrinkage, but when the water dries, it will take with it whatever moisture is in the leather, which will make the leather stiff and cracked. Any good leather creme will do fine. You want something with neatsfoot oil in it, but not the oil itself. You will be promptly evicted if you open a can of any kind of animal oil in the house. The tent in the back yard would not be a wise tactical decision, given your present situation. There are several conditioners that also contain silicone. While I was reluctant to use them at first, they seem to do wonders to prevent leather goods from drying out after exposure to rain. It also reduces the effect of discoloration dramatically. In fact, it will remove a good bit of it. Apply those types of conditioners in private, away from people who like to make fun of you. They are a thin white cream. You can guess what the jokes were when I was cleaning up my boots.
I don't know just why everybody flips out over WD-40. It works really well for cleaning off all kinds of junk from a gun. If you leave it on there too long, you might as well have slathered your gun with cosmoline, but it won't hurt anything if you're using it as a cleaner. It is very effective for preventing corrosion immediately after a water gun attack. As always, a good coat of oil on the gun to begin with is your first line of defense. CLP will not prevent rust forever, but it will help a great deal if you should be caught in an early morning rain shower and not have a chance to clean your gun until you get home.
As for the revenge bit... I recommend you cook your boys a couple of REALLY nice dinners. Don't say a word about your plans, but do have the gun on you, in its holster, in a really obvious way when you're serving your boys a nice big steak dinner. Do this several times. Let them forget about all this unpleasantness over a week or so, and the hit 'em. HARD.
You want revenge that you're not there to see. It will freak them out more. Pete F's suggestion is good, but you really need to respond to this sort of thing with, as my grandfather loves to say, "old age and treachery." A bucket of icy water is in the "youth and exuberance" category because it requires your presence. You're around the house more than they are, usually, so you need to exploit it. Some of my favorites are:
Change the front door lock, or, if you're daring, change all of them. Do this while they're out playing ball. Pretend not to be home. Rearranging or replacing the house numbers is a nice addition to this one if it's feasable.
If you can sneak into their rooms at night without arousing suspicion, various items filled with sand/popcorn/bloodthirsty leeches will do nicely. I prefer boots and popcorn. You'll be up and about before they are, so you won't be there when they find it. Use this as the setup for a full day of pranks.
The classic ink in the shampoo is a favorite of mine. Be adventurous. Use a really obnoxious pink instead of the traditional blue or black. An ink pad for a rubber stamp stuffed into the shower head is a good alternative. It will take a good week to wash off.
Sending them after nonexistent things is always a good one. If you have a 'round the corner type hardware store nearby, you might just be in need of a bottle of radio oil, winter air for tires (it's cheaper in summer, you know!), or anything else you can come up with. Be creative. The only limit is your imagination.
Contact a military school, and have their literature sent to the house. Marine Military Academy in Harlingen, Tx is not only a hellhole filled with sadistic mental patients, but will also provide you with large, full-color literature. Leave it around the house where they'll notice it.
Grease up their bicycle seats with vaseline. It won't really slick up enough to be dangerous, but it will leave a nice big stain on denim in an embarassing pattern. Only do this to one of them. Use it in conjunction with changing the locks.
There are all sorts of foul tasting yet non lethal things you can soak a toothbrush in. Again, use your imagination. If you're really mean (like my mother), you might also place a small bottle of ipecac on the bathroom counter when you pull this one.
One word: Laxatives. They make chocolate flavored stuff that is undetectable in a glass of Quick or Ovaltine.
I'm going to stop now, as I'm beginning to scare myself just a tad. If you're interested in somewhat more dangerous pranks, such as the "human curiosity box," please let me know.