If you want to own and wear armor, and can afford it, go for it. I can tell you from years of doing it professionally - body armor plain flat out sucks in high heat. When you rig a hose from the AC vent in the vehicle to run down your neckline for relief, you will understand. We did that in one armored truck I worked on - dark red metal seems to attract Arizona sunlight.
But vests get lighter and more comfortable all the time, so weigh the pros and cons. Also, be aware, a full coverage vest will affect your CCW setup, as the vest will make you "wider" right above your pistol, especially if it's kept close to the body in a typical CCW setup. The contour style won't, but will leave your sides open.
As for rifle, yes, you can get rifle proof armor, and actually a LOT cheaper than a top line IIIA soft vest. AR500.com sells level III plates with heavy anti spall coating that get pretty good reviews.
http://www.ar500armor.com/plate-carriers/plate-carrier-packages-w-armor.html
They sell a concealable carrier, or you can use one like this one, which I do personally have.
http://www.lapolicegear.com/bpg-lowvis-plate-carrier-large.html
I got it, adjusted it to work under a shirt, (the shoulder pads had to go), put in my AR500 Level III front and back plates, and went to the range. I shot for about 2 hours or so, and picked up my brass. I am a fat, old, out of shape man, and that wasn't as much fun as it could have been. 15 pounds of steel is not real comfortable. But, I can say I did it, and I still have the setup...though I have zero idea when I would find it useful.
BTW, the Advanced Shooters Cut on the AR500 plate did allow me to shoulder my rifle easily.
But unlike the naysayers, I say, go for it, see what works, that fits your budget and doesn't eat you alive in summer. if you can make it work, good for you. If you can't, don't feel bad - that stuff can be a huge pain in the patoot.