Taking Colt out of the mix, Just about all of the "brand name" forged lowers on the market will work just fine but there are some very minor differences.
First off, I recommend staying away from Cast lowers. I know many people have them and haven't had any issues but the fact remains they are a lot more fragile than their forged counterparts and generally only cost $20-$30 less. Not enough of a savings IMO to justify the added risk.
As stated, some have a "low shelf" (LAR made lowers) and some have a "High shelf" (ex. CMT and LMT). Low shelf lowers will accept an RDAIS and high shelf lowers will not but unless you already own an RDAIS I wouldn't worry about that.
There is really only a handful of machine shops milling lowers. LAR (who makes BM "L" series, DPMS, Grizzly and Ameetec) CMT (who makes RRA and Stag and some reports claim they make Colt's as well?) and LMT (who makes LMT, PWA, Lauer and a couple of others that I can't think of right now). There are probably a few other machine shops but those three are the best known.
Keep in mind though that even though they may make lowers for a number of different companies, they may not all be made to the same specs. LAR is a good example. The lowers they make for BM are just Hard Coat Anodized. The lowers they make for DPMS and Ameetec are Teflon coated after they are anodized.
Which brings up another point to be aware of. Some people like Teflon coated lowers because they feel they are more wear resistant. Some people don't like them because they usually will not match an Anodized upper real well (color wise). Either way, know that if you plan to paint your lower, none of the typical products used will stick to a Teflon coating very well.
As far as upper\lower fit. That is always a crap shoot. Even if you buy your upper and lower from the same source at the same time, they may not lock up tight. Functionally it does not matter in the least. A 100% tight lock up offers absolutely no advantage over a completely loose combo accuracy and performance wise.
If you want tight, go with a CMT milled lower as they mill the rear take-down area a little fatter than most. It is done on purpose to help tighten up Upper\lower fit but just know if you get an upper with lugs a little fatter than norm, you may need to file the upper's lugs to make them fit correctly. The other solutions to tighen up the Upper-lower fit is either an Accuwedge or a #7 o-ring around the front lug.
I own (or have owned) the following lowers:
Colt (?)
RRA (CMT)
PWA (LMT)
Eagle Arms. (?)
While I love the Colt (if for no other reason then it's the only one actually marked AR15) but I would have to say, out of that group, The RRA's are my favorite because of their fit\finish\quality\cost.
Just my $.02... YMMV