This is a 1st Amendment issue, and there is lots of case law, although much of it has to do with still photography (IANAL). Same issue with video, though.
With extremely few exceptions, you have a right to photograph anything when you are in a public place, or when you are in a private place...