Right to drive falls under the right to travel. If you own your car (thus having all rights to it, lest if you don't you only have privileges) and the roads are purely public, the right remains.
The problem today: you don't own your car and the government strictly regulates road use. Not one...