You don't need a gun permit here for long guns, though the state does require a Handgun Safety Certificate to purchase hand guns.
Here's a link to the CA DMV, if they believe that you have become a CA resident they will issue you an ID Card or Drivers license. Once you have the license is is...