Can any doctor access my medical records or do they need my permission?

I am switching to a new psychiatrist and i don't want them to access my old records because my last psychiatrist was a joke. I want a clean slate and don't want my new doc to have an opinion already formed about my condition based on my crappy old pyschiatrists interpretations. so do they see all of my medical records or do i have to give my permission before any information is transfered?