Domain in your name
The domain must be registered under your own account. If it sits in your provider's account, in practice it isn't yours.
Access to the code and content
Ask for a copy of the code or access to the platform it lives on. You should be able to take the site with you.
Analytics and email accounts
Analytics, forms and domain email should live in accounts you control.
A logins document
At the end of a project you should receive a list of every service, user and what it does. We always hand one over.