My question involves landlord-tenant law in the State of: california

hi im a new landlord and i have a tenant thats not paying. the utilities are in his name EXCEPT the water. the lease says "tenant will pay directly for all utilities, services, and charges provided to the property, including any and all deposits required." i was doing him a favor keeping the water in my name so he wouldnt have to pay the deposit but now that hes delinquent with rent, etc.. i dont feel comfortable having it in my name anymore. i gave him a 3 day notice to pay rent or leave. i also want to get the water off my name immediately. hes more than welcome to transfer it to his name, i just dont want to be liable anymore. is it ok to do that? thanks alot. by the way im new to the forum too. thanks!

btw i think "shutting off" is not the right term, i mean to transfer service to him. thanks