You're right, it's not a contract.

If the shoe was on the other foot and they decided that you weren't working out, they would just show you to the door.

I don't see you having any liability if you tell them it's not working out and you quit.