You wouldn't have to pay back the company, you'd have to pay back the state.

If you don't go to the hearing, you will lose automatically, and you will be required to pay back the benefits to the state. If you're OK with that, then fine, don't attend the hearing. But if paying back the state seems wrong to you, then the way to fix that is to attend the hearing.