The UI hearing is not a criminal trial so you are not afforded the constitutional rights of a prosecuted person.
You can certainly refuse to answer questions that might be used against you in a criminal court but the hearing officer is free to conclude that your silence is an admission of misconduct which is grounds to deny you benefits and require you to pay back whatever you've already collected.

