If you had the right to an attorney, then it would not be a situation in which the judge could simply deny you a jury -- you would have had to have waived that right. If you waive the right to a jury after paying the fee, you don't get the fee returned.
If you did not have the right to a jury but paid a fee, it would be necessary to review the nature of the case, the state and local court rules, and perhaps also case law to determine if the fee you paid entitled you to a jury trial, or if (for example) it was more in the manner of a motion fee.
Absent your waiving the jury, this is an unusual scenario.

