The passport office shouldn't give you a problem - if you have court papers saying that you have sole custody, you do not need Dad's consent to obtain a passport

Go here and look at Step 7. Print it out and take it with you, with your proof of sole legal custody. You should be fine.