It doesn't sound like your ex- is in a good position to fight against the involuntary termination, due to his abandonment of the children.