You can object to anything you want. If your ex doesn't agree you'll have to take him to court to enforce your objection.

Why not try talking to him about the risk.