Your son has the right to seek visitation. Even if mom doesn't want him to... that is the joy of having a baby... both parents can demand and get involvement.

You, however, don't have a say in this case.