Yes, you must go to court. Your name change you get for free with the marriage but the children have to get a court order.
This however should be a slam dunk since everybody is in agreement on a last name.
Info here: http://lawny.org/index.php/family-se...e-change-child

