I don't see where they would ask for the ss benefits back that were received for the children. Your saving the money for college should be ok. However, as Mr. Knowitall suggested, you might contact your local SS office & ask them any questions you might have.