Many marriages have trouble when there are changes in the home and with employment. The fact that you stayed home with the children does not give you grounds of annulment, though it might strengthen your claim to primary custody depending on what your soon-to-be ex does for a living.