kfburrage: If you have been married to your husband for three years then you are likely eligible to become a US citizen through naturalization (see here, especially Attachment A on the fourth page). Once you are a citizen, you will not need to worry about this any more.
If you satisfy the eligibility requirements then your best option is probably to apply for citizenship as soon as possible and remain in the US until that process is completed. Based on what immigration officers are telling you, you're at risk of having your green card revoked at any time if you keep leaving the country and then reentering.

