YES the banks will sue you. They have departments set up to handle things like this.
And NO they dont give up after a few years and forget about it.
It seems like you have your mind made up, so go with that and see what happens. You can always go another route down the line. You have nothing to lose either way based on what you disclosed on here.

