I think the fence is an excellent idea.

I would recommend that you discuss the letter idea with your attorney as to content and timing for rescinding permissive use. It's worth the money to have the lawyer write and send the letter.

For an interesting discussion of prescriptive easements in Mississipi:

www.mssc.state.ms.us/Images/Opinions/CO37843.pdf