Ask the neighbor why he thinks the wall etc. are six feet onto his property.

Is there any time limit on a situation like this
Oh yes, time can certainly be a factor.

But get the answer to the first question for us.