Your neighbor acknowledges the problem, and is putting up a fence on his own side of the property line? What's stopping you from taking down the other fence?