I suspect there was some evidence pointing to you since most thieves don't have sudden changes of heart and offer a confession if they get away with the theft.

Then, unless you now want to start lying and claim you never admitted to the theft, he has your confession. If there was anybody else present they are witnesses to your confession.

If it comes down to it and you are in court, lying about your statement is perjury.