My question involves landlord-tenant law in the State of: Oregon

November 30, 2012 I moved out of an apartment.
December and January, I call my landlord a few times asking when to expect my security deposit returned. He never gives a concrete answer, but he'll get to it.
Today is Feb 6, 2013, and I have not received anything in writing, nor has he called. I go see him in person, and he produces a document claiming I was late paying rent several times during my 2 year tenancy. All the late fees conveniently add up to the exact same amount as my security deposit (under $1000).

I acknowledge the presence of a late fee in my contract, but I did not get receipts each month, and he always cashed the checks after the 5th. Is there anything I can do to show rent was on time?

What about the fact that he did not notify me of anything within 31 days of moving out? Do I have any recourse to recover my deposit?