All the landlord is required to do is provide the covers. You have the covers. The rest is up to you. Go to Home Depot and buy some weather stripping (it's cheap). There's also a cover available:

http://www.homedepot.com/s/wall%2520...20strip?NCNI-5