You don't have any relationship with the other tenant which would give you the legal power to evict him.

Has the agency indicated what, if anything, they will do for you if they cannot deliver the apartment as promised?