At this point...it will be your word versus theirs....unless a child was born from one of those rapes, there is no evidence to prove your case.

Speaking publicly at this point - he could sue you for Defamation of Character. You have no criminal case, no proof.