Your prior abuse case could well trigger concern and, depending on the severity of the injury to the child, could result in removal. I would expect it to at least trigger an evaluation to see if a safety plan was necessary and, if so, to ensure that it was implemented. A safety plan can involve removal, but does not necessarily require that you go to court or that the child be placed in foster care if you and protective services work out a mutually acceptable arrangement.
I suggest consulting a lawyer with the full details of your situation, as that's the only way you're going to get an answer that is reasonably reliable.

