That's up to a judge. What might specifically constitute harassment such that a judge WILL grant a CHO can be largely subjective and is up to the opinion of the judge.
This is from the state courts website and the link that adjusterjack provided:
What Is Civil Harassment?
In general, civil harassment is abuse, threats of abuse, stalking, sexual assault, or serious harassment by someone you have not dated and do NOT have a close relationship with, like a neighbor, a roommate, or a friend (that you have never dated). It is also civil harassment if the abuse is from a family member that is not included in the list under domestic violence. So, for example, if the abuse is from an uncle or aunt, a niece or nephew, or a cousin, it is considered civil harassment and NOT domestic violence.
The civil harassment laws say “harassment” is:
Unlawful violence, like assault or battery or stalking, OR
A credible (real) threat of violence, AND
The violence or threats seriously scare, annoy, or harass someone and there is no valid reason for it.
“Credible threat of violence” means intentionally saying something or acting in a way that would make a reasonable person afraid for his or her safety or the safety of his or her family. A “credible threat of violence” includes following or stalking someone, making harassing calls, or sending harassing messages, by phone, mail, or e-mail, over a period of time (even if it is a short time).
And CCP 527.6(b)(3) defines "harassment" thus:
"Harassment" is unlawful violence, a credible threat of
violence, or a knowing and willful course of conduct directed at a
specific person that seriously alarms, annoys, or harasses the
person, and that serves no legitimate purpose. The course of conduct
must be such as would cause a reasonable person to suffer substantial
emotional distress, and must actually cause substantial emotional
distress to the petitioner.
From the description you have provided it would seem that a judge might have sufficient cause to issue the initial, temporary order. However, when the two of you face the judge a few weeks afterwards, he may be able to convince the court that he is not a threat to you.
None of us can predict what an unknown judge might say concerning an unknown affidavit or testimony.