Is this wrong behaviour?

There is no excuse for that kind of behavior. A man should never lay his hands on a woman in anger. It's good that you're not with him any more because things could have gotten a lot worse.