Don't let him bully you by making threats to do something illegal by acquiescing and doing what he wants.
Scapegoats suffer decades of all sorts of abuse.
Did he do other harassing and stalkerish things? Experts say there are five love languages, but since the invention of smartphones, you can add a sixth: sexting.