Title is a bit of an exaggeration and maybe paints the wrong picture but I didn't know how to sum it up

My boyfriend doesn't want me to talk to his ex, who I was friend with before I met him, and he still talks to his ex and is going to visit him in a few weeks. He doesn't like him and is just visiting to talk

I know im in the wrong because the guy is a bad person, but I just really don't like my bf giving me these dramatic rules and being so suspicious of me. Its really frustrating. Especially because like I asked him if I were to say I dont want him to visiting his ex, he said he would or would not abide based on my reasoning. But for me he said it was an absolute boundary that I'm not to talk to this person

Like I get its my choice in theory and its just that if I choose to, he would leave me, so its not that he's "telling me what to do" (his reasoning)

But its just so frustrating. I dont like being told who I can and can't talk to and I dont like feeling like I'm a bad person when I havent done anything. Like I would like to at least be able to talk to the guy about the situation and how we can no longer talk. I was thinking maybe asking for that, but my boyfriend has already threatened to make me block the guy online and I dont want to have him make me do that

Tl;dr I dont know. I just feel so frustrated but I am worried talking to my boyfriend more will just make him angry with me.