Welcome to MarriageBuilders, Zor...
What's with the permission stuff? I ask because if you believe there is privacy in marriage, then you can't be intimate, can you?
I hope you go online to post here...there is a lot of help and information to aid you. I'm delighted you're here.
You aren't dealing with an easy issue...ex's exist, they were what you were before...to each other.
There's a rule here, on the Infidelity General Questions II forum (best place to post for the most traffic), which is a good guide for marriage...
Marriage is for two people only. When one partner puts another person ahead of the marriage, it's an affair. Whether they're sleeping together or not.
With your contacting your ex when you had agreed not to; and him contacting his ex, when he agreed not to, you both betrayed the marriage.
Think of it as you, him and the marriage. There are things you don't allow yourself to do to honor the marriage, even when you don't feel like honoring your husband...due to his behavior and your resentment.
How long married? Children? Why is there any forbidding in your marriage? I ask because forbidding is a fantasy word...no one can control another human being...not in God's design...we are limited to only controlling ourselves...we can influence, but only when the other person allows our influence.
You chose not to intimately communicate with your ex. Your H chose differently. Forbidding isn't real, Zor. You have choice. It's the balance to our human limits...no one can make you do anything...you choose to comply, homor, respect, believe...or not.
Hating yourself is something you have domain over. Knowing why you obsess, suspect, distrust, create resentment in yourself...those are within your control...what you own.
You are not alone. You're not crazy. You're resourceful and you found your way to a great place. Have you read all the articles on The Love Bank, Policy of Joint Agreement, the four rules of marriage, Emotional Needs and Love Busters? The links are to the right of your screen.
We're here for you.
LA