I also want to get opinions on my leaving my job - right now we are comfortable with money, if I leave things could shift in that regard. Will he resent me for this even more, if I don't find a new job ASAP?
I have been looking for 10 months and have not gotten an interview yet. I think we would be ok for a while with only one income but because the affair caused a bunch of problems, now will I be adding additional problems to the marriage and make it even worse?
You need to talk to our husband about the lifestyle changes you will need to make in order to rebuild your marriage.
The most important thing is to leave your job, but I suspect that you might need to move house, also, to avoid any possibility of running into your affair partner. If you both live within travelling distance of your jobs, then surely it is possible for you to run in to each other in the neighbourhood, or shops.
If this is the case, you and your H need to make plans so that you can buy a new house, far away from the current one, without relying on your income, which it might take a long time for you to replace. Indeed, since you had a workplace affair, your not working for a while would be good for your marriage, and your boundaries.
If you do not live close enough to risk running into him, it would still be good for your marriage to have a fresh start, and to stop relying on your income.
So, you need to tell your husband that leaving the job is not negotiable and must happen right away. Tell him how unhappy you are at having to meet your AP under any circumstances (limited, infrequent, not talking; the circumstances do not matter because they are painful). Tell him that you are no longer willing to put your marriage at risk by seeing this man, ever again. Tell him that you want to make a fresh start in a new area, and you want to explore ways of moving to a new home where you will not have to rely on your income to survive.
I'm asking you to focus on protecting your husband, because I know how he feels, whether he admits his feelings to you, or not.
My H continued a 5 year EA, using the workplace phone, with no meetings in person, for 5 years after his 3.5 year PA ended. Eventually, when I discovered this, he had to retire in order for me to know that workplace contact was no longer possible. He took a big drop in income, but we adjusted and are comfortable. We did not have to move house, as his AP lived in another country, but I would have moved house and faced unemployment rather than go through another day knowing that workplace contact was taking place, and he was lying to me about this. Recovery was just not possible while I lived with doubt, suspicion and uncertainty.
You are not lying to your H as my H was to me, but your H does not know that for sure. And worse; he does not know when one of those carefully controlled meetings will turn into a re-ignition of the affair. He must go through each day, and try to sleep each night, knowing that you had strong feelings for that man, and that you spend your days at work wondering whether you will see him (even though you don't want to see him)and recovering from having seen him at a meeting.
That is no way to recover. Your husband cannot recover like that, and so your marriage is doomed, even if you stick to your agreement about meetings and emails.
If your marriage is more important than your standard of living, give up the job. If you won't give it up, you are making a very clear statement about your priorities.