my opinion is that you should bring it up in counseling. He may be embarassed to bring you...heck, others may not even know that he is trying to work things out with you.
bottom line is, he doesn't have to let you be there... BUT if he is truly committed to making this work, you should be invited.