Maybe ask yourself this:

"What is the worst that could happen if I let him go on two short business trips a year?"

Most likely letting him go on a couple trips and one party a year...with your blessing...would not be worse..... than an ugly DIVORCE.