You can change your whatsapp settings that you only can be added to a whatsapp group if you give permission. Easy fix. Do it now for your own account and tell your IM and mother to do the same.