A Client with permissions to give a lower tier role in their channel can set the lower tier role in the other channels?

Hey folks, I know I’ve asked two questions now, but I’m unsure how to fix this, I’d be really appreciative if you could help.

So essentially I have a group called channel admin which can do various things such as edit description of the channel etc etc, however, the client who has this admin role can set a whitelist role which allows a user to join the channel without needing a password.

The problem I am coming across is the fact that a client in one channel with the admin channel role in one channel can set a whitelist role in another channel.

Screenshot - 26b51daab4e3c51135519426b4e32861 - Gyazo - This is an image of the Admin role and its permissions in regards to adding/removing roles.
Screenshot - ad4ac731342cd490407b3ca69d68050d - Gyazo - This is an image of the whitelist role and its permissions in regards to having roles added/removed.

Thanks to anyone who can help.