Set the Needed Talk Power to say 100, and anyone who has a talk power below 100 cannot talk in that channel.
Needed Talk Power