I can't remove view address permission

I was in my teamspeak server and when I went to remove the permission for people being able to view peoples IP addresses the grant box was already at 0 but the value box ticked. This now means I cannot remove the permission from the people who have the role so they are free to view anyones IP. I only know one way to fix it which is resetting the teamspeak server but I just finished it and really don’t want to have to reset it. Does anyone know any other way to sort this?