What if everybody refused to blacklist someone when they said to do it? They couldn’t blacklist everyone. They’d have no one left to push around.

If we don’t have freedom of association then you don’t either.