This isn’t about me, this is about what people from persecuted minorities have told me they need, when I bought this exact argument to them.
The same arguments apply, though.
Your version of blocking doesn’t exactly handle the problem you’re describing well, either, as someone wishing to spread hate or “off-screen harassment” can block their direct target which, under the model, will mean they can’t see it, and then post.
To be clear, they don’t like that he’s threatening to ban people from somewhere over speech. That is, first of all, not mere speech - that’s an action they’re threatening to take.
Second, it’s not some kind of gotcha or contradiction that some speech might be disapproved of in the defence of free speech. You might espouse the principle of peacefulness, yet no-one would suggest that responding violently in self-defence was in contradiction to that. Being in favour of free speech doesn’t mean being in favour of all speech; many and varying exceptions are made, for example for hate speech, threatening speech or indeed speech which has the effect of restricting or chilling the speech of others. And we’re not talking about a violent or legal response here but rather dogpiling - and while that does chill speech in general, it’s not on the same level so deservedly has a lower bar.