And who will do that? I doubt there are people willing to spend their time on something like that.
People who are regular viewers of a particular streamer's stream. It's not that complicated, a right-click and a ban for the evening. The question is whether the moderator is reasonable, but there are many of them. The streamer knows many viewers and has people he could trust.