Fix filter buttons

[luisa-beerboom]

Closes #2357

[Elblinator]

After selecting filters the first click still doesn't deactivate the button.
It doesn't matter whether the x or anywhere else on the button is clicked.

[bastianjoel]

This does not seem right and I cannot replicate the issue on current main.

[luisa-beerboom]

This does not seem right and I cannot replicate the issue on current main.

Have you tested it in firefox or chrome?

[Elblinator]

X in participants is still not working immediately