Using the "detokenizer" filter rule gives an error

[bhaddow]

How to reproduce:

Install the requirements-all.txt

Load a corpus, and navigate to filters

Attempt to add the "detokenizer" rule.

The following error is produced:

Usage: sacremoses [OPTIONS] COMMAND [ARGS]...
Try 'sacremoses -h' for help.

Error: No such option: -l
Error: subprocess exited with status code 2

[jelmervdl]

That's so weird, all sacremoses commands should be able to accept an -l option.

Maybe it has something to do with python dependencies, where the sacremoses command is installed by another package that's incompatible.

Additionally, (but more relevant for another issue) we should have a test suite that installs requirements-all.txt to see whether everything still works in that environment.

Additionally additionally, integration tests for individual filters would be nice, but quite a bit of (easy but boring) work.