GitHub - patrik-lambert/parallel-data-cleaning-and-mt-eval: Basic methods for parallel data cleaning and mt evaluation

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
1-data-cleaning		1-data-cleaning
2-mt-evaluation		2-mt-evaluation
resources		resources
clean_encoding.py		clean_encoding.py
langid_filtering.py		langid_filtering.py
length_filter.py		length_filter.py
mt-eval.sh		mt-eval.sh
parallel-data-cleaning.sh		parallel-data-cleaning.sh
remove_duplicates.py		remove_duplicates.py