Skip to content

Latest commit

 

History

History
 
 

language-detection

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 

How-to

  1. You need to download and process dataset first,
wget http://downloads.tatoeba.org/exports/sentences.tar.bz2
bunzip2 sentences.tar.bz2
tar xvf sentences.tar
  1. Change to csv,
awk -F"\t" '{print"__label__"$2" "$3}' < sentences.csv | shuf > all.txt
  1. Run any notebook using Jupyter Notebook.