We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
When prepare the file assigned to FILE_projects_list in config.ini, DO NOT end with an empty line:
FILE_projects_list
config.ini
path/to/project1.zip path/to/project2.zip
Run python tokenizer.py zip, then check the log file and see:
python tokenizer.py zip
[INFO] (MainThread) Starting zip project <1, path/to/project1.zip> (process 0) ... [INFO] (MainThread) Starting zip project <2, path/to/project2.zi> (process 0)
The path of the last project is handled incorrectly which results in project not found.
This may caused by proj_paths.append(line[:-1]) in tokenizers/file-level/tokenizer.py .
proj_paths.append(line[:-1])
Recommend to use line.strip() instead of line[:-1].
line.strip()
line[:-1]
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Steps to reproduce
When prepare the file assigned to
FILE_projects_list
inconfig.ini
, DO NOT end with an empty line:Run
python tokenizer.py zip
, then check the log file and see:The path of the last project is handled incorrectly which results in project not found.
This may caused by
proj_paths.append(line[:-1])
in tokenizers/file-level/tokenizer.py .Recommend to use
line.strip()
instead ofline[:-1]
.The text was updated successfully, but these errors were encountered: