You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
However, it seems there is a bug in the mapai_training_data.py, and it can't properly handle nondefault directory.
I would suggest to add an optional cache_dir to the create_dataset function which is propagated
into the load_dataset, and also fixing the bug in the huggingface datasets.
It is hackable, but especially on long term, after the competition, it would be nice to have a conformant dataset
which could be used in the future easily.
Reproduction:
execute the above lines
Possible cause:
very likely in the _split_genetators function the current working dir is not the one which is assumed,
therefore the os.makedirs refer to wrong location.
The text was updated successfully, but these errors were encountered:
The user home directories are actually not a good place to store data.
This is configurable in the huggingface interface with something like this:
However, it seems there is a bug in the mapai_training_data.py, and it can't properly handle nondefault directory.
I would suggest to add an optional cache_dir to the
create_dataset
function which is propagatedinto the load_dataset, and also fixing the bug in the huggingface datasets.
It is hackable, but especially on long term, after the competition, it would be nice to have a conformant dataset
which could be used in the future easily.
Reproduction:
Possible cause:
_split_genetators
function the current working dir is not the one which is assumed,therefore the os.makedirs refer to wrong location.
The text was updated successfully, but these errors were encountered: