Skip to content

Latest commit

 

History

History
9 lines (8 loc) · 430 Bytes

README.md

File metadata and controls

9 lines (8 loc) · 430 Bytes

FFCV_training

Create FFCV dataset

python FFCV_datasets.py create --dataset-path <path_to_directory> --dataset-name <DatasetClass> --dataset-splits <train/val> --ffcv-directory <path_to_directory>

Issues:

  • PAGE_SIZE being too low will give malloc error halt the process in memory allocator
  • Default workers in the DatasetWriter is equal to num of cpu cores. For me this crashes the whole system time to time.