-
Notifications
You must be signed in to change notification settings - Fork 185
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[EHN] Adding ERPCore datasets #627
base: develop
Are you sure you want to change the base?
Conversation
…pting data_path and get_single_subject fcts
* Copy workflow changes from PR NeuroTechX#584 * Update whats_new.rst * Remove "always deploy" used for testing * Restore change to pytest instead of unittest * Use mne data cache in tests too
* Add summary tables as csv * Change BaseDataset to include the dataset's summary table in the docstring * Try update summary table in doc * Add test for dataset summary table * Fix future annotations * Prepare summary tables before doc * Make build dir if not exist * Add rstate table * Replace tables with CSVs in doc * Add PapersWithCOde column * Fix initial white space * Fix formatting of ints * Remove tables from docstrings * Add missing DemonsP300 row * Update whats_new.rst * Remove Shin2017B leaderboard * Move PWC link outside of docstring table
* including Liu2024 Dataset * [pre-commit.ci] auto fixes from pre-commit.com hooks * Function data_path * [pre-commit.ci] auto fixes from pre-commit.com hooks * data_infos and get_single_subject_data functions * [pre-commit.ci] auto fixes from pre-commit.com hooks * Data Description * [pre-commit.ci] auto fixes from pre-commit.com hooks * updating get_single_subject fct and data_path & adding encoding fct * [pre-commit.ci] auto fixes from pre-commit.com hooks * Finishing the code * [pre-commit.ci] auto fixes from pre-commit.com hooks * updating docstrings for data_path * Updating dataset_summary and updating the get_single_subject fct to handle the case of existing file in path_electrodes * adapting the return of get_single_subject_data fct * [pre-commit.ci] auto fixes from pre-commit.com hooks * Adding dataset description and preload = True when reading the data in the get_single_subject fct * fix: codespell * fix: changing to static method the encoding * repushing and resolving pre-commit conflicts * [pre-commit.ci] auto fixes from pre-commit.com hooks * fix: changing the mapping * fix: changing the unmatching between the trigger and the events from the csv * ehn: using pylint to improve the code (remove not used variables, and change the module); * modifying the python version in the pre-commit file * adding description to enhancements * adjusting the encoding * adjusting comments and dataset description * solving channels types and names issues & correcting encoding * Correcting the number of trials per class and the total trials * Correcting data description * Adding the possibility to exclude/include break and instructions events * Correcting code to include/exclude instr and break events * Remove table from docstring Signed-off-by: PierreGtch <[email protected]> * Add CSV row --------- Signed-off-by: PierreGtch <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: bruAristimunha <[email protected]> Co-authored-by: PierreGtch <[email protected]> Co-authored-by: Pierre Guetschel <[email protected]>
Signed-off-by: PierreGtch <[email protected]>
Signed-off-by: Bru <[email protected]>
…to Adding-ERPCore
Signed-off-by: Bru <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I tried to load data from subject 1 with the latest version of the code using:
data = ErpCore2021_ERN().get_data([1])
but got:
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='files.osf.io', port=443): Read timed out. (read timeout=15)
I tried on eduroam and on a mobile connection.
Am I the only one to have problem downloading this dataset?
…PCore
I have tested to install the moabb version with the ERPCORE2021, and try to get the data but I get this warning : |
With the latest version, download works on my side
And the file can't be loaded:
Also I get the same warning as @sebVelut :
|
if path is not None: | ||
path = Path(path) / DATASET_PARAMS[self.task]["folder_name"] | ||
else: | ||
# The Default path is in the user's home directory under 'mne_data' | ||
path = Path.home() / "mne_data" / DATASET_PARAMS[self.task]["folder_name"] | ||
|
||
path_zip = path / DATASET_PARAMS[self.task]["zipfile"] | ||
|
||
# checking if the zip of the dataset is already downloaded | ||
if not Path(path_zip).exists() or force_update: | ||
# Download and extract the dataset | ||
path_zip = dl.data_dl( | ||
DATASET_PARAMS[self.task]["url"], | ||
f"erpcore{self.task.lower()}2021", | ||
path, | ||
force_update, | ||
) | ||
|
||
metainformation = path / "participants.tsv" | ||
# check if it has to unzip | ||
if not Path(metainformation).exists(): | ||
zip_ref = z.ZipFile(path_zip, "r") | ||
zip_ref.extractall(path) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
https://zenodo.org/records/14866307 replace this.
The purpose of this PR is to add ERPCore datasets Here is the link to the official website of the dataset : https://erpinfo.org/erp-core.