This is the codebase for the 2024 ICASSP Auditory EEG challenge. This codebase contains baseline models and code to preprocess stimuli for both tasks.
Google Meet Link: https://meet.google.com/jut-oavn-ega
Python >= 3.6
Steps to get a working setup:
1. Clone this repository and install the requirements.txt
# Clone this repository
git clone https://github.com/exporl/auditory-eeg-challenge-2024-code
# Go to the root folder
cd auditory-eeg-challenge-2024-code
# Optional: install a virtual environment
python3 -m venv venv # Optional
source venv/bin/activate # Optional
# Install requirements.txt
python3 -m install requirements.txtYou will need a password, which you will receive when you register.
The folder contains multiple folders (and zip files containing the same data as their corresponding folders). For bulk downloading, we recommend using the zip files,
-
split_data(.zip)contains already preprocessed, split and normalized data; ready for model training/evaluation. If you want to get started quickly, you can opt to only download this folder/zipfile. -
preprocessed_eeg(.zip)andpreprocessed_stimuli(.zip)contain preprocessed EEG and stimuli files (envelope and mel features) respectively. At this stage data is not yet split into different sets and normalized. To go from this to the data insplit_data, you will have to run thesplit_and_normalize.pyscript (preprocessing_code/split_and_normalize.py ) -
sub_*(.zip)andstimuli(.zip)contain the raw EEG and stimuli files. If you want to recreate the preprocessing steps, you will need to download these files and then runsparrKULee.py(preprocessing_code/sparrKULee.py) to preprocess the EEG and stimuli and then run thesplit_and_normalize.pyscript to split and normalize the data. It is possible to adapt the preprocessing steps insparrKULee.pyto your own needs, by adding/removing preprocessing steps. For more detailed information on the pipeline, see the brain_pipe documentation.
Note that it is possible to use the same preprocessed (and split) dataset for both task 1 and task 2, but it is not required.
There is a general config.json defining the folder names and structure for the data (i.e. util/config.json ).
Adjust dataset_folder in the config.json file from null to the absolute path to the folder containing all data (The challenge_folder from the previous point).
If you follow the BIDS structure, by downloading the whole dataset, the folders preprocessed_eeg, preprocessed_stimuli and split_data, should be located inside the 'derivatives' folder. If you only download these three folders, make sure they are either in a subfolder 'derivatives', or change the 'derivatives' folder in the config, otherwise you will get a file-not-found error when trying to run the experiments.
OK, you should be all setup now!
Each task has already some ready-to-go experiments files defined to give you a
baseline and make you acquainted with the problem. The experiment files live
in the experiment subfolder for each task. The training log,
best model and evaluation results will be stored in a folder called
results_{experiment_name}. For general ideas, you might want to look at the winners of the
previous ICASSP auditory EEG challenge.
By running task1_match_mismatch/experiments/dilated_convolutional_model.py, you can train the dilated convolutional model introduced by Accou et al. (2021a) and (2021b).
Other models you might find interesting are Decheveigné et al (2021), Monesi et al. (2020), Monesi et al. (2021),….
See more information about Task1 at Task 1: Match-mismatch
By running task2_regression/experiments/linear_baseline.py, you can train and evaluate a simple linear baseline model with Pearson correlation as a loss function, similar to the baseline model used in Accou et al (2022).
By running task2_regression/experiments/vlaai.py, you can train/evaluate the VLAAI model as proposed by Accou et al (2022). You can find a pre-trained model at VLAAI's github page.
Other models you might find interesting are: Thornton et al. (2022),...
See more information about Task2 at Task 2: Regression