Toolkit+Modal related: MOUNT_DIR not syncing local folder with volume

[zablit]

This is for bugs only

Did you already ask in the discord?

Yes

You verified that this is a bug and not a feature request or question by asking in the discord?

Yes

Describe the bug

MOUNT_DIR doesn't sync the Modal volume with the local assigned folder even though the names match. Local folder remains empty. Any idea what i might be doing wrong? Thanks!

The relevant lines of code in run_modal.py are:

(lines 28-29)
MOUNT_DIR = "/root/ai-toolkit/outputs" # due to "cannot mount volume on non-empty path" requirement

(lines 95-96)
# create the Modal app with the necessary mounts and volumes app = modal.App(name="headshots", image=image, mounts=[code_mount], volumes={MOUNT_DIR: model_volume})

(lines 141-143)
job.config['process'][0]['training_folder'] = MOUNT_DIR os.makedirs(MOUNT_DIR, exist_ok=True) print(f"Training outputs will be saved to: {MOUNT_DIR}")

and in the ai-toolkit config yaml (line 9):

training_folder: "/root/ai-toolkit/outputs" # must match MOUNT_DIR from run_modal.py

[vivek-kumar-poddar]

I am having the same issue.