image root directory and annotation correspondence

[liyangliu]

Thank you for your great work. Could you please provide a file containing the correspondence between the image root directory and relative path in the annotation file ? Now in the annotation file there only exists the relative path, it's hard to find the absolute path of the image.

[LinB203]

Hi, image_root depends on your download folder.

For example, if you download the BLIP3o-60k dataset to /data/to/your/local/path, then image_root should be set to /data/to/your/local/path. This is because absolute paths vary across users, so we use a combination of absolute path and relative path (as specified in the JSON file).

In addition, we provide a visualization tool to help you verify whether the configuration is correct.

[liyangliu]

Thank you for your response. I download the data directly from HuggingFace and the data directory is as:

For some dataset, absolutely I can infer the image root directory from the json file. But for some datasets such as ImgEdit (e.g. UniWorld-V1/json/imgedit/laion_add_part0_edit.json), the relative path is as:

It's hard to know which image root should be assigned to the relative path, since the ImgEdit image directory is as:

It seems that the relative path in json file is not informative enough to get the absolute path of the image. Would be please provide a more accurate relative path ? Thanks.

[LinB203]

For UniWorld-V1/json/imgedit/laion_add_part0_edit.json, the data_root is imgedit/add. But ... sorry, I forgot to upload the imgedit/add. Please forgive me and let me uplaod it. Sorry again.

[liyangliu]

Thanks. It would be great if you could update the relative path in json files (and corresponded image files) according to this directory, so that users can directly concatenate the rootdir and relative path to obtain the absolute path of the image.

[LinB203]

Thank you for your suggestion. I will complete it when I have time. Before that, I will finish uploading the data first. Uploading data will be done in next hours...

[liyangliu]

Great! Thanks.

[LinB203]

Great! Thanks.

@liyangliu Hello, we have uploaded the imgedit/add. Feel free to contact me if anything wrong in dataset. Thanks!

[liyangliu]

@LinB203 Thanks a lot. It would be great to update the json file when you have time.

It would be great if you could update the relative path in json files according to this directory, so that users can directly concatenate the rootdir and relative path to obtain the absolute path of the image.

[tyxsspa]

@LinB203 Hi, seems like some folders in UniWorld-V1/data/imgedit (e.g, compose, transfer, action....) are not needed, right? I found that in the UniWorld-V1/json/imgedit folder, only add, adjust, background, remove, replace samples has json files.

[LinB203]

Sorry, we missed uploading this part. We have just checked and re-uploaded the JSON files for compose, action, and transfer. Welcome to use our datasets. Please contact us if you encounter any data issues.

@LinB203 Hi, seems like some folders in UniWorld-V1/data/imgedit (e.g, compose, transfer, action....) are not needed, right? I found that in the UniWorld-V1/json/imgedit folder, only add, adjust, background, remove, replace samples has json files.

[liyangliu]

Hi @LinB203, is there a easy way to get the relative path of the image from the json file according to the tree structure here? For example, in json/imgedit/laion_add_part0_edit.json I notice the path: 00106_00029_000290275/original.png, but I cannot find data/imgedit/add/add_part0/00106_00029_000290275/original.png. Thanks.

[LinB203]

Hi @LinB203, is there a easy way to get the relative path of the image from the json file according to the tree structure here? For example, in json/imgedit/laion_add_part0_edit.json I notice the path: 00106_00029_000290275/original.png, but I cannot find data/imgedit/add/add_part0/00106_00029_000290275/original.png. Thanks.

Maybe I need to refactor the JSON file. I think I will make it more clear tomorrow. Sorry again.

[LinB203]

@liyangliu @tyxsspa Hello, I have prepared a data.txt file about ImgEdit for your reference.

data/imgedit/action/action,json/imgedit/pandam_action_edit.json,true
data/imgedit/action/action_part2,json/imgedit/pandam2_action_edit.json,true
data/imgedit/action/action_part3,json/imgedit/pandam3_action_edit.json,true
data/imgedit/action/action_part4,json/imgedit/pandam4_action_edit.json,true
data/imgedit/add/add_part0,json/imgedit/laion_add_part0_edit.json,true
data/imgedit/add/add_part1,json/imgedit/laion_add_part1_edit.json,true
data/imgedit/add/add_part4,json/imgedit/results_add_laion_part4_edit.json,true
data/imgedit/add/add_part5,json/imgedit/results_add_laion_part5_edit.json,true
data/imgedit/adjust/adjust_part0,json/imgedit/results_adjust_canny_laion_part0_edit.json,true
data/imgedit/adjust/adjust_part2,json/imgedit/results_adjust_canny_laion_part2_edit.json,true
data/imgedit/adjust/adjust_part3,json/imgedit/results_adjust_canny_laion_part3_edit.json,true
data/imgedit/adjust/adjust_part4,json/imgedit/laion_adjust_canny_part4_edit.json,true
data/imgedit/background/background_part0,json/imgedit/results_background_laion_part0_edit.json,true
data/imgedit/background/background_part2,json/imgedit/results_background_laion_part2_edit.json,true
data/imgedit/background/background_part3,json/imgedit/laion_background_part3_edit.json,true
data/imgedit/background/background_part5,json/imgedit/laion_background_part5_edit.json,true
data/imgedit/background/background_part7,json/imgedit/laion_background_part7_edit.json,true
data/imgedit/compose/compose_part0,json/imgedit/results_compose_part0_edit.json,false
data/imgedit/compose/compose_part2,json/imgedit/results_compose_part2_edit.json,false
data/imgedit/compose/compose_part6,json/imgedit/results_compose_part6_fix_edit.json,false
data/imgedit/refine_replace/refine_replace_part1,json/imgedit/results_extract_ref_part1_refimg_edit.json,true
data/imgedit/remove/remove_part0,json/imgedit/laion_remove_part0_edit.json,true
data/imgedit/remove/remove_part1,json/imgedit/results_remove_laion_part1_edit.json,true
data/imgedit/remove/remove_part4,json/imgedit/results_remove_laion_part4_edit.json,true
data/imgedit/remove/remove_part5,json/imgedit/results_remove_laion_part5_edit.json,true
data/imgedit/replace/replace_part0,json/imgedit/laion_replace_part0_edit.json,true
data/imgedit/replace/replace_part1,json/imgedit/laion_replace_part1_edit.json,true
data/imgedit/replace/replace_part4,json/imgedit/results_replace_laion_part4_edit.json,true
data/imgedit/replace/replace_part5,json/imgedit/results_replace_laion_part5_edit.json,true
data/imgedit/transfer/transfer,json/imgedit/results_style_transfer_edit.json,false
data/imgedit/transfer/transfer_part0,json/imgedit/results_style_transfer_part0_cap36472_edit.json,false

[liyangliu]

@LinB203 Thanks. But this problem still exists, I cannot find the image (data/imgedit/add/add_part0/00106_00029_000290275/original.png) from the path in json file.

[LinB203]

@LinB203 Thanks. But this problem still exists, I cannot find the image (data/imgedit/add/add_part0/00106_00029_000290275/original.png) from the path in json file.

I checked the data, and it exists. Could you provide more information? For example, has it been completely un-package (it consists of multiple parts)? Are all of them missing, or just this one?