Bug report #1765
Description
What happened?
Currently, the parameters for JEPA transformer head are specified as flat list:
loss_fcts : {
"JEPA": {
'weight': 4, "loss_extra_args": {}, "out_dim": 2048, "head": transformer,
"num_blocks": 6, "num_heads": 12, "with_qk_lnorm": True, "intermediate_dim": 768,
"dropout_rate": 0.1,
target_source_correspondence: {0 : {0 : "independent"} },
},
For maintainability, this needs to be a nested dict.
What are the steps to reproduce the bug?
No response
Hedgedoc link to logs and more information. This ticket is public, do not attach files directly.
No response