Publishing weights at different epochs during training?

[brianrobinson]

This codebase is an invaluable resource. Is there a way to access model weights during different epochs of training? I realize that publishing all weights during all epochs of training would be prohibitive, but publishing a few intermediate sets of weights (e.g. at 5-10 different epochs during training of smaller models, such as ViT-B16), would be a great resource for the community investigating the properties of these networks.

[rwightman]

https://huggingface.co/laion/scaling-laws-openclip/tree/main/full_checkpoints

There were some full sets for the scaling laws paper

[rwightman]

@brianrobinson