Will the pre-training code be released in the future?

Very amazing job! I wanna try to follow this work from pre-training, but I don’t see any code related to pre-training. Will this part of the code be released in the future? Looking forward to your responses.