This release contains the pretrained and finetuned model weights with various configurations.
Note that pretrained-transformer-24l-1024d-400k is too large to upload, we remove the weights for teacher model and upload student weights only. It is named pretrained-transformer-24l-1024d-400k-student-only.