Fine-Tuning Question?

[robot-gen]

Can I directly leverage the Cosmos-1.0-Diffusion-7B-Video2World checkpoint to continue fine-tuning it by using the training code from NeMo's Diffusion?

If not, where can I download the model checkpoint of the DiT5/7B model for NeMo fine-tuing?

Thanks!

[snowmanwwg]

Finetuning code will be available in the next day or so. Will let you know.

[ethanhe42]

Hi @robot-gen , fine-tuning is available here https://github.com/NVIDIA/Cosmos/tree/main/cosmos1/models/diffusion/nemo/post_training#readme

[robot-gen]

Thanks，this is a fantastic work! I am expecting the coming Video2World finetuning code~

[jpenningCA]

@robot-gen I'm a PM at NVIDIA for COSMOS, can you share your use case for Post-training/Fine-tuning using the Video2world WFM?

[akshatd007]

@jpenningCA Hey, I would love to actually view the Video2World finetuning script. I used the 14B video2world on an A100 40GB. However, my use case for interior and lifestyle generations seem to be satisfied using the 7B varaint.

I wanted to fine tune it in order to reduce deformations and more importantly have the WFM model follow camera prompts more accurately. Thanks Joel