[QUESTION] Converting a Megatron-LM ckpt to Nemo

[abgoswam]

Following the GPT Pretraining section in the Megatron-LM repo, we are able to successfully train a model using Megatron-LM

I saw pointers on how to convert from HF to nemo. For example, this conversion script convert_llama_hf_to_nemo.py

However I did not see any examples of converting a ckpt saved using the Megatron-LM to nemo format . Are there any examples for this?

p.s. I am thinking of doing this conversion to nemo, so I can use tools like Nemo-Aligner for post-training

[gaojingwei]

I also encountered the same problem in nemo 2.0

[Phlip79]

This doc might be helpful, although it only applies if you are using Nemo 2.5.0 or older.