You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
error with .nemo model. invalid strategy name: strategy=<nemo.collections.nlp.parts.nlp_overrides.NLPDDPStrategy object at 0x7fd7b9f79f60>. It must be either a string or an instance of lightning.pytorch.strategies.Strategy#2647
Open
songwang41 opened this issue
Jan 21, 2025
· 0 comments
ValueError: You selected an invalid strategy name: strategy=<nemo.collections.nlp.parts.nlp_overrides.NLPDDPStrategy object at 0x7fd7b9f79f60>. It must be either a string or an instance of lightning.pytorch.strategies.Strategy. Example choices: auto, ddp, ddp_spawn, deepspeed, ... Find a complete list of options in our documentation at https://lightning.ai
The text was updated successfully, but these errors were encountered:
torchrun --nproc-per-node=4 --no-python lm_eval
--model nemo_lm
--model_args path=/projects/llm/models/weight/Llama-3.1-8B.nemo,devices=4,tensor_model_parallel_size=2,pipeline_model_parallel_size=2
--tasks ifeval
--batch_size 32
ValueError: You selected an invalid strategy name:
strategy=<nemo.collections.nlp.parts.nlp_overrides.NLPDDPStrategy object at 0x7fd7b9f79f60>
. It must be either a string or an instance oflightning.pytorch.strategies.Strategy
. Example choices: auto, ddp, ddp_spawn, deepspeed, ... Find a complete list of options in our documentation at https://lightning.aiThe text was updated successfully, but these errors were encountered: