Issues

• [Feature] 该怎么在VLM训练里也用这个框架？有示例吗

  enhancement
  InternLM/InternEvo#426 · Filter by author lynshwoo2022 opened on Apr 29, 2025
  

• [Bug] Some spelling errors in repo

  bug
  InternLM/InternEvo#417 · Filter by author kkscilife opened on Feb 20, 2025
  

• [Bug] CPU Mem utilization grows with training, when Dataloader num_workers>0

  bug
  InternLM/InternEvo#415 · Filter by author BradZhone opened on Feb 18, 2025
  

• [Bug] TypeError: Qwen2.__init__() got an unexpected keyword argument 'enable_qkv_fusion'

  bug
  InternLM/InternEvo#408 · Filter by author luojiapeng14 opened on Jan 31, 2025
  

• [Feature] Add Lingen - MATE architecture (SSM Mamba2 based) as a model option

  enhancement
  InternLM/InternEvo#402 · Filter by author mgyong opened on Jan 13, 2025
  2

  

• [Bug] loss error: flat_fp32_avg_grads will not be scaled when hybridzerooptimizer use cpu_offload

  bug
  InternLM/InternEvo#398 · Filter by author fengsibo opened on Jan 1, 2025
  2

  

• [QA] 训练到一半Nan grad norm occurs, please check it

  question
  InternLM/InternEvo#375 · Filter by author wang-benqiang opened on Nov 24, 2024
  

• [QA] Does internEvo support loongtrain selective checkpoint++?

  question
  InternLM/InternEvo#372 · Filter by author wplf opened on Nov 20, 2024
  1

  

• [QA] 如何进行单卡微调的，需要调整那些设置

  question
  InternLM/InternEvo#354 · Filter by author OkGuai opened on Oct 25, 2024
  

• [QA] loong train 支持packed_sample_into_one=false吗

  question
  InternLM/InternEvo#346 · Filter by author Lzhang-hub opened on Sep 27, 2024
  1

  

• [Feature] MoE模型里稠密层和专家层zero和并行的解耦

  enhancement
  InternLM/InternEvo#325 · Filter by author sunpengsdu opened on Sep 11, 2024
  

• [Feature] 不使用memory pool

  enhancement
  InternLM/InternEvo#324 · Filter by author sunpengsdu opened on Sep 11, 2024
  1

  

• [QA] check import system var at the start of training

  question
  InternLM/InternEvo#300 · Filter by author sunpengsdu opened on Aug 17, 2024
  

• [Feature] how to finetuning lora

  enhancement
  InternLM/InternEvo#286 · Filter by author wen020 opened on Jul 26, 2024
  1

  

• [Bug] RuntimeError: [3] is setting up NCCL communicator and retrieving ncclUniqueId from [0] via c10d key-value store by key '0', but store->get('0') got error: Socket Timeout

  bug
  InternLM/InternEvo#285 · Filter by author kkscilife opened on Jul 25, 2024
  

• [Bug] 仅支持了GShard模式的MoE模型转huggingface

  bug
  InternLM/InternEvo#279 · Filter by author Cerberous opened on Jul 16, 2024
  

• [Bug] 训练bf16 infer fp16出现NaN

  bug
  InternLM/InternEvo#278 · Filter by author Cerberous opened on Jul 16, 2024
  

• [Bug] TFLOPS计算不准

  bug
  InternLM/InternEvo#269 · Filter by author Cerberous opened on Jul 3, 2024
  2

  

• [QA] InternEvo能否load预训练llama2的参数

  question
  InternLM/InternEvo#268 · Filter by author JunZhan2000 opened on Jul 2, 2024
  4

  

• [QA] Internevo是否支持tied_embedding?

  question
  InternLM/InternEvo#267 · Filter by author Cerberous opened on Jul 1, 2024
  3

  

• [Bug] 使用internevo训练，转换成hf模型用opencompass测试时候有一定概率会nan

  bug
  InternLM/InternEvo#266 · Filter by author Cerberous opened on Jul 1, 2024
  2

  

• [Bug] 用MoE训练的时候tflop超级低

  bug
  InternLM/InternEvo#264 · Filter by author Cerberous opened on Jun 28, 2024
  4

• [Bug] 好像没有把internevo的MoE权重转换成huggingface版本的脚本？

  bug
  InternLM/InternEvo#262 · Filter by author Cerberous opened on Jun 27, 2024
  8

  

• [QA] Internevo这个框架里面MoE支持expert parallel嘛？

  question
  InternLM/InternEvo#253 · Filter by author Cerberous opened on Jun 18, 2024
  1

  

• [QA] 用Internevo已经训练出来了一个7B模型，如何用这个internevo权重跑MoE？

  question
  InternLM/InternEvo#251 · Filter by author Cerberous opened on Jun 17, 2024
  1