Issues

• How to use fabric.clip_gradients in 16-mixed?

  help wantedquestion
  Lightning-AI/litgpt#2042 · Filter by author VJJJJJJ1 opened on May 15, 2025

• finetune_lora on gemma bug

  bughelp wanted
  Lightning-AI/litgpt#2020 · Filter by author qqandy0120 opened on Apr 26, 2025
  1

• Why Alpaca is only mask_prompt=False??

  help wantedquestion
  Lightning-AI/litgpt#1987 · Filter by author HERIUN opened on Mar 31, 2025

• After Fintune lora. apply chat_template

  help wantedquestion
  Lightning-AI/litgpt#1986 · Filter by author HERIUN opened on Mar 31, 2025

• UserWarning: The file size of checkpoints/microsoft/phi-4/lit_model.pth is over 4.2 GB.

  help wantedquestion
  Lightning-AI/litgpt#1979 · Filter by author harisnae opened on Mar 25, 2025
  1

• finetune (lora) with LitData

  help wantedquestion
  Lightning-AI/litgpt#1966 · Filter by author mtasic85 opened on Mar 13, 2025

• Getting probability distributions

  help wantedquestion
  Lightning-AI/litgpt#1950 · Filter by author SeriousJ55 opened on Mar 5, 2025

• Generating output from finetuned model using LLM.generate() method vs litgpt chat cli command

  help wantedquestion
  Lightning-AI/litgpt#1937 · Filter by author asmitnayak opened on Feb 16, 2025

• Merging weights after Finetuning with Adapter.

  help wantedquestion
  Lightning-AI/litgpt#1921 · Filter by author chnyhz opened on Jan 26, 2025

• LitGPT fine-tuning Dont Use GPU

  help wantedquestion
  Lightning-AI/litgpt#1911 · Filter by author strikene opened on Jan 20, 2025
  2

• Trouble to load a litpgt trained model using transformers library

  help wantedquestion
  Lightning-AI/litgpt#1910 · Filter by author nxtr-admin-it opened on Jan 20, 2025

• Exporting LoRA to HF format without merging

  help wantedquestion
  Lightning-AI/litgpt#1878 · Filter by author M1TR opened on Dec 20, 2024
  3

• Fine-Tuning Chat Model with Domain-Specific Data for custom dataset

  help wantedquestion
  Lightning-AI/litgpt#1877 · Filter by author anantgupta129 opened on Dec 18, 2024

• failure converting pretrained litgpt checkpoints to HF format: a reproducible example

  bughelp wanted
  Lightning-AI/litgpt#1871 · Filter by author 2533245542 opened on Dec 12, 2024
  5

• Issues Converting lit_model.pth to Huggingface Format Using convert_from_litgpt

  help wantedquestion
  Lightning-AI/litgpt#1847 · Filter by author Kidand opened on Dec 2, 2024
  7

• Finetune LLM model for Classification task

  help wantedquestion
  Lightning-AI/litgpt#1839 · Filter by author Mustehsen-AI opened on Nov 27, 2024

• Pretraining an OLMo model on the SlimPajama dataset

  help wantedquestion
  Lightning-AI/litgpt#1837 · Filter by author aflah02 opened on Nov 26, 2024
  16

• Performance degradation on multi-node pretrain

  help wantedquestion
  Lightning-AI/litgpt#1836 · Filter by author HaebinShin opened on Nov 25, 2024

• Multi-gpu training with slurm times out

  bughelp wanted
  Lightning-AI/litgpt#1832 · Filter by author nightingal3 opened on Nov 19, 2024
  6

• pretraining multi jobs

  help wantedquestion
  Lightning-AI/litgpt#1831 · Filter by author sadrafh opened on Nov 18, 2024

• Pretrain with Llama3.1-70b

  help wantedquestion
  Lightning-AI/litgpt#1828 · Filter by author sadrafh opened on Nov 12, 2024

• openai-gpt2

  help wantedquestion
  Lightning-AI/litgpt#1824 · Filter by author sorobedio opened on Nov 5, 2024

• chatting with mistral generates answer with no spaces

  buggood first issuehelp wanted
  Lightning-AI/litgpt#1822 · Filter by author micrem73 opened on Nov 4, 2024
  3

• Errors when try to save checkpoints during the full fine-tuning

  help wantedquestion
  Lightning-AI/litgpt#1764 · Filter by author lemon-awa opened on Oct 1, 2024

• Abnormal Output from Gemma Pretrained Model After Conversion to Hugging Face Format

  bughelp wanted
  Lightning-AI/litgpt#1762 · Filter by author SKNahin opened on Sep 30, 2024
  2