SFTTrainer Source Code Exploration: Prepare Train

• Prepare Train Overall Logic
• Prepare Train Code Details
  • _inner_training_loop
  • training_step
  • compute_loss
  • PeftModelForCausalLM.forward
  • Linear4bit.forward