SFTTrainer 源码解读: Prepare Train

• Prepare Train 总体逻辑
• Prepare Train 代码细节
  • _inner_training_loop
  • training_step
  • compute_loss
  • PeftModelForCausalLM.forward
  • Linear4bit.forward

SFTTrainer 源码解读: Prepare Dataset

• Prepare Dataset 总体逻辑
• Prepare Dataset 代码细节
  • SFTTrainer.init
  • DataCollatorForLanguageModeling
  • _prepare_dataset

SFTTrainer 源码解读: Prepare Model

• Prepare Model 总体逻辑
• Prepare Model 代码细节
  • _prepare_peft_model
  • PeftModelForCausalLM.init
  • PeftModel.init
  • LoraModel.init
  • Linear4bit.init
  • LoraLayer.init(self, base_layer)