Useful Stuff

Optional topics that are useful once the core training flow is already familiar.

Pages in This Section

• Sharding — multi-device training and placement
• PEFT — parameter-efficient fine-tuning
• GaLore — optimizer memory reduction with low-rank projection
• Logging Backend — logging integrations and notes