peft-fine-tuning

About peft-fine-tuning

Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train less than 1% of parameters with minimal accuracy loss, or for multi-adapter serving. HuggingFace's official library integrated with transformers ecosystem.

使用LoRA、QLoRA和25种以上方法对LLM进行参数高效微调。在有限GPU内存的情况下微调大型模型（7B-70B）时使用，当您需要以最小的准确性损失训练<1%的参数时，或用于多适配器服务。HuggingFace的官方库与transformers生态系统集成。