跳到主要内容

peft

参数高效微调:LoRA、QLoRA、适配器

7 篇,已拆 0 篇。回总览

2023​

  • QLoRA: Efficient Finetuning of Quantized LLMs — paper=qlora@arXiv:2305.14314v1
  • Tree of Thoughts: Deliberate Problem Solving with Large Language Models — paper=tree-of-thoughts@arXiv:2305.10601v2

2022​

  • Efficient Few-Shot Learning Without Prompts — paper=efficient-few-shot-learning-without-prompts@arXiv:2209.11055v1

2021​

  • LoRA: Low-Rank Adaptation of Large Language Models — paper=lora@arXiv:2106.09685v2
  • Prefix-Tuning: Optimizing Continuous Prompts for Generation — paper=prefix-tuning@arXiv:2101.00190v1

2020​

  • First return, then explore — paper=first-return-then-explore@arXiv:2004.12919v6

2019​

  • Parameter-Efficient Transfer Learning for NLP — paper=parameter-efficient-transfer-learning-for-nlp@arXiv:1902.00751v2