Reading Route

Efficient Adaptation

Parameter-efficient tuning and compression methods for adapting large models with fewer trainable parameters.

1
2015 · Compression · Distillation
Distilling the Knowledge in a Neural Network
Coming soon
2
2019 · Efficiency · Adapter
Parameter-Efficient Transfer Learning for NLP
Coming soon
3
2021 · Efficiency · Prompt Tuning
The Power of Scale for Parameter-Efficient Prompt Tuning
Coming soon
4
2021 · Efficiency · LoRA
LoRA: Low-Rank Adaptation of Large Language Models
Coming soon