Large Language Models
Lecture 15
Parameter Efficient Fine-Tuning (PEFT)
Krishnendu Ghosh
Transfer Learning Before LLM Era
Transfer Learning Before LLM Era
Transfer Learning Before LLM Era
Transfer Learning Before LLM Era
Downsides of In-context Learning
Full Fine-tuning in LLM Challenging?
Parameter Efficient Fine Tuning
PEFT Advantages
PEFT Techniques
(Soft) Prompt Tuning (Lester et al. 2021)
(Soft) Prompt Tuning:
Multi-Task Serving
(Soft) Prompt Tuning:
Multi-Task Serving
(Soft) Prompt Tuning
(Soft) Prompt Tuning
(Soft) Prompt Tuning
PEFT Techniques
Prefix Tuning (Li & Liang 2021)
Prefix Tuning (Li & Liang 2021)
Prefix Tuning (Li & Liang 2021)
PEFT Techniques
Adapters (Houlsby et al 2019)
Adapters
Adapters
PEFT Techniques
Low Rank Composition
Intrinsic Dimensionality (ID)
Structure-Aware Intrinsic Dimension
Structure-Aware Intrinsic Dimension
Structure-Aware Intrinsic Dimension
Low Rank Adaptation (LoRA)
Low Rank Adaptation (LoRA)
Low Rank Adaptation (LoRA)
Low Rank Adaptation (LoRA)
LoRA: Effect on Weight Matrices
LoRA: Effect on Performance
LoRA Weights Initialization
Extensions of LoRA
PEFT Techniques
LLM Sizes
LLM Sizes
LLM Sizes
LLM Inference
LLM Inference
LLM Inference
Cost Effective Inference
Model Compression
Quantization: Problem with LLMs
Quantization: Numerical Values Representation
Quantizing FP32 to INT8
Dequantizing INT8 to FP32
Post Training Quantization (PTQ)
Post Training Quantization (PTQ)
Post Training Quantization (PTQ)
PTQ: LLM.int8() [Dettmers et al., 2022]
PTQ: LLM.int8() [Dettmers et al., 2022]
PTQ: LLM.int8() [Dettmers et al., 2022]
QLoRA [Dettmers et al. 2023]
QLoRA [Dettmers et al. 2023]
QLoRA [Dettmers et al. 2023]
QLoRA [Dettmers et al. 2023]
QLoRA [Dettmers et al. 2023]
QLoRA [Dettmers et al. 2023]
QLoRA [Dettmers et al. 2023]
QLoRA [Dettmers et al. 2023]
QLoRA [Dettmers et al. 2023]
QLoRA [Dettmers et al. 2023]
Pruning
Magnitude Pruning
[Han et al. 2015, See et al. 2016]
Wanda [Sun et al. 2023]
Wanda [Sun et al. 2023]
Unstructured Pruning
Structured Pruning
Structured Pruning [Xia et al. 2022]
Distillation [Hinton et al 2015]
Distillation [Hinton et al 2015]
Distillation [Hinton et al 2015]
Sequence Level Distillation
[Kim et al. 2016]
Self-Instruct [Wang et al. 2023]
Source: https://lcs2-iitd.github.io/ELL881-AIL821-2401/lectures/