Huggingface PEFT

Creator

Creator

Seonglae Cho

Created

Created

2023 Dec 7 9:14

Editor

Editor

Seonglae Cho

Edited

Edited

2024 Mar 31 5:38

Refs

Refs

Language Model RL

Huggingface PEFT Usages

PeftModel.merge_and_unload()

PEFT.LoraConfig

PEFT로 LoRA Checkpoint 로드시 size mismatch 해결법

base_model.model.gpt_neox.layers.0.attention.query_key_value.lora_A.weight: copying a param with shape torch.Size([16, 5120]) from checkpoint, the shape in current model is torch.Size([8, 5120]) 와 같은 문제를 해결하기

PEFT로 LoRA Checkpoint 로드시 size mismatch 해결법

https://junbuml.ee/lora-ckpt-size-mismatch

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

PEFT

https://huggingface.co/docs/peft/index

PEFT

Recommendations

/////////