Huggingface PEFT UsagesPeftModel.merge_and_unload()PEFT.LoraConfig PEFT로 LoRA Checkpoint 로드시 size mismatch 해결법base_model.model.gpt_neox.layers.0.attention.query_key_value.lora_A.weight: copying a param with shape torch.Size([16, 5120]) from checkpoint, the shape in current model is torch.Size([8, 5120]) 와 같은 문제를 해결하기https://junbuml.ee/lora-ckpt-size-mismatchPEFTWe’re on a journey to advance and democratize artificial intelligence through open source and open science.https://huggingface.co/docs/peft/index
