QLoRA Implementation

Creator

Creator

Seonglae Cho

Created

Created

2023 Oct 29 5:15

Editor

Editor

Seonglae Cho

Edited

Edited

2023 Oct 29 5:20

Refs

Refs

gptqlora
qwopqwop200 • Updated 2024 Jan 23 3:25

qlora
artidoro • Updated 2023 Jun 22 13:15

Fine-tune Falcon 180B with QLoRA and Flash Attention on Amazon SageMaker

Learn how to fine-tune Falcon 180B with QLoRA and Flash Attention on Amazon SageMaker.

https://www.philschmid.de/sagemaker-falcon-180b-qlora

Fine-tune Falcon 180B with QLoRA and Flash Attention on Amazon SageMaker

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

https://huggingface.co/blog/4bit-transformers-bitsandbytes

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

Recommendations

////////////