Texonom
Texonom/
Science
Science/Mathematics/Math Field/Statistics/Statistical Model/Model Generalization/Model Training/Fine Tuning/PEFT/LoRA/QLoRA/
QLoRA Implementation
Search

QLoRA Implementation

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2023 Oct 29 5:15
Editor
Editor
Seonglae ChoSeonglae Cho
Edited
Edited
2023 Oct 29 5:20
Refs
Refs
 
 
 
Fine-tune Falcon 180B with QLoRA and Flash Attention on Amazon SageMaker
Learn how to fine-tune Falcon 180B with QLoRA and Flash Attention on Amazon SageMaker.
Fine-tune Falcon 180B with QLoRA and Flash Attention on Amazon SageMaker
https://www.philschmid.de/sagemaker-falcon-180b-qlora
Fine-tune Falcon 180B with QLoRA and Flash Attention on Amazon SageMaker
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
https://huggingface.co/blog/4bit-transformers-bitsandbytes
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
 
 

Recommendations

Texonom
Texonom/
Science
Science/Mathematics/Math Field/Statistics/Statistical Model/Model Generalization/Model Training/Fine Tuning/PEFT/LoRA/QLoRA/
QLoRA Implementation