Seonglae ChoMaking LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
https://huggingface.co/blog/4bit-transformers-bitsandbytes
How to Fine-Tune LLMs in 2024 with Hugging Face
In this blog post you will learn how to fine-tune LLMs using Hugging Face TRL, Transformers and Datasets in 2024. We will fine-tune a LLM on a text to SQL dataset.
https://www.philschmid.de/fine-tune-llms-in-2024-with-trl
Supervised Fine-tuning Trainer
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
https://huggingface.co/docs/trl/sft_trainer