bitsandbytes

Creator

Creator

Seonglae Cho

Created

Created

2023 Jun 7 16:11

Editor

Editor

Seonglae Cho

Edited

Edited

2023 Dec 9 6:45

Refs

Refs

4-bit, 8-bit functions for PyTorch

BNB are useful for fine-tuning

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

https://huggingface.co/docs/transformers/main/en/quantization?bnb=4-bit#bitsandbytes

Quantization

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

https://huggingface.co/blog/4bit-transformers-bitsandbytes

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

Recommendations

////////