Texonom
Texonom/
Engineering
Engineering/Data Engineering/Artificial Intelligence/Machine Learning/Reinforcement Learning/Language Model RL/Huggingface TRL/
TRL setup_chat_format()
Search

TRL setup_chat_format()

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2024 Mar 4 9:40
Editor
Editor
Seonglae ChoSeonglae Cho
Edited
Edited
2025 Jul 13 22:40
Refs
Refs
ChatML
Huggingface Tokenizer.apply_chat_template()
Preparing models and tokenizers for chat-based fine-tuning
  • Adds essential tokens like mark conversation boundaries
  • Automatically resizes the model's embedding layer to accommodate the newly added special tokens
  • Sets up the tokenizer's chat_template to format input data into a chat-like structure, defaulting to OpenAI's
    ChatML     format
 
 
 
 
How to Fine-Tune LLMs in 2024 with Hugging Face
In this blog post you will learn how to fine-tune LLMs using Hugging Face TRL, Transformers and Datasets in 2024. We will fine-tune a LLM on a text to SQL dataset.
How to Fine-Tune LLMs in 2024 with Hugging Face
https://www.philschmid.de/fine-tune-llms-in-2024-with-trl
How to Fine-Tune LLMs in 2024 with Hugging Face
 
 

Recommendations

Texonom
Texonom/
Engineering
Engineering/Data Engineering/Artificial Intelligence/Machine Learning/Reinforcement Learning/Language Model RL/Huggingface TRL/
TRL setup_chat_format()