TRL

Creator

Creator

Seonglae Cho

Created

Created

2023 Sep 9 17:8

Editor

Editor

Seonglae Cho

Edited

Edited

2024 Jul 8 15:3

Refs

Refs

Preference Optimization

Policy Gradient Learning

Transformer Model reinforcement learning

TRL Notion

RAFT

Constitutional AI

Reinforcement Learning Transformers

Decision Transformer

Trajectory Transformer

TRL - Transformer Reinforcement Learning

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

TRL - Transformer Reinforcement Learning

https://huggingface.co/docs/trl

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

https://huggingface.co/blog/trl-peft

How to Fine-Tune LLMs in 2024 with Hugging Face

In this blog post you will learn how to fine-tune LLMs using Hugging Face TRL, Transformers and Datasets in 2024. We will fine-tune a LLM on a text to SQL dataset.

How to Fine-Tune LLMs in 2024 with Hugging Face

https://www.philschmid.de/fine-tune-llms-in-2024-with-trl

How to Fine-Tune LLMs in 2024 with Hugging Face

Recommendations

///////