TRL

Creator

Creator

Created

Created

2023 Sep 9 17:8

Editor

Editor

Edited

Edited

2025 Mar 5 21:34

Refs

Refs

Preference Optimization

Policy Gradient Learning

Transformer Model reinforcement learning

TRL Rewards

RAFT

Constitutional AI

Gradient Coefficient Reward

Self Rewarding LLM

TRL Benchmarks

FollowBenchEval

Reinforcement Learning Transformers

Decision Transformer

Trajectory Transformer

BodyTransformer

\pi0

SFT Memorizes, RL Generalizes (

Model Generalization,

While the provocative title is not exactly correct, it provides insight even for Multimodality

SFT Memorizes, RL Generalizes

SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training

SFT Memorizes, RL Generalizes

https://tianzhechu.com/SFTvsRL/

SFT Memorizes, RL Generalizes

Appendix is awesome for
TRL

https://arxiv.org/pdf/2402.03300

TRL - Transformer Reinforcement Learning

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

TRL - Transformer Reinforcement Learning

https://huggingface.co/docs/trl

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

https://huggingface.co/blog/trl-peft

How to Fine-Tune LLMs in 2024 with Hugging Face

In this blog post you will learn how to fine-tune LLMs using Hugging Face TRL, Transformers and Datasets in 2024. We will fine-tune a LLM on a text to SQL dataset.

How to Fine-Tune LLMs in 2024 with Hugging Face

https://www.philschmid.de/fine-tune-llms-in-2024-with-trl

How to Fine-Tune LLMs in 2024 with Hugging Face

Recommendations

//////