TRL

Creator

Creator

Alan Jo

Created

Created

2023 Sep 9 17:8

Editor

Editor

Alan Jo

Edited

Edited

2023 Nov 11 9:9

Refs

Refs

Preference Optimization

Transformers reinforcement learning

TRL Notion

RAFT

Constitutional AI

TRL Usages

Best of N sampling

TRL - Transformer Reinforcement Learning

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

TRL - Transformer Reinforcement Learning

https://huggingface.co/docs/trl

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

https://huggingface.co/blog/trl-peft

Recommendations

///////