Pre-trained Prompt Tuning

Creator

Creator

Seonglae Cho

Created

Created

2023 Sep 10 13:28

Editor

Editor

Seonglae Cho

Edited

Edited

2025 Jul 10 23:6

Refs

Refs

PPT

Adding soft prompts into the pre-training stage to obtain a better initialization.

can reach or even outperform full-model fine-tuning under both full-data and few-shot settings

PPT: Pre-trained Prompt Tuning for Few-shot Learning

Prompts for pre-trained language models (PLMs) have shown remarkable performance by bridging the gap between pre-training tasks and various downstream tasks. Among these methods, prompt tuning,...

https://arxiv.org/abs/2109.04332

Recommendations

//////////