Prefix Tuning

Created

Created

2023 Sep 5 16:5

Editor

Editor

Seonglae Cho

Creator

Creator

Seonglae Cho

Edited

Edited

2023 Sep 10 13:32

Refs

Refs

task specific frozen model and fine tune prefix virtual token

can’t be generalized because it is task specific

subset of prompt tuning (case of soft prompt is prefix)

task specific하게 input text 에 prefix로 virtual token 붙임

aclanthology.org

https://aclanthology.org/2021.acl-long.353.pdf

Prefix-Tuning: Optimizing Continuous Prompts for Generation

Xiang Lisa Li, Percy Liang. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.

Prefix-Tuning: Optimizing Continuous Prompts for Generation

https://aclanthology.org/2021.acl-long.353/

Prefix-Tuning: Optimizing Continuous Prompts for Generation

Recommendations

//////////