Seonglae Chotask specific frozen model and fine tune prefix virtual token
can’t be generalized because it is task specific
subset of prompt tuning (case of soft prompt is prefix)
task specific하게 input text 에 prefix로 virtual token 붙임
aclanthology.org
https://aclanthology.org/2021.acl-long.353.pdf
Prefix-Tuning: Optimizing Continuous Prompts for Generation
Xiang Lisa Li, Percy Liang. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
https://aclanthology.org/2021.acl-long.353/
