Soft Prompt

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2023 Sep 5 15:36
Editor
Edited
Edited
2023 Sep 6 13:4
Refs
Refs

Prompts consist of an embedding

So for sure, a disadvantage is the lack of interpretability of soft prompts.
Soft prompts are created during the process of prompt tuning
including additional context in the input text
model weights are frozen, and the parameters of a prompt are updated
이식성이 낮음
어텐션 블락 들어가기 전 임베딩 생성전에 레이어 추가하여 생성되고 그부분 훈련
 
 
 
 
 
 

Recommendations