Prompt Optimization, Prompt Tuning
Prompt changes can significantly impact side effects, so prompt modifications should only be made when they result in Pareto improvements
A process of finding optimized prompts for models with fixed parameters
- Fewer tokens
- Same meaning
- Better results
Prompt Optimization Notion
Prompt Optimization Usages
LARGE LANGUAGE MODELS AS OPTIMIZERS
RLPROMPT: Optimizing Discrete Text Prompts with Reinforcement Learning
RLPROMPT: Optimizing Discrete Text Prompts with Reinforcement Learning, EMNLP 2022
https://velog.io/@mmodestaa/RLPROMPT-Optimizing-Discrete-Text-Promptswith-Reinforcement-Learning

Prompting
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
https://huggingface.co/docs/peft/conceptual_guides/prompting

Seonglae Cho