Seonglae Choeasy way to use models for inference
max_new_tokens- max generated tokens
FP16으로 Transformers Pipeline에 모델 로드하기
Junbum Lee Personal Notion Site
https://junbuml.ee/fp16-transformers-pipeline
Huggingface Transformers Pipeline
Huggingface Transformers 라이브러리의 pipeline에 사용하는 옵션들
https://junbuml.ee/transformers-pipeline-options