Huggingface Transformers Profile

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2023 Nov 18 15:35
Editor
Edited
Edited
2026 Jan 7 11:49
Refs
batch-size 1 inference run on a HuggingFace Transformers model with very poor CPU/GPU overlap
batch-size 1 inference run on a HuggingFace Transformers model with very poor CPU/GPU overlap
 
 
 

Compile torch

Pipeline Batching

 
 
 

Recommendations