HuggingFace Evaluate Perplexity

Creator
Creator
Seonglae Cho
Created
Created
2024 Mar 9 13:7
Editor
Edited
Edited
2024 Mar 11 12:24
Refs
import evaluate model_id='seonglae/yokhal-md' perplexity = evaluate.load("perplexity", module_type="metric") input_texts = ["lorem ipsum", "Happy Birthday!", "Bienvenue"] results = perplexity.compute(model_id=model_id, add_start_token=True, predictions=input_texts) print(round(results["mean_perplexity"], 2))
 
 
 
 
 
 

Recommendations