import evaluate model_id='seonglae/yokhal-md' perplexity = evaluate.load("perplexity", module_type="metric") input_texts = ["lorem ipsum", "Happy Birthday!", "Bienvenue"] results = perplexity.compute(model_id=model_id, add_start_token=True, predictions=input_texts) print(round(results["mean_perplexity"], 2))
HuggingFace Evaluate Perplexity
Creator
Creator
Seonglae ChoCreated
Created
2024 Mar 9 13:7Editor
Editor
Seonglae ChoEdited
Edited
2024 Mar 11 12:24Refs
Refs
Perplexity