Huggingface Text Generation

Creator

Creator

Seonglae Cho

Created

Created

2023 Jul 15 7:2

Editor

Editor

Seonglae Cho

Edited

Edited

2024 Mar 11 17:23

Refs

Refs

Causal language model

Next Token Prediction

do_sample boolean default False (random)

decoding strategies
top_k 1이상 샘플 개수 뽑을지
num_beams (beam means set of candidate sequences)

1 means greedy search

no_repeat_ngram_size default 0 (all ngrams of that size can only occur once)

max_length

min_length

max_new_tokens

repetition_penalty 1이상

HF TG Usages

HF GenerationConfig

HF TG generate()

HF TG beam_search()

HF TG beam_sample()

HF TG contrastive_search()

HF TG group_beam_search()

Transformers StoppingCriteria

HF TextStreamer

Huggingface Transformers Config

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

https://huggingface.co/docs/transformers/v4.30.0/main_classes/text_generation

Generation

Recommendations

///////