API Reference — tensorrt_llm documentation
model (str or Path) – The model name or a local model directory.
Note that if the value could be both a model name or a local model directory,
the local model directory will be prioritized.
https://nvidia.github.io/TensorRT-LLM/llm-api/reference.html#tensorrt_llm.llmapi.SamplingParams