supported modelsSupported Models — SGLangpython3 -m sglang.launch_server --model-path lmms-lab/llava-onevision-qwen2-7b-ov --port=30000 --chat-template=chatml-llavahttps://docs.sglang.ai/references/supported_models.htmlSpeculative Decoding Speculative Decoding — SGLangSGLang now provides an EAGLE2-based speculative decoding option. Our implementation aims to maximize speed and efficiency and is considered to be among the fastest in open-source LLM engines.https://docs.sglang.ai/backend/speculative_decoding.html
Seonglae ChoSeonglae ChoSeonglae ChoSeonglae ChoSeonglae ChoSeonglae Cho
