Seonglae ChoVirtual sharing even when NVIDIA hardware level MIG is not supported
genv llm serve phi4 --gpus 1 --gpu-memory 12g
It's for shared usage, and remote multi-GPU is not supported - it just uses the first server
Overview — Genv 1.4.3 documentation
Genv is an environment management software for GPUs that manages GPUs on a single machine or in a cluster.
https://docs.genv.dev/llms/overview.html