Genv

Creator

Creator

Seonglae Cho

Created

Created

2025 Jan 12 2:22

Editor

Editor

Seonglae Cho

Edited

Edited

2025 Nov 14 11:41

Refs

Refs

Virtual sharing even when NVIDIA hardware level
MIG is not supported


genv llm serve phi4 --gpus 1 --gpu-memory 12g

It's for shared usage, and remote multi-GPU is not supported - it just uses the first server

run-ai • Updated 2025 Nov 11 15:30

Overview — Genv 1.4.3 documentation

Genv is an environment management software for GPUs that manages GPUs on a single machine or in a cluster.

https://docs.genv.dev/llms/overview.html

Recommendations

//////