CLI
- Linux 2.6.18+ (ARM64 or AMD64) i.e. any distro RHEL5 or newer
- macOS 15.6+ (ARM64 or AMD64, with GPU only supported on ARM64)
- Windows 8+ (AMD64)
- FreeBSD 13+ (AMD64, GPU should work in theory)
- NetBSD 9.2+ (AMD64, GPU should work in theory)
- OpenBSD 7+ (AMD64, no GPU support)
LLaMa3
for 25x sppeed on CPU