LLaMaFile

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2023 Dec 15 3:22
Editor
Edited
Edited
2024 Apr 28 8:49
Refs
Refs
GGUF

CLI

  • Linux 2.6.18+ (ARM64 or AMD64) i.e. any distro RHEL5 or newer
  • macOS 15.6+ (ARM64 or AMD64, with GPU only supported on ARM64)
  • Windows 8+ (AMD64)
  • FreeBSD 13+ (AMD64, GPU should work in theory)
  • NetBSD 9.2+ (AMD64, GPU should work in theory)
  • OpenBSD 7+ (AMD64, no GPU support)
 
 
 

LLaMa3

for 25x sppeed on CPU
 
 

Recommendations