CLI
- Linux 2.6.18+ (ARM64 or AMD64) i.e. any distro RHEL5 or newer
- macOS 15.6+ (ARM64 or AMD64, with GPU only supported on ARM64)
- Windows 8+ (AMD64)
- FreeBSD 13+ (AMD64, GPU should work in theory)
- NetBSD 9.2+ (AMD64, GPU should work in theory)
- OpenBSD 7+ (AMD64, no GPU support)
LLaMa3
for 25x sppeed on CPU
Bash One-Liners for LLMs
Tutorial on how llamafile makes LLMs shell scriptable.
https://justine.lol/oneliners/

Llamafile’s progress, four months in – Mozilla Hacks - the Web developer blog
Mozilla’s Innovation group launched the llamafile project last year and it has become one of Mozilla’s most-favorited repositories on GitHub.
https://hacks.mozilla.org/2024/04/llamafiles-progress-four-months-in/


Seonglae Cho