Original release notes
What's Changed
0.10.5 is a release that focused on making the "sync with upstream llama.cpp" task simpler and better. In the span of 2 weeks we performed three syncs and took advantage of these iterations to improve the llamafile skill/plugin for AI agents. The result is a better process that provides more reliable code, requiring fewer iterations to go from an auto-generated draft PR to the final merged code. As a byproduct, llamafile now supports very recent models such as Ternary Bonsai 27B and Laguna-S-2.1.
Thanks to our community's contributions, this release also brings significant documentation updates clarifying the new help system, the difference between different lllamafile executables, and up-to-date llamafile GPU support. Many thanks everyone for the huge help!
- Update llama.cpp to b10052 (b2dd28a) by @aittalam in https://github.com/mozilla-ai/llamafile/pull/1021
- Update llama.cpp to b10083 (846e991) by @aittalam in https://github.com/mozilla-ai/llamafile/pull/1026
- Improve llamacpp update skill by @aittalam in https://github.com/mozilla-ai/llamafile/pull/1027
- Update llama.cpp to b10103 (c588c4f) by @aittalam in https://github.com/mozilla-ai/llamafile/pull/1030
- docs(quickstart): clarify llamafile vs llamafile-thin and other release binaries (#1022) by @Anai-Guo in https://github.com/mozilla-ai/llamafile/pull/1023
- build(install): install transcribefile so it ships as a release artifact (#1035) by @Anai-Guo in https://github.com/mozilla-ai/llamafile/pull/1036
- Fix typo in README.md for 'architectures' by @shawntax in https://github.com/mozilla-ai/llamafile/pull/1031
- docs: Add docs for cli args and tools by @angpt in https://github.com/mozilla-ai/llamafile/pull/1037
- docs(support): document the Vulkan GPU backend (#1029) by @Anai-Guo in https://github.com/mozilla-ai/llamafile/pull/1033
New Contributors
- @shawntax made their first contribution in https://github.com/mozilla-ai/llamafile/pull/1031
Full Changelog: https://github.com/mozilla-ai/llamafile/compare/0.10.4...0.10.5
