.svg?fit=max&auto=format&n=mQScX1J5vEe0-L40&q=85&s=24c5c941d6f990a4aab4041c9b243291)
Technical references
Bonsai collection
All Bonsai models repositories: 1-bit and ternary, GGUF and MLX.
1-bit and Ternary Bonsai 27B whitepaper
Architecture, training approach, and evaluation methodology for the Bonsai family.
Source code
Community benchmark
Measured throughput on real hardware (RTX 3080, GB10, Strix Halo, M4 Pro, and more) is collected incommunity-benchmarks/ in the demo repo. To contribute numbers for your hardware, copy the llama.cpp or MLX template in that folder, run the documented procedure, and open a pull request.
Get help
- Discord: discord.gg/prismml for questions, hardware reports, and announcements.
- GitHub issues: Bonsai-demo issues for bugs in the scripts or binaries.
- X / LinkedIn: @PrismML and PrismML on LinkedIn for release news.