Built with Open reimplementations
sys1
Blazing fast, self-hosted structured decisions for open models with a TypeSafe AI compatible API, written in Rust.
58 ★ on GitHub
What it is
Blazing fast structured decisions for System One open-models self-hosted with a TypeSafe AI compatible API, written in Rust.
What the README says it does
- tokio, axum and serde, the usual suspects
- System One compatible API Spec
- candle with tokenizers release candidate!
- Dynamic, token-based batching
- SDPA on CPU, Metal, and CUDA
From the project’s README.
Where the decision sits
sys1 calls the hosted decision API rather than running its own weights. That keeps the project small and means its behaviour moves whenever the vendor ships a new model version. It also means an API key and a network round trip sit in the path of every decision.
Models it references: Jev, laya-typed-decisions, laya-multilingual, laya-typed-decisions, laya.
How active it is
Created 2026-09-22, last pushed 2026-10-10, 58 stars and 4 forks when we read it on 2026-11-02. Everything in this category is weeks old at most, so a stale push date means something different here than it would on a mature project. Check the repository before you depend on it.
Find out what your data actually supports
We turn your historical decisions into a frozen test set, then tell you which model, which threshold, and how much of it you can safely automate.