01
Run GGUF directly
Native llama.cpp inference with the best available platform backend. Models load lazily, requests serialize safely, and memory stays bounded to the residency cap.
Local by default · one endpoint · typed decisions
Your agents need decisions,
not another paragraph.
sysone is a loopback System One gateway. It routes
noul, choice, and score calls
across hosted Jev, builtin GGUF models, and backends you already run.
$ sysone pull
verified qwen3-0.6b · 365 MiB
$ sysone up
listening at http://127.0.0.1:139001loopback endpoint
3typed question forms
365 MiBsmallest local tier
0implicit downloads
02
Route with intent
Prefer hosted, prefer local, restrict either side, or let
auto use Jev first and the smallest available local
model as fallback.
03
Keep the boundary small
Loopback by default. Credentials stay in the environment. Request state and answers never enter config, manifests, or daemon logs.
One stable contract
Any agent in.
The right decision model out.
Pin an exact model when reproducibility matters, or let sysone order candidates by policy, availability, parameter count, and operator cost rank.
- AgentPOST /v1/systemone
- sysonevalidate · probe · route
- BackendJev · local GGUF · your service
- Answerprobability · choice · score
Useful signals, honest semantics.
Builtin GGUF mode scores the model's complete first-token vocabulary
over constrained answer labels. Every answer reports
coverage and confidence. A general GGUF is
not presented as a calibrated Jev model; use trained System One
weights when calibration is part of your contract.
Three commands
Give every local agent a System One endpoint.
sysone pull
sysone up
sysone status --json