HYDRA v1.x · MIT ★ GitHub
skip intro ↓
local-first · provider-neutral · trust control plane

HYDRA, the local-first Trust Control Plane: multi-model AI orchestration CLI

One Cortex · Many Heads

The local-first Trust Control Plane for AI. Hydra discovers every model on your machine, CLI agents, API keys, local servers, and routes each task to the cheapest head that clears your target confidence.

Read the docs →
Where we fit in the universethe uncontested quadrant

Every other tool is a hosted proxy.
We built the local-first one.

Cloud gateways route your traffic through their servers. Eval tools score answers after the fact. Local runtimes each manage only their own models. Plot the field on two axes, hosted↔local and cost-routing↔trust, and one quadrant sits empty. That is where Hydra lives. Hover any star.

hosted · proxy-first
local-first · on-device
trust · confidence
cost · latency routing
the empty quadrant
local-first × trust
→ Hydra, alone

Cloud gateways Eval & observability Local runtimes Frontier heads (destinations) Hydra
The math, drawnmechanism, not decoration

Three curves that run the router.

Routing isn't vibes. Hydra rides the cost/quality Pareto frontier, stops sampling the instant confidence clears the bar, and reads the code graph to know when a change is dangerous. Here is the actual math.

a · cost vs quality

The Pareto frontier

Single models are dots. For any one of them, Hydra's routed curve reaches equal or better quality at lower cost, it picks the best head per task.

cost per task → quality → Haiku Flash GPT-class all-Claude Hydra routes here
Same quality, lower cost: the RouteLLM result, applied per dispatch.
b · optimal stopping

Confidence, then stop

Hydra polls heads until the sequential test (SPRT) crosses your target confidence, then it stops early and banks the unspent heads.

heads queried → confidence → target 0.95 accept ✔ stopped early
Fewer heads, cleared bar: the calibrated number the field lacks.
c · percolation-κ

Blast radius (Molloy-Reed)

κ = ⟨k²⟩/⟨k⟩. A hub file with many transitive dependents is cascade-capable, so it demands more confidence. Hover a node.

hover a node, κ & blast radius
High-κ ⇒ higher bar. The confidence target rises with the graph.
Derive it yourself, six interactive proofs on the First Principles page →
Accountabilitycounts hide the sequence

You gave an agent your repo. What did it do?

Every access an agent makes is recorded in a local, hash-chained ledger. hyctl security reads that log and answers the one question you actually have, not a wall of metrics.

$ hyctl securitycopy
VERDICT ACT NOW
critical incident, gpt-4o: the same resource was denied
repeatedly, then it escalated to an exec/network action,
then it targeted the audit trail itself.
recon → escalation → audit-tampering · 4 event(s)
 
activity 4 blocked · 0 flagged
evidence 4 event(s), 4 hash-chained, intact

“4 denied, 2 flagged” and “injection → recon → escalation → an attempt on the audit trail” are the same rows read twice. Only the second one is an incident. Severity is OWASP Risk Rating (likelihood × impact), never a blended score.

hyctl security --why opens the whole programme underneath: a risk register on an SLA clock, crosswalked to OWASP LLM / NIST AI RMF / ISO 42001 / MITRE ATLAS / SOC 2 · OWASP LLM Top-10 coverage · a policy audit that finds rules which can never fire · PII exposure resolved against real heads, so a local model is not reported as a leak · control effectiveness, where a control that is configured but never applied reads as inert rather than as protection · head-binary integrity · edit blast radius.

Honest about its own limits. Framework mappings are marked curated assertions, not measurements. Defect cost is per-occurrence, not annualised. A file the dependency graph does not index is unknown, never “low-risk”. The attestation is unsigned, because Hydra has no key management and a signature without one is theatre.

The ledger records what an agent did. hyctl mcp registry scores whether the MCP server it was talking to was ever safe to trust in the first place, every existing MCP directory answers “does this exist”, none answer “is it safe to run with my credentials right now”, and star counts are actively misleading (the most-starred servers score worst on quality in independent research). audit resolves what's installed against the official registry and scores it; every trust state drops back to provisional on a version bump, the direct fix for a server that ships clean for months then turns malicious in one release.

By the numbersevery number has a mechanism

Loud numbers. Real levers.

No tokens-processed arms race. Each of these is something you can reproduce on your own machine with hyctl stats and hyctl probe.

73%
cheaper, typically
Median cost avoided by routing boilerplate away from the frontier orchestrator to a mid or local head. Reproduce with hyctl stats.
58%
kept 100% local
Share of tasks that never left your machine. No hosted gateway can claim this.
0.95
target confidence
Routes to a calibrated confidence-of-correctness, then stops early via SPRT.
12
heads discovered
CLI agents + API keys + local servers found on a typical dev box. Run hyctl probe.
100%
offline-capable · ~0ms routing overhead
The router runs on-device with zero network calls to decide. Local Qwen is the always-on terminal fallback, so a dispatch never hard-fails on a rate limit.
Hydra vs the gatewaysonly one is local-first + trust + ledger

Others route your traffic. Hydra routes on your metal.

Cost routing and fallback are table stakes, most tools have them. The differentiators are the rows nobody else can check: local-first, confidence/trust routing, and an on-device accountability ledger.

swipe to compare →

Capability Hydra OpenRouter LiteLLM Portkey
Local-first discovery & routing
Provider-neutral, routes away from expensive headspartialpartialpartial
Automatic fallback chains
Spend logging & cost reporting
Confidence / trust routing (calibrated + optimal-stopping)
On-device accountability ledger (PII / local-only policy)
MCP server trust scoring (not just an index)
Runs fully offline (0 network to route)

Every row checked above ships today: hyctl dispatch --confidence, hyctl graph blast, hyctl mcp, hyctl mcp registry. The cockpit (hyctl tui) runs the work you type and renders real runs from the per-run event log, and the desktop app ships as a download for macOS, Windows and Linux on both x86-64 and ARM64 with every release, not yet code-signed, so macOS needs right-click → Open on first launch.

Hydra Desktopships with every release

Prefer to watch it rather than grep it?

Everything above is the CLI. The same control plane has a desktop app that opens on a chat: ask for work, and every reply says which model answered, at which tier, and what it cost, beside a pane showing what the router knows. Models, Activity, Usage and Audit sit behind it, over the logs hyctl already writes. No account, no server, nothing leaves the machine.

Modelswhat you can actually route to Activitywhat needs you Usagewhere the money went Auditwhat the agents did
See the app
$ curl -fsSL …/install-app.sh | shcopy
checksum verified · /Applications/Hydra.app

macOS · Linux · Windows, attached to every GitHub release with a SHA-256 checksum. Not yet code-signed, so macOS needs right-click → Open the first time, the install script clears that for you. ARM64 builds ship for both Windows and Linux (#263). Direct downloads.

Getting startedthree commands

Installed to first dispatch in under a minute.

01, INSTALL

Get the binary

One Go binary. No daemon, no account, no cloud.

$ brew install ankit373/hydra/hyctlcopy
$ npm install -g hyctlcopy
$ pip install hyctlcopy
$ curl -fsSL …/install.sh | shcopy
🍺 hyctl 1.x installed · or run once with npx hyctl
02, DISCOVER

Scan your machine

Finds every head: CLI agents, API keys, local servers.

$ hyctl probecopy
12 heads · agy · gemini · openrouter
ollama(qwen) · lmstudio · …
03, DISPATCH

Route a task

Classify → tier → cheapest head that clears confidence.

$ hyctl dispatch --enum SIMPLE …copy
→ T8 gemini-flash · $0.0001
✓ done · saved $0.0149 vs all-Claude

Stop paying frontier prices
for boilerplate.

One cortex, many heads. Route each task to the cheapest head that clears your bar, on your own hardware, with your spend and policy staying home.

See the whitespace ↑