Browse the open-source catalog · Try LintLang · See engineering evidence · Get help with a production failure

These systems can pass conventional evaluations and still fail silently in production. Instructions get dropped. Tools report success they did not achieve. Retrieved context changes meaning. Memory drifts. Policies weaken across long workflows. Evidence no longer explains why an action happened.

Hermes Labs provides engineering services to diagnose these failures and harden the operational layers where they occur: prompts, tool interfaces, retrieval, memory, policies, runtime controls, and evidence.

We build reliability infrastructure for agents and LLM applications whose behavior must remain dependable, inspectable, and reconstructable under real use.

• Diagnose. We review prompts, tools, scaffolds, configurations, memory, retrieval, and traces; run controlled adversarial probes; and deliver prioritized findings with reproducible failure cases and concrete fixes.
• Harden. We design and integrate runtime controls, anti-fabrication safeguards, context-integrity protections, policy gates, and offline-verifiable evidence inside the stack you already operate.

Bring us a system and a symptom →

In agent systems, language is part of the runtime.

System prompts, tool descriptions, retrieved context, memory, summaries, policies, and evaluation criteria do not merely describe a system. They condition what it notices, chooses, remembers, and does.

We treat this operational layer as an engineering surface: something that can be inspected before deployment, tested under adversarial conditions, controlled at runtime, and verified after an action occurs.

That is where systems can remain technically healthy while silently doing the wrong thing.

Choose an installation route: agent plugins for Claude Code, Codex, or GitHub Copilot; the shared Homebrew tap for packaged command-line tools. Each catalog lists its available tools; product repositories retain their source, releases, and issue trackers.

Four useful places to begin:

• LintLang — statically check agent instructions, configuration, and tool descriptions before they ship.
• zer0dex — explore a readable local memory index alongside vector retrieval.
• Little Canary — probe untrusted input for prompt-injection risk before it reaches the primary workflow.
• Fidelis — retrieve original local passages verbatim in the default memory path.

Use the open-source catalog and each repository README for current maturity, installation, limitations, and supporting evidence before adoption.

Our public research examines distinct reliability problems from empirical, measurement, and conceptual perspectives. Each paper addresses a different question and should be evaluated on its own evidence.

• Tool Differentia: Relational Static Analysis for AI Agent Tool Descriptions. A bounded deterministic analysis of the distinguishing information neighboring AI-agent tool descriptions do or do not provide; it documents LintLang H1.6 and does not establish semantic distinguishability or runtime-selection correctness.
• Behavioral Canarying for Prompt Injection: Powerless Model Probes with Explicit Coverage Semantics. A technical note on pre-execution prompt-injection sensing that separates routing disposition from evidence that inspection ran; it does not claim universal detection, formal security, or aggregate accuracy for the current release.
• The Generative Horizon. A conceptual paper on model self-report, recursive interpretive conditioning, and the boundary between measured representations and claims about inner states.
• Precise Records, Unstable Meanings. A measurement-validity audit of claims derived from AI agent telemetry.
• A Taxonomy of Epistemic Failure Modes in Large Language Models. A taxonomy of seven structural epistemic failure modes.
• The Asymmetric Burden of Proof. A matched-vignette study of null-result asymmetry.

Read the research index for abstracts, hosted copies, and citation exports.

Machine-readable publication record: JSON · JSON-LD · BibTeX.

Machine discovery for agents: llms.txt · full context · software catalog JSON · contribution ledger JSON.

The canonical external contribution record reports current, dated totals and separates merged engineering work, submitted fixes, integrations, documentation, ecosystem listings and research-index submissions. Structured ledger.

Merged AI/framework fixes contributed by Roli Bosch (roli-lpci), founder of Hermes Labs:

• microsoft/semantic-kernel #13610 — Preserve the first system/developer message during Python chat-history truncation and handle the target_count=1 boundary. Case study.
• langchain-ai/langchain #35544 — Drop forced tool_choice with a warning when Anthropic extended thinking is enabled; preserve auto and unaffected requests. Case study.
• microsoft/semantic-kernel #13635 — Use value equality to avoid duplicate null entries in strict JSON Schema type arrays, with three regression tests. Case study.
• stanfordnlp/dspy #9978 — Reject an empty Evaluate devset with a descriptive ValueError before metric-summary division, with a regression test. Case study.

Mem0 #5250 contributed a Redis cosine-distance-to-similarity patch with regression coverage. It closed without merge after a maintainer acknowledged the conversion in a broader sweep. The case study preserves earlier community provenance and the patch’s missing clamp. Other substantive unmerged fixes remain visible in the ledger.

Typing modernization in PyTorch Ignite and Optuna, compatibility work and dependency maintenance remain credited in their own classes. Community-list and research-index submissions do not count as merged code contributions.

This work may be executed through human-directed autonomous engineering infrastructure. Rolando Bosch is the responsible human contributor and authorizes publication from his GitHub account.

We keep additional reference implementations and research concepts public so others can inspect, test, fork, and develop them.

Public does not automatically mean flagship or production-ready. Browse the full GitHub catalog and each repository's own status, installation instructions, and limitations.

Support the public work — GitHub Sponsors helps fund Hermes Labs’ open-source tools, evaluations, upstream fixes, migrations, and maintenance.

Hermes Labs was founded by Roli Bosch (Rolando Bosch in professional and academic work). roli@hermes-labs.ai · hermes-labs.ai