Your AI Agent Problem Isn't the Model — It's the Harness
Table of Contents
The equation reshaping how every major AI company thinks about agents is straightforward: Agent = Model + Harness. The model provides intelligence. Everything else — tools, memory, safety constraints, the execution loop — that's the harness. Right now, the harness is where most of the competitive advantage lives.
From Chat Loops to Control Frameworks
The concept of an agent harness has evolved rapidly. In 2023, frameworks like LangChain introduced simple chains: prompt goes in, completion comes out. The "harness" was barely more than a while loop tracking messages.
By 2024, the ReAct pattern — a cycle where the model reasons, takes an action via a tool call, and observes the result — turned those loops into something useful. Frameworks like CrewAI, AutoGen, and LangGraph emerged, and the harness grew from a wrapper into a control framework.
2025 brought the agent explosion: Claude Code, Cursor, Codex, Aider, Cline. Full products competing not just on model quality but on how well they scaffolded the model's work. The AI agents market reached an estimated $7.8 billion in 2025, with projections exceeding $50 billion by 2030.
In 2026, "Harness Engineering" has become a named discipline. Martin Fowler published his framework for designing feedforward guides and feedback sensors. Both Anthropic and OpenAI released engineering blogs on harness design. The consensus, as Addy Osmani puts it:
A decent model with a great harness beats a great model with a bad harness.
What a Harness Actually Does
Viv Trivedy's formulation cuts through the noise: if you're not the model, you're the harness. That includes system prompts, tool definitions, sandbox environments, memory files, execution hooks, and orchestration logic. A raw model generates text. The harness turns that text generation into reliable, autonomous work.
The components break down into distinct jobs:
Durable state
Models can only act on what's in their context window — the text they can "see" at any given moment. Filesystem access and Git give agents a workspace to read data, store intermediate results, and collaborate through shared files. This is the most foundational primitive and often the most underrated.
General-purpose execution
Rather than pre-building a tool for every possible action, modern harnesses give agents terminal access. The agent writes and runs its own code on the fly. As Simon Willison frames it:
An agent is a system that runs tools in a loop to achieve a goal.
Safety and isolation
Sandboxes — isolated execution environments — let agents run code without risking production systems. They enforce command allow-lists, network restrictions, and come with pre-installed runtimes. Environments spin up on demand and tear down when work finishes.
Memory across sessions
Models can't update their own knowledge after training. But harnesses inject configuration files (like AGENTS.md) at the start of every session. When the agent edits these files, the harness reloads them. A simple but effective form of continual learning.
Context management
As conversations grow long, model performance degrades — a phenomenon called context rot, which describes the decline in recall and reasoning quality as input grows. Harnesses fight this through compaction (summarizing older context), output trimming (keeping only the relevant parts of large tool results), and progressive disclosure (loading tools and instructions only when a task calls for them).
Enforcement hooks
Hooks are scripts that run at specific moments — before a tool call, after a file edit, before a commit. They separate "I told the agent to do X" from "the system enforces X." The design principle, highlighted by HumanLayer via Osmani:
Success is silent, failures are verbose.
If the typecheck passes, the agent hears nothing. If it fails, the error gets injected back into the loop for self-correction.
The Proof: Same Model, Dramatically Different Results
On Terminal Bench 2.0 — a benchmark for coding agents — Claude's Opus 4.6 running inside Claude Code scores far lower than the same model in a custom-optimized harness. One team moved from Top 30 to Top 5 by changing only the harness.
Jarek Wasowski reports a 6x performance improvement on the same model through better harness architecture. That's the difference between a prototype and a production system.
The explanation: models are now post-trained alongside their harnesses. Anthropic and OpenAI both train models with the harness in the loop, so the model gets better at actions the harness prioritizes — filesystem operations, terminal execution, planning. This creates a feedback loop: useful primitives are discovered in the harness, standardized, and then used to train the next model generation.
The side effect is real: models can overfit to specific harness patterns. That's why the best harness for your task isn't necessarily the one the model was trained inside.
Four Harness Patterns, One Converging Direction
Today's agent tools cluster into distinct architectural patterns:
| Pattern | Examples | Strength | Trade-off |
|---|---|---|---|
| CLI-first agent | Claude Code, Aider, Codex CLI | Full filesystem access, autonomous | Requires terminal fluency |
| IDE-integrated | Cursor, GitHub Copilot | Context-aware, familiar UX | Less autonomous operation |
| Extension-based | Cline, Continue | Flexible model choice | Fragmented experience |
| Orchestrator | OpenCode, Pi | Multi-model coordination | Added complexity |
The notable trend: these tools look more like each other than their underlying models do. The industry is converging on the same load-bearing components — filesystem, terminal, sandbox, memory, hooks — regardless of which model sits underneath.
For teams running EU-hosted or latency-sensitive workloads, the harness choice intersects with infrastructure decisions. Platforms like AKI.IO that offer model-agnostic hosting let you swap models without rebuilding the harness — a practical advantage when the evidence shows the harness matters more than the model choice.
The Ratchet Principle
The most productive habit in harness engineering: treat agent failures as permanent signals, not one-off accidents. The agent shipped a PR with commented-out tests? Add a rule. Ran a destructive command? Add a blocking hook. Lost track of a 40-step task? Split it into a planner and an executor.
Every line in your agent configuration should trace back to a specific failure you observed. You add constraints only for real problems; you remove them only when a more capable model makes them redundant. This is why harness engineering is a discipline, not a framework you download — the right harness is shaped by your failure history.
What Now?
The model you pick matters less than the harness you build around it. That's the shift defining AI agent development in 2026.
Three steps for this week:
1. Audit your agent's failure modes. Document the last ten times it produced bad output. For each, identify whether a harness component such as memory, hooks, context management could have prevented it.
2. Tighten your agent configuration. Osmani cites HumanLayer recommending under 60 lines as every line competes for the model's attention. Every rule should trace to a specific past failure. If it doesn't, remove it.
3. Measure the harness, not the model. Run the same task with your current setup and a modified harness. Track completion rate, error frequency, and token cost. The gap tells you where the leverage is.
Verdict: The harness is where engineering meets AI. Models will keep improving, that's the provider's job. Yours is building the system that makes the model's intelligence reliable, safe, and productive. The teams that get this right won't just have better agents; they'll have a compounding advantage, because every failure they encode makes every future run stronger. That's the promise of harness engineering, and it's where the real work begins.
More articles
Introducing AKI.IO: The European AI API for Model Inference
A European AI API for teams that want EU-hosted inference with curated open-weight and open-source models such as Qwen, MiniMax, GPT-OSS, Llama, Apertus, Ministral, Flux.2, and more. Integrate through OpenAI- and Anthropic-compatible interfaces without self-hosting GPU infrastructure.
Agentic AI in Europe: What Teams Should Get Right Early
Agentic AI is moving beyond chat into systems that can read files, edit code, call tools, browse the web, run terminal commands, and complete work across multiple steps.
The AKI.IO Launch Manifesto
Let’s be honest: Europe did not win the race for general artificial intelligence. The United States and China are competing for dominance over frontier models — and with them, technological power.