Francesco Di Costanzo
Back to shorts

(3) What Makes Human-Agent Collaboration Compound

Most professional AI use still consists of isolated prompts. In a 2023 Harvard/BCG field experiment with 758 consultants, people using GPT-4 completed tasks 25% faster and improved output quality by 40%; the lowest-skilled workers improved by 43%. The result is often described as a model effect. In practice, durable productivity also depends on how the work is delegated, reviewed, and revised.

The Briefing Problem

The productivity trap starts earlier, with how we manage what we already know. Knowledge workers spend an average of 2.5 hours per day searching for information. A 2023 survey found that 82% of knowledge workers had tried multiple productivity systems and abandoned all of them, cycling through three to five setups per decade. Capture is easy. Keeping knowledge current is what breaks every system. Your second brain is already out of date. The same pattern repeats with AI: adoption stalls not because the model is weak but because the briefing is. A poorly scoped request produces a poorly scoped output, and the user blames the tool rather than the management.

Memory, iteration, and scope

The difference between a toy demo and productive collaboration is architectural, and it maps cleanly onto three managerial disciplines. First, memory: modern agent frameworks distinguish episodic, semantic, and procedural memory. A 2025 LangChain survey found that 32% of organisations cite output quality as the top barrier to production agent deployment, traced directly to agents starting each session without context. Second, iteration: a 2025 field experiment on the Pairit platform found human-AI teams were 73% more productive per worker, with participants delegating 17% more work to AI agents and performing 62% fewer direct edits. Memory-backed iteration produces compounding returns that stateless chatbots cannot replicate. Third, scope discipline: the agent executes, the human directs, and the boundaries are explicit. The agent does not widen the argument, invent sources, or make judgment calls beyond its remit. Each tier is a managerial decision, not a technical one.

Convergence is a real risk

Memory and iteration improve quality, but they do not eliminate every risk. Human-AI teams produce higher average quality yet reduced output diversity, a pattern researchers call diversity collapse. Outputs homogenise around AI-generated patterns. The Pairit experiment confirmed this jagged frontier: teams scored higher on text quality but lower on tasks where AI capabilities remain uneven. The risk is not that the agent fails but that the collaboration converges too smoothly on a predictable mean. Good managers notice this and course-correct. Bad managers accept the output and move on.

From retrieval to recombination

Most current AI tooling optimises retrieval through RAG, search, and memory layers. Remembering a preference or finding an old note is useful, but it remains retrieval. More valuable work begins when the agent proposes a connection across sessions that was not recorded explicitly. Those connections still need verification: fluent synthesis can hide a weak analogy. Organisations that learn to brief, iterate, scope, and check this work will get more from the same models than those that rely on recall alone.

Sources

Dell'Acqua, F. et al. (2023). "Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality." Harvard Business School Working Paper. https://www.gabormelli.com/RKB/Dell'Acqua_et_al.,_2023

Pairit Field Experiment (2025). "Collaborating with AI Agents: A Field Experiment on Teamwork, Productivity, and Performance." arXiv:2503.18238. https://arxiv.org/html/2503.18238

LangChain (2025). State of Agent Engineering Survey. (Cited in research memo.)

Soda (2026). "The Maintenance Problem: Why Your Second Brain Is Already Out of Date." https://getsoda.app/hub/the-knowledge-maintenance-problem

myah.dev (2026). "The second brain that never actually worked." https://www.myah.dev/blog/second-brain-failed

Atlan (2026). "Memory Layer for AI Agents: Definition, Types, How It Works." https://atlan.com/know/memory-layer-for-ai-agents/