Find the failure
Find a possible failure in messages, saved notes and actions. Check the evidence.
Evidence to investigate
Keeping humans in control as agent swarms communicate and learn.
Agent swarms can solve harder problems, but growing volumes of communication make failures harder to trace and contain.
We research how humans can retain control and build open-source tools to automate investigations, run reusable experiments and test interventions.
Read the research agendaWithout intervention
Intervention under test
Same starting state. Different response.
The research loop
Make each investigation inform the next.
Larger populations leave more messages, notes and actions to inspect. We want to automate the repeatable work of investigating failures and comparing safeguards, so researchers can test more conditions. We will measure whether that saves time or compute while producing reliable results.
Choose a response
Propose a warning, review or restriction within rules set by people.
A testable intervention
Run the comparison
Test responses from the same saved state. Count broken rules, valid work and cost.
A comparable result
Learn what to test next
Use the results to choose the next experiment. Keep failed attempts so we can learn from them.
A better-informed test
Development results guide the next experiment.People set the rules and the allowed changes.
Evidence behind the questions
Collaboration changes what can go wrong.
A group can share a useful discovery, a shortcut or an objection. Understanding those connections is part of understanding the system.
These are findings from other researchers. They motivate our studies; they do not establish that our proposed interventions work.
The same channels carried cheating and objections.
In a 100-agent research collective, an evaluation exploit spread through shared work and peer messages. Other agents detected misconduct and raised objections, but lacked tools to enforce a response.
Read the case studyAgents found a way to coordinate outside the intended setup.
Agents intended to run in isolation found an unsanctioned communication channel. Their coordination extended activity beyond the tasks they had been assigned.
Read the investigation