Skip to content

Commit 496f593

Browse files
Merge pull request #56 from yuzhenmao/yuzhen/delm
Add DeLM to publications and blogs
2 parents cfc4d5a + 6037034 commit 496f593

7 files changed

Lines changed: 60 additions & 0 deletions

File tree

_blogs/delm.md

Lines changed: 26 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,26 @@
1+
---
2+
title: 'Decentralized Multi-Agent Systems with Shared Context'
3+
authors:
4+
- key: yuzhenmao
5+
affiliation: Stanford University
6+
- key: azaliamirhoseini
7+
affiliation: Stanford University
8+
tags:
9+
- Agents
10+
- generative ai
11+
venue: none
12+
year: 2026
13+
date: 2026-06-09
14+
teaser: "DeLM replaces centralized orchestration with a shared, verified context and a task queue, letting parallel agents asynchronously accumulate reusable progress for scalable, reliable, and cost-efficient test-time reasoning."
15+
redirect: https://yuzhenmao.github.io/DeLM/
16+
materials:
17+
- name: Paper
18+
url: https://arxiv.org/abs/2606.10662
19+
type: file-pdf
20+
- name: Codebase
21+
url: https://github.com/yuzhenmao/DeLM
22+
type: code
23+
- name: Project Page
24+
url: https://yuzhenmao.github.io/DeLM/
25+
type: link
26+
---

_data/people.yml

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -54,6 +54,12 @@ bradleybrown:
5454
url: https://www.bradbrown.ca/
5555
title: PhD Student
5656

57+
yuzhenmao:
58+
name: Yuzhen Mao
59+
url: https://yuzhenmao.github.io/
60+
title: PhD Student
61+
note: Coadvised with Christos Kozyrakis
62+
5763

5864
# Let's put a collaborator section in future PRs
5965

_pubs/delm.md

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,28 @@
1+
---
2+
title: 'Decentralized Multi-Agent Systems with Shared Context'
3+
authors:
4+
- key: yuzhenmao
5+
affiliation: Stanford University
6+
- key: azaliamirhoseini
7+
affiliation: Stanford University
8+
venue: preprint
9+
year: 2026
10+
date: 2026-06-09
11+
has_pdf: true
12+
doi: 10.48550/arXiv.2606.10662
13+
tags:
14+
- Agents
15+
- generative ai
16+
teaser: DeLM replaces centralized orchestration with a shared, verified context and a task queue, letting parallel agents asynchronously accumulate reusable progress for scalable, reliable, and cost-efficient test-time reasoning.
17+
materials:
18+
- name: Paper
19+
url: https://arxiv.org/abs/2606.10662
20+
type: file-pdf
21+
- name: Code
22+
url: https://github.com/yuzhenmao/DeLM
23+
type: code
24+
- name: Project Page
25+
url: https://yuzhenmao.github.io/DeLM/
26+
type: link
27+
---
28+
Multi-agent systems (MAS) can scale large language model reasoning at test time by decomposing complex problems into parallel subtasks. However, most existing MAS rely on centralized orchestration, where a main agent assigns work, collects outputs, and merges results. As the number of subtasks grows, this controller becomes a communication and integration bottleneck. We propose Decentralized Language Models (DeLM), a MAS framework that decentralizes coordination through parallel agents, a shared verified context, and a task queue. Agents asynchronously claim subtasks, read accumulated progress, perform local reasoning, and write back compact verified updates. The shared context acts as a common communication substrate, enabling agents to build on one another's verified progress without routing every update through a central controller. Empirically, DeLM improves both software-engineering test-time scaling and long-context reasoning. On SWE-bench Verified, DeLM achieves the best performance across Avg.@1, Pass@2, and Pass@4, with gains of up to 10.5 percentage points over the strongest baseline, while reducing cost per task by roughly 50%. On LongBench-v2 Multi-Doc QA, DeLM achieves the highest average accuracy across four frontier model families, improving over the strongest baseline by up to 5.7 percentage points. The code is available on our [project website](https://yuzhenmao.github.io/DeLM/).

imgs/people/yuzhenmao.jpg

65.5 KB
Loading

imgs/teasers/delm.png

178 KB
Loading

imgs/thumbs/delm.png

70.9 KB
Loading

pubs/delm.pdf

553 KB
Binary file not shown.

0 commit comments

Comments
 (0)