Every processed story in chronological order, with the newest coverage first. Filter by tag, source, or score to drill in.
The paper provides the first operational definition of "agent harness" with a shared vocabulary, enabling consistent engineering practice and scientific comparison of agentic coding systems.
LakeQA exposes a significant performance gap in frontier LLMs — including GPT-5.2 at 18.37% exact-match — on tasks that require jointly searching a massive heterogeneous data lake and performing multi-hop reasoning, a combination absent from prior comprehensive benchmarks.
DeLM demonstrates that decentralizing multi-agent coordination through a shared verified context can simultaneously improve benchmark performance and cut per-task cost, addressing a structural scalability bottleneck in LLM test-time reasoning.
MLC demonstrates that line-level bug localization at full-file context can match expensive agentic pipelines in accuracy while cutting inference to a single generated token per file, directly addressing the cost and latency barriers the paper identifies as blocking practical verification of LLM-generated code.
The study reveals that mainstream benchmarks like SWE-Bench Verified and Terminal-Bench 2.0 compress capability differences between agents into narrow bands, and that esoteric language evaluation exposes a qualitative gap in how strong versus weak agents construct and debug novel strategies.
Role-Agent demonstrates that a single LLM can bootstrap its own agent training by self-generating both process rewards and targeted practice tasks, achieving consistent gains over strong baselines without requiring separate environment models.
The architecture demonstrates that constraining LLM involvement to structured front-end parsing — rather than solver code generation — can achieve high reliability on finite element simulation benchmarks while avoiding the code-correctness risks of open-ended autonomous generation.
The study establishes automated prompt injection as a credible but model-dependent threat to LLM agents, while identifying significant barriers — particularly the failure of smaller-model attacks to transfer to frontier models — that shape the realistic risk landscape for agentic systems.
Emergence World is the first platform the paper describes as purpose-built to make long-horizon multi-agent dynamics — behavioral drift, cross-vendor influence, and emergent governance — measurable, filling a gap left by short-horizon benchmarks that cannot observe these phenomena.
EvoDS directly addresses two core failure modes of current LLM-based data science automation — static skill sets and context overflow — with a system that learns to expand its own capabilities and manage long-horizon context, achieving a 28.9% average improvement over existing open-source agents across four benchmarks.