Every processed story in chronological order, with the newest coverage first. Filter by tag, source, or score to drill in.
NRT-Bench reveals that frontier LLM agents are vulnerable to adaptive multi-turn attacks even in safety-critical supervisory roles, and that model-specific, nearly non-overlapping failure modes mean aggregate robustness metrics can mask significant individual weaknesses.
The paper provides a measurable, formal account of how evaluation bias spreads in multi-agent LLM pipelines and identifies a concrete structural intervention — expanding evaluator committee size — that reduces that spread by 72.4%.
The benchmark reveals that frontier AI models — including those augmented with Code Agents — effectively fail at large-scale game project engineering, with runtime pass rates collapsing to 5.7%, exposing architectural design as an unsolved bottleneck that compilation-focused improvements cannot address.
The paper surfaces a pre-PR coordination layer that existing PR-history analysis cannot see, and provides a concrete substrate and mining toolkit that reduce redundant multi-agent work from 78% to 0% — directly addressing why autonomous agents' PRs are accepted less often despite being produced faster.
By forcing LLM agents to commit their security assumptions as falsifiable assertions and immediately stress-testing them with a fuzzer, Code-Augur replaces opaque agent reasoning with a verifiable, self-correcting audit loop — directly addressing the missed-vulnerability risk the paper identifies as the central weakness of current agentic security analysis.
DSG demonstrates that externalizing search grounding into a shared, MCP-compatible layer can reduce production search costs by over 98% while preserving accuracy, replacing a fixed, opaque model feature with a tunable, provider-agnostic interface.
The taxonomy gives protocol designers and adopters a structured framework for navigating an otherwise fragmented interoperability landscape, while the finding that no single protocol can satisfy all constraints simultaneously reframes the field's goal from convergence to federation.
The MCP-integrated, specification-first design removes the need for domain experts to manually author, debug, and submit complex scientific pipelines, making large-scale reproducible workflow execution accessible to non-expert users.
SWE-Future offers a path to coding-agent benchmarks that are both grounded in real repository evolution and resistant to data contamination from historical pull-request replay.
GameCraft-Bench exposes a concrete ceiling on current coding agents' ability to produce fully playable games, showing that even the best frontier models fall below 41.46% on a task requiring integrated scripts, scenes, assets, and runtime interaction — a gap that partial code-generation benchmarks do not capture.