Every processed story in chronological order, with the newest coverage first. Filter by tag, source, or score to drill in.
AMC demonstrates that principled RL-style optimization of black-box LLM agents is feasible at test time, opening a path to improving proprietary API-only agents without requiring access to model weights.
The work addresses the practical economic and computational constraint of LLM-call costs in counterfactual recourse, showing that a structured agentic search strategy can produce more diverse, validated alternatives without increasing budget expenditure.
The study reveals that the gap between stage-level and end-to-end pipeline automation in real scientific workflows is a distinct, underexplored challenge not captured by existing coding agent benchmarks.
The paper formalizes a conceptual framework — including the new discipline of "Agentic Engineering" and the AaaS category — that attempts to give researchers and practitioners a structured vocabulary for understanding how LLM-driven agents differ fundamentally from traditional software systems.
The work demonstrates that an autonomous LLM-driven agent can produce physically interpretable, generalizable control policies through a fully auditable discovery process — without the black-box weight optimization that typically makes deep reinforcement learning opaque in scientific contexts.
SWE-Explore provides a fine-grained diagnostic lens on coding agent capabilities that binary benchmarks like SWE-bench cannot offer, enabling targeted measurement of where exploration quality breaks down before the repair stage.
Socratic-SWE demonstrates that an agent's own solving traces can serve as a scalable, self-improving training substrate — overcoming the limitation of fixed synthetic data pipelines that are blind to the agent's actual weaknesses.
The discovery that LLM agent safety varies significantly based on conversational position — with a measurable 9–52% improvement after warm-up tasks — identifies a concrete, previously unnamed vulnerability in deployed agentic systems and proposes a benchmark and mitigation strategy grounded in empirical evidence.
The study reveals that a single instruction-tuned model cannot optimally serve both Flow and Command coding modes simultaneously, highlighting a concrete design tension that the authors argue must be carefully balanced in AI-powered coding assistant development.
The hacker-fixer loop shows that automated, iterative verifier hardening can eliminate reward hacking that corrupts both benchmark leaderboards and RL training signal — without requiring per-task manual patching.