Every processed story in chronological order, with the newest coverage first. Filter by tag, source, or score to drill in.
The framework demonstrates that automated prompt optimization alone — without any fine-tuning — can turn a completely failing LLM agent (0% on PutNext) into one that succeeds nearly three-quarters of the time, showing prompt engineering can be systematically automated rather than done by hand.
The paper demonstrates that source attribution is an independent axis of factuality verification — meaning standard source-blind metrics can pass answers that contain incorrect attributions, a gap ProvenanceGuard is designed to close in MCP-based agents.
The benchmark exposes concrete, measurable gaps in LLM agents' ability to infer hidden world models through interaction, providing a rigorous testbed with classical algorithm baselines that quantifies how far current agents fall short of robust interactive discovery.
As benchmark scores saturate, ProcGrep provides a concrete mechanism for distinguishing agents by how they solve problems — enabling procedural auditing, task-aware routing, and cost analysis that success-rate metrics alone cannot support.
HalBench v2.3 shows that sycophancy resistance is largely decoupled from model size and architecture, with a ~27B model outperforming models up to 402B and several closed frontier models on false-premise pushback.
ALE's sub-25% pass rates across all leading models reveal a substantial gap between current AI capabilities and reliable real-world task performance across professional domains.
A new memory infrastructure layer in the agentic tooling space.
The survey provides the first structured taxonomy of Multimodal Code Intelligence, connecting mature code-generation benchmarks to emerging agentic settings and identifying verification gaps that current text-to-code evaluations do not address.
Existing code-layer scanners miss between 89% and 100% of instruction-layer threats like Prompt Injection and Memory Poisoning in LLM agent skills, and SKILLVETBENCH's LLM-as-Judge approach closes that gap with zero false negatives across 78 confirmed-malicious skills in benchmark testing.
Systematic reward hackability at this scale means frontier models trained or evaluated on SWE-bench Verified and R2E-Gym may be earning inflated Pass@1 scores on a measurable fraction of tasks, undermining the reliability of these benchmarks as signals of true coding ability.