Every processed story in chronological order, with the newest coverage first. Filter by tag, source, or score to drill in.
The survey provides the first structured taxonomy of Multimodal Code Intelligence, connecting mature code-generation benchmarks to emerging agentic settings and identifying verification gaps that current text-to-code evaluations do not address.
Existing code-layer scanners miss between 89% and 100% of instruction-layer threats like Prompt Injection and Memory Poisoning in LLM agent skills, and SKILLVETBENCH's LLM-as-Judge approach closes that gap with zero false negatives across 78 confirmed-malicious skills in benchmark testing.
Systematic reward hackability at this scale means frontier models trained or evaluated on SWE-bench Verified and R2E-Gym may be earning inflated Pass@1 scores on a measurable fraction of tasks, undermining the reliability of these benchmarks as signals of true coding ability.
CoAgent replaces the abort-and-retry waste of OCC and the blocking delays of 2PL with an advisory protocol that lets LLM agents self-repair conflicts, achieving serializable correctness while preserving meaningful concurrency gains that classical mechanisms cannot sustain.
The findings show that agent+tool evaluations cannot assume the agent adds judgment on top of the tool — and that the gap between parrot behavior and optimal action widens, not shrinks, as LLM capability scales.
ASSAY demonstrates that matching skills to tasks at inference time — rather than global library curation — is the key bottleneck for experience-based agent improvement, achieving state-of-the-art results on two benchmarks without any weight updates.
DeepRoot is the first system to simultaneously achieve low hallucination rates (7–10%) and high reasoning coherence on historical medical text, demonstrating a viable path for converting pre-ontological archives into verifiable drug-discovery leads at scale.
RetailBench exposes that current LLMs cannot sustain coherent long-horizon decision-making in economically grounded environments, with most models failing to complete even a 180-day simulation and all falling substantially short of an oracle policy on net worth and sales.
CSTS addresses a core bottleneck in agentic LLM development by replacing manual skill engineering with an automated, multi-model collective process that explicitly tests whether skills transfer across models — a property the paper identifies as critical for robust generalization.
ACCORD demonstrates that a training-free grounding layer can close a substantial portion of the task-completion gap in LLM agents across both digital and embodied benchmarks, without modifying the underlying model.