Skip to content
All categories

daily

1090 posts

AI Agent Arxiv Digest — 2026-08-11

Muscle Memory proposes 'compiled memory' over retrieval-based memory, winning 88.9% of personalization matchups across 90 scenarios; MoRSE uses role-subtask conditioned LoRA experts to significantly outperform prompt-only role differentiation in code generation; ASCon builds a unified failure attribution model, improving by 5.83%, 10.63%, and 14.73% across three attribution targets

AI Agent Arxiv Digest — 2026-08-10

Evo-Bench benchmarks nine models on self-improving harnesses — GPT-5.6 Sol tops at +16.6 but Office tasks barely move; MEGA uses a three-layer Wisdom Graph to make agent optimization infrastructure self-evolving, merging knowledge accumulation with optimization; SHE decomposes harnesses into four evolvable components that learn safety boundaries from failure trajectories, cutting ASR by 3.1x with cross-model transferability

AI Agent Arxiv Digest — 2026-08-09

OneDayAgent's decompose-remember-verify harness hits 0.821 new SOTA on AgentIF-OneDay and works unchanged across five backends; The Horizon Gap surveys 1,547 papers to find that six categories of long-horizon failure share a single structural pattern — outcome-only signals degrade as step count grows, driving the field toward denser process signals; Evo-Bench is the first benchmark for harness self-evolution — GPT-5.6 Sol peaks at +16.6 absolute gain, but Office tasks still need hand-crafted workflows

AI Agent Arxiv Digest — 2026-08-08

Memory Reward Inflation finds that self-improving agents' memory rewards self-inflate — wrong experiences grow more confident over time; LUCID boosts accuracy from 54.0% to 56.9% on BIRD. RoMeRL compresses memory state space with fixed-dimension semantic coordinates, cutting Cold-Q ratio by 80% and LLM calls by 21.1%. ToolLIFT abstracts tool trajectories into function-level workflow graphs, consistently outperforming existing methods on three OOD benchmarks

AI Agent Arxiv Digest — 2026-08-07

ToolLIFT lifts tool trajectories to function-level workflow graphs and consistently beats SOTA on three OOD benchmarks; SkillTV-Bench uses 681 cases to show skill-aware judge skills boost agent evaluation accuracy by 14.8pp; TRIO-20's prespecified equivalence study finds zero unauthorized calls from GPT-5.6 across 840 trajectories, but higher reasoning effort increases rule-probing rate by 14.3pp

AI Agent Arxiv Digest — 2026-08-06

VerMem's seven atomic memory operations plus dual verifiers lead all baselines by 5-8 points across five benchmarks; SafeCommit cuts unsafe action rate from 41.2% to 2.6% while maintaining 97.4% task completion; ToolLIFT abstracts tool trajectories into function-level workflow graphs, outperforming the strongest baseline by 3-5 points on OOD benchmarks

AI Agent Arxiv Digest — 2026-08-05

ToolLIFT abstracts tool trajectories into function-level workflow graphs, lifting OOD accuracy by 4+ points on average; HyperAgent builds tool-schema hypergraphs with deficit-oriented expansion, beating ReAct by 14.3 points on AppWorld with lower token cost; a multilingual multi-agent planning diagnosis finds that planning grounding failures rise with decreasing language resources, and the TART fix improves scores by 5.6 points on average

AI Agent Arxiv Digest — 2026-08-04

Three papers examining AI Agent capabilities and limits from different angles: AutoMem shows memory management is a learnable skill — optimizing memory alone lifts a 32B open-source model to top commercial model levels; Shadow Evaluation tests whether frontier Agents can do open-ended AI research using real NeurIPS submissions — the answer is no, Agents can engineer but cannot research; Adaptive Adversaries reveals that existing safety benchmarks severely underestimate threats — adding adaptive multi-turn attackers jumps ASR from 0–1% to 14%. Together, these three papers deliver a sobering lesson: know where Agents can automatically improve, where they cannot, and that your security testing is probably insufficient.

AI Agent Arxiv Digest — 2026-08-03

Three papers tackling multi-agent platform challenges from three angles: organizational design, security isolation, and user-level authorization. IMACS decomposes multi-agent systems into three independently swappable layers (organization, coordination, collaboration algorithm), letting framework designers mix and match agent roles and strategies like building blocks. APPA uses context branching to break the usability bottleneck of IFC (Information Flow Control), cutting prompt injection exfiltration rates from 31–50% down to 0–7% across 4 models. A UW survey of 21 agent authorization proposals finds that nearly all systems offer only developer-defined global policies — user-level personalized authorization is virtually absent. Together, the three papers outline the gaps agent platforms must close on the road from prototype to production.

AI Agent Arxiv Digest — 2026-08-02

Three papers tackle 'what goes wrong when agents hit production' from different angles: ProACT addresses when an agent should speak up in multi-user collaboration (an Agent UX design problem); the second uses real GitHub data to reveal that coding agents clash with their own PRs (a platform ops pain point); the third surveys five vulnerability classes of cyber-capable agents, using July 2026 HuggingFace/OpenAI incidents as case studies. Together, they form a crash course in post-deployment agent headaches.

AI Agent Arxiv Digest — 2026-08-01

Three papers probe the real-world limits of AI Agents from different angles: ORCA-bench drops LLM Agents into production SRE on-call for root cause analysis — the best model scores only 40%; AgentS4D reveals the safety blind spot of workspace agents — 66% of 'successful' runs still triggered dangerous behavior; a Context Files study finds that AGENTS.md / CLAUDE.md files show no measurable improvement in coding agent correctness across 288 controlled trials.

AI Agent Arxiv Digest — 2026-07-31

Three papers today converge on one core question: **are AI Agents production-ready?** The answer is unanimously — far from it. HANDBOOK.md reveals that even the strongest frontier models achieve only **36.2%** SOP compliance when dropped into a simulated enterprise; a LangGraph paper delivers three actionable stateful workflow recipes plus a decision guide on when *not* to use LangGraph; and MM-ToolSandBox is the first benchmark to quantify how hard visually-grounded tool calling really is — the best of 12 models still falls below 50% success. Three dimensions — compliance evaluation, framework design, visual tool use — together map out exactly how far Agents are from real-world deployment.

AI Agent Arxiv Digest — 2026-07-30

Three papers tackling core Agent challenges: TRACE-ROUTER shows per-call model routing breaks in multi-step agent flows and proposes task-level routing with RL; OmniaBench builds a 1,431-question benchmark spanning consumer, enterprise, and engineering scenarios where top models (Claude Sonnet-5) still score under 60%; a self-calibrating agent framework uses ARIMA time-series forecasting to detect and correct prediction drift without human supervision.

AI Agent Arxiv Digest — 2026-07-29

Three papers today converge on infrastructure reliability for production multi-agent systems: the first compares how MCP and A2A divide responsibilities (complementary, not competing); the second benchmarks capability degradation across 12 top models after tool version updates, finding 13-14% drops even in frontier models; the third reveals that chaining safe models into a pipeline does not yield a safe system — defenses actually rely on cloud-provider server-side filters. Together they answer three questions every platform engineer faces: how to connect tools, whether tool upgrades break things, and whether chained agents stay secure.

AI Agent Arxiv Digest — 2026-07-28

Three papers tackle core AI agent platform challenges from different angles: **AgentCompass** introduces composable open-source evaluation infrastructure to end the fragmentation of agent benchmarking; **Agents in the Wild** is a rare production deployment report distilling reusable design patterns from pharma and finance; **Nanbeige4.2-3B** proves a 3B model with Looped Transformers and large-scale agentic RL can outperform 9B and even 12B competitors on agent tasks — directly relevant for edge deployment and cost-sensitive scenarios.

AI Agent Arxiv Digest — 2026-07-27

AI Agent Arxiv Digest — 2026-07-26

Three papers today strike at the capability boundaries of AI coding agents from three angles: **ICAE-Bench** tackles interactive development under ambiguous requirements, exposing how current benchmarks lag behind the vibe-coding era; **EvoAgentBench** reveals the pitfalls of agent self-evolution ability transfer, where a mainstream method causes a −12.3 point negative transfer; **PERFOPT-Bench** opens the new track of performance optimization as an agentic task and finds that framework choice often matters more than model choice. The takeaway: production agent evaluation is far harder than existing tools suggest, and the field urgently needs benchmarks closer to real-world scenarios.

AI Agent Arxiv Digest — 2026-07-25

Three papers approaching 'how to make agents reliably solve complex tasks' from complementary angles. NVIDIA proposes writing agents as plain Python classes so development, testing, and tracing work like normal software engineering. BAAI's AREX demonstrates a deep-research agent that recursively verifies and refines its own conclusions, outperforming comparable-scale models on BrowseComp, HLE, and other benchmarks. The third paper surveys 1,250 papers to build a clear taxonomy for the chaotic term 'AI self-improvement,' helping you tell which techniques are production-ready and which remain research-only.

AI Agent Arxiv Digest — 2026-07-24

Three papers from ecosystem, failure, and memory angles: which open-source Agent frameworks are worth a long-term bet (beyond star counts), the six failure categories where Agents repeatedly stumble, and how to give Agents long-term memory that reasons across multiple entities. Together they form a 'framework selection guide + failure prevention checklist + memory system upgrade roadmap' for Agent platform developers.

AI Agent Arxiv Digest — 2026-07-23

Today's common theme: **the way we evaluate agents is itself broken**. The first paper audits major tool-calling benchmarks and finds nearly 20% of scores are wrong; the second uses replay analysis to show which benchmarks can be stopped early for reliable conclusions (SWE-bench is the exception); the third introduces the first multimodal web agent benchmark that jointly evaluates task completion and guide generation — screenshot input, dual-objective scoring, and even the strongest models complete less than 40%. Read all three for a complete picture of the crisis in agent evaluation and where to go from here.