Tous 674 🔐 Cybersécurité 415 🤖 Intelligence Artificielle 253 💻 Tech & Transformation Digitale 6
Chargement…
🧠
Intelligence Artificielle

Does a Language Server Save Tokens for Coding Agents? A Measurement Methodology and Preliminary Study

arXiv:2608.13568v1 Announce Type: new Abstract: Coding agents spend most of their context budget on retrieval. Lexical retrieval (grep) is universal, instant, and zero-setup, but noisy: it cannot tell a definition from a call from a comment. Semantic retrieval via the Language Server Protocol (LSP) is precise and typed, but needs a running, indexed server and pays a…

Lire l'article
🧠
Intelligence Artificielle

Measuring Cross-Task Behavioral Consistency in Language Model Agents

arXiv:2608.13598v1 Announce Type: new Abstract: Agent evaluation relies almost entirely on outcome metrics such as success rate, which capture whether an agent succeeds but not how consistently it behaves. We argue that behavioral consistency across tasks is a distinct and measurable property, and we introduce the Behavioral Consistency Metric (BCM) to quantify it. BCM trains…

Lire l'article
🧠
Intelligence Artificielle

Stable Miscalibration in Large Language Models: A Practical View of High-Confidence Errors

arXiv:2608.13591v1 Announce Type: new Abstract: High-confidence errors in large language models are often treated as evidence of fragile internal inference. We study a different possibility: stable miscalibration, where a confident wrong answer remains locally stable under small perturbations. We combine two diagnostics: a label-aware output-level audit score that ranks…

Lire l'article
🧠
Intelligence Artificielle

AI Evaluation Should Work With Humans

arXiv:2608.13577v1 Announce Type: new Abstract: This position paper argues that the dominant paradigm of AI evaluation (which focuses on superhuman autonomous performance and so implicitly targets the goal of replacing humans) is guiding AI development in the wrong direction. Instead, the AI community should pivot to evaluating the performance of human--AI teams. We argue…

Lire l'article
🧠
Intelligence Artificielle

Agentao: A Governed Local-First Runtime for Tool-Using LLM Agents

arXiv:2608.13574v1 Announce Type: new Abstract: LLM agents increasingly operate as execution systems that invoke tools, modify local state, use persistent memory, and interact with external protocols. These capabilities make agents useful, but they also introduce risks related to over-privileged actions, weak auditability, prompt injection, tool poisoning, and uncontrolled…

Lire l'article
🧠
Intelligence Artificielle

A Year in LLM Serving: Workload Evolution, Caching and Load-Balancing

arXiv:2608.13573v1 Announce Type: new Abstract: Large Language Model (LLM) serving has become a critical cloud workload, and realistic traces are essential for motivating and benchmarking serving systems. However, existing LLM serving workload studies remain limited in scale and scope. They often observe short time periods and provide limited visibility into how users…

Lire l'article