Tous 676 🔐 Cybersécurité 417 🤖 Intelligence Artificielle 253 💻 Tech & Transformation Digitale 6
Chargement…
🧠
Intelligence Artificielle

EvalDetectBench: A Benchmark for Measuring Evaluation Awareness in Frontier Language Models

arXiv:2609.01611v1 Announce Type: new Abstract: Frontier large language models can often recognize when they are being evaluated, a capability known as evaluation awareness. If models behave differently in evaluations than in deployment, this undermines the validity of evaluation results, which are a crucial component of current AI safety frameworks. We introduce…

Lire l'article
🧠
Intelligence Artificielle

RePro: Proof-Verified Benchmark Rewriting for Reliable Evaluation of LLM Mathematical Problem Solving

arXiv:2609.00062v1 Announce Type: new Abstract: Data contamination undermines the reliable evaluation of large language models (LLMs) on mathematical problem solving. While rewriting-based evaluation mitigates memorization, existing methods lack guarantees of problem validity and answer correctness. We propose Proof-Verified Benchmark Rewriting (RePro), the first framework to…

Lire l'article
🧠
Intelligence Artificielle

CUDA-Harness: Harnessing Agentic CUDA Kernel Generation and Optimization from Natural Language

arXiv:2609.00058v1 Announce Type: new Abstract: Developing high-performance CUDA kernels demands specialized knowledge in algorithm implementation, correctness validation, and hardware-aware parallel optimization, creating a substantial expertise barrier and making generating CUDA kernels directly from natural language (Text2CUDA) essential. Meanwhile, the general-purpose…

Lire l'article
🧠
Intelligence Artificielle

ValueGraph: Value-Signal Guided Graph Pre-training for Contextualized User Representation

arXiv:2609.00057v1 Announce Type: new Abstract: Value signals are aggregated user-level moral representations that capture users' inferred value-related tendencies from their online discourse. User behavior on social media is shaped not only by what users say or whom they interact with, but also by the value signal through which they express attitudes. Existing user…

Lire l'article
🧠
Intelligence Artificielle

Zero-Shot Respiratory Sound Classification through LLM-Augmented Audio-Text Alignment

arXiv:2609.00055v1 Announce Type: new Abstract: Self-supervised respiratory encoders lack semantic grounding in clinical domain needed for zero-shot inference, limiting their utility without task-specific labeled data. We propose a framework that aligns these encoders with medical terminology in a shared latent space turning them into a zero-shot-capable foundation model. To…

Lire l'article
🧠
Intelligence Artificielle

From Detection to Refusal: Safer LLMs via Circuit-Guided Weight Scaling

arXiv:2609.00051v1 Announce Type: new Abstract: Despite extensive alignment efforts, Large Language Models (LLMs) remain vulnerable to generating unsafe content under adversarial prompting, yet the internal mechanisms by which safety behaviors are implemented remain poorly understood. We study LLM safety from a mechanistic interpretability perspective and characterize a…

Lire l'article