arXiv cs.AI - 2026-08-17

268 items collected.

1. Inducing Reward-Free Judging Rubrics that Reduce Over-Crediting in Agent Evaluation

Author: Darragh Quinn, David Dylan, Roisin Healy, Fionn Carroll, Maeve Donnelly, Cormac Sheehan
Published: 8/17/2026, 4:00:00 AM
Categories: cs.AI

arXiv:2608.13564v1 Announce Type: new Abstract: Evaluating language-model agents at scale increasingly relies on a second language model as an automatic judge, because the gold signal, an executable environment reward, is expensive, slow, or unavailable at deployment time. Such a judge is a reward-f...

arXiv cs.AI - 2026-08-17 ​

1. Inducing Reward-Free Judging Rubrics that Reduce Over-Crediting in Agent Evaluation ​

2. Depth-Aware Sensitivity Analysis of Mixture-of-Experts Models via Magnitude-Based Expert Masking ​

3. Modular Cognitive Architecture Emerges in Large Language Models ​

4. A Year in LLM Serving: Workload Evolution, Caching and Load-Balancing ​

5. Agentao: A Governed Local-First Runtime for Tool-Using LLM Agents ​

6. AI Evaluation Should Work With Humans ​

7. Stable Miscalibration in Large Language Models: A Practical View of High-Confidence Errors ​

8. Measuring Cross-Task Behavioral Consistency in Language Model Agents ​

9. Cross-Disciplinary Taxonomy and Modeling of Misunderstanding Generation, Amplification, and Detection, from Pragmatics to AI Agents ​

10. Active Perception for Embodied Disambiguation ​

11. MobileMem: Learning from a Year of Mobile Experiences ​

12. No Universal Signal Predicts Sample-Level LLM Regression under Version Updates ​

13. Evaluating Agentic Learning Harness Capabilities Without Labels via the Scaling Hypothesis ​

14. SemPlan: Benchmarking Structured Semantic Planning for LLM-Based Queries over Enterprise Data ​

15. How Compliant is Sepsis Treatment? An Expert-Guided Neuro-symbolic Pipeline for Generating Clinical Compliance Insights ​

16. Algorithm Design and Physician Liability ​

17. Your Probabilistic JEPA Is Secretly a Hidden Markov Model: A State-Space Interpretation of Joint-Embedding Predictive Learning ​

18. ARC: Fair Relative Advantage Comparison in Open-Ended Real-World Interaction ​

19. Reward Machines for Signal Temporal Logic ​

20. A Calibrated Test of Internal Action Maps: State Signals Without Global Affine Closure ​

21. Exploring ESC Winners with Nested Diagrams ​

22. Ontology-Grounded Project Memory for Coding Agents ​

23. Second Thought: Reasoning in Parallel as LLM Agents Act and Observe ​

24. Learning to Assemble Novel Structures with Unfamiliar Parts under Semantic Constraints ​

25. Coverage Aware Active Evaluation for Failure Discovery with Paired Systems ​

26. Explanation Multiplicity: Circuit-Level Interpretability Evidence Does Not Survive Defensible Analytic Variation ​

27. Simulation-Aware In-Context Policy Improvement for LLM-Aided Analog Layout Refinement ​

28. FLARE MCMC: Fidelity-based Layer-Adaptive REcursive proposals for MCMC ​

29. From Passive Delegates to Strategic Negotiators: Reinforcing Social Reasoning in Small Language Models with SocialRL ​

30. SDO: Subspace Deconflicting Operator for Multi-Adapter Composition ​

31. Joint Optimization of Memory and Computing Frequency for Energy-Efficient DNN Inference ​

32. MemoryLake on MemoryArena: A Matched Study of Agent Memory Backends ​

33. When Personal Memory Has No Single Answer: Evaluating LLM Agents under Irreducible Conflict ​

34. Never the Number: Structural Abstention for AI Systems Whose Answers Are Consumed as Fact ​

35. AI Research Preference Models ​

36. HELIX: Model-Harness Co-evolution for Recursive Self-Improvement ​

37. Implementing Computational Law in Wolfram Language for the Governance of Artificial Intelligence ​

38. Nanbeige4.2-3B on Apple Silicon: Fixing Deployment Bugs and Decreasing Looped Transformer Memory Overhead ​

arXiv cs.AI - 2026-08-17

1. Inducing Reward-Free Judging Rubrics that Reduce Over-Crediting in Agent Evaluation

2. Depth-Aware Sensitivity Analysis of Mixture-of-Experts Models via Magnitude-Based Expert Masking

3. Modular Cognitive Architecture Emerges in Large Language Models

4. A Year in LLM Serving: Workload Evolution, Caching and Load-Balancing

5. Agentao: A Governed Local-First Runtime for Tool-Using LLM Agents

6. AI Evaluation Should Work With Humans

7. Stable Miscalibration in Large Language Models: A Practical View of High-Confidence Errors

8. Measuring Cross-Task Behavioral Consistency in Language Model Agents

9. Cross-Disciplinary Taxonomy and Modeling of Misunderstanding Generation, Amplification, and Detection, from Pragmatics to AI Agents

10. Active Perception for Embodied Disambiguation

11. MobileMem: Learning from a Year of Mobile Experiences

12. No Universal Signal Predicts Sample-Level LLM Regression under Version Updates

13. Evaluating Agentic Learning Harness Capabilities Without Labels via the Scaling Hypothesis

14. SemPlan: Benchmarking Structured Semantic Planning for LLM-Based Queries over Enterprise Data

15. How Compliant is Sepsis Treatment? An Expert-Guided Neuro-symbolic Pipeline for Generating Clinical Compliance Insights

16. Algorithm Design and Physician Liability

17. Your Probabilistic JEPA Is Secretly a Hidden Markov Model: A State-Space Interpretation of Joint-Embedding Predictive Learning

18. ARC: Fair Relative Advantage Comparison in Open-Ended Real-World Interaction

19. Reward Machines for Signal Temporal Logic

20. A Calibrated Test of Internal Action Maps: State Signals Without Global Affine Closure

21. Exploring ESC Winners with Nested Diagrams

22. Ontology-Grounded Project Memory for Coding Agents

23. Second Thought: Reasoning in Parallel as LLM Agents Act and Observe

24. Learning to Assemble Novel Structures with Unfamiliar Parts under Semantic Constraints

25. Coverage Aware Active Evaluation for Failure Discovery with Paired Systems

26. Explanation Multiplicity: Circuit-Level Interpretability Evidence Does Not Survive Defensible Analytic Variation

27. Simulation-Aware In-Context Policy Improvement for LLM-Aided Analog Layout Refinement

28. FLARE MCMC: Fidelity-based Layer-Adaptive REcursive proposals for MCMC

29. From Passive Delegates to Strategic Negotiators: Reinforcing Social Reasoning in Small Language Models with SocialRL

30. SDO: Subspace Deconflicting Operator for Multi-Adapter Composition

31. Joint Optimization of Memory and Computing Frequency for Energy-Efficient DNN Inference

32. MemoryLake on MemoryArena: A Matched Study of Agent Memory Backends

33. When Personal Memory Has No Single Answer: Evaluating LLM Agents under Irreducible Conflict

34. Never the Number: Structural Abstention for AI Systems Whose Answers Are Consumed as Fact

35. AI Research Preference Models

36. HELIX: Model-Harness Co-evolution for Recursive Self-Improvement

37. Implementing Computational Law in Wolfram Language for the Governance of Artificial Intelligence

38. Nanbeige4.2-3B on Apple Silicon: Fixing Deployment Bugs and Decreasing Looped Transformer Memory Overhead