arXiv cs.AI - 2026-07-21

519 items collected.

1. Rater State Bias in RLHF Preference Data: An Audit Framework

Author: Elena Kopteva, Vitaliy Hlynianyi-Zhuk
Published: 7/21/2026, 4:00:00 AM
Categories: cs.AI

arXiv:2607.16195v1 Announce Type: new Abstract: We identify a structured confound in Reinforcement Learning from Human Feedback (RLHF). Pairwise preference labels are intended to reflect the compared outputs, but they may also reflect the rater's state during annotation. Under sustained stressful or...

arXiv cs.AI - 2026-07-21 ​

1. Rater State Bias in RLHF Preference Data: An Audit Framework ​

2. Design and Validation of a Lightweight 1D CNN for Affective Touch Classification in Soft Plush Companions ​

3. Some Large Language Models Exhibit Consistent Risk Attitudes ​

4. A Survey on GNN-based Link Prediction: Techniques, Applications, and Challenges ​

5. PlanFlip: Attacking Multi-Agent LLM Systems via Planning-Phase Prompt Injection ​

6. Deterministic Replay for AI Agent Systems ​

7. Generative Ontology Induction: Domain-Agnostic Schema Discovery from Document Corpora Using Large Language Models ​

8. Democratizing AI with Small Language Models: Structured Benchmarking and Parameter-Efficient Fine-Tuning for Local Deployment ​

9. Masked Diffusion Language Models are Strong and Steerable Text-Based World Models for Agentic RL ​

10. It Takes 8 Tokens: Weak-to-Strong Off-Policy RL via Auxiliary Branches ​

11. PPO-HSC: An Exploratory Reinforcement Learning Framework Based on Wide-Area Policy Coverage Optimization ​

12. JUMP: Single-Pass Membership Inference on Fine-Tuned Diffusion Language Models ​

13. ColGraphRAG: Late-Interaction Evidence Retrieval for Multimodal GraphRAG ​

14. Shapley Context Pruning: A Cooperative Game Perspective for Context Reranking and Pruning ​

15. A Survey on the Verification of Reinforcement Learning Policies ​

16. Accurate and Efficient Long-Term Memory for LLM Agents ​

17. Symbolic Augmentation Closes a Canonical-Equivalence Blind Spot in Neural Fact-Checkers ​

18. SelKV: Selective KV Cache Merging with Per-Token Merge-or-Drop and Attention Compensation ​

19. RAIL Guard: Closing the Evaluation-to-Remediation Gap in Responsible AI for LLM Agents ​

20. Generalist AI Control: Towards Multi-purpose Adaptive Algorithms ​

21. LaCache: Exact Caching and Precision-Adaptive Inference for Diffusion Large Language Models ​

22. Interactive Task Alignment as a POMDP ​

23. When to Plan: Learning to Select Between Reactive Control and Deliberative Planning ​

24. Berkeley and Heiserman as an Unexhausted Architecture for Embodied Machine Intelligence ​

25. SEER: Supervised Learning to Control Energetic Reasoning ​

26. Nonuniformity Principle in Human-AI Coworking ​

27. From Modalities to Propositions: A Language-Centric Framework for Multimodal Intelligence ​

28. Exact Network Surgery: Functional Invariance and Gradient Plasticity in Reactive Computational Graphs ​

29. FST.ai 2.5: Explainable and Uncertainty-Aware AI for Olympic and Para-Taekwondo Decision Support, Athlete Digital Twins, and Federation-Scale Analytics ​

30. Just A Rather Very Intelligent Spoken Agent ​

31. A Research Prototype for Closed-Loop Generative Design of Customized Foot Orthoses via Semantic-Physics Alignment ​

32. TopoTuner: Topological Finetuning of Large Language Models ​

33. Diversity-Oriented Fine-Tuning for Uncertainty-Based Hallucination Detection ​

34. DS@GT ARC at eRisk 2026: Hybrid Multi-Agent LLM System with Structured Algorithmic Guidance for Conversational Depression Screening ​

35. Tractable Query Answering under Epistemic Confidentiality Policies in DL Ontologies (extended version) ​

36. RECON: Benchmarking Agent Memory for Compositional Reasoning over Long Contexts ​

37. Constraint-Anchored Reasoning Traces ​

38. Supporting Autonomous Process Execution within a Multi-Perspective Constraint Frame via Numeric Planning ​

arXiv cs.AI - 2026-07-21

1. Rater State Bias in RLHF Preference Data: An Audit Framework

2. Design and Validation of a Lightweight 1D CNN for Affective Touch Classification in Soft Plush Companions

3. Some Large Language Models Exhibit Consistent Risk Attitudes

4. A Survey on GNN-based Link Prediction: Techniques, Applications, and Challenges

5. PlanFlip: Attacking Multi-Agent LLM Systems via Planning-Phase Prompt Injection

6. Deterministic Replay for AI Agent Systems

7. Generative Ontology Induction: Domain-Agnostic Schema Discovery from Document Corpora Using Large Language Models

8. Democratizing AI with Small Language Models: Structured Benchmarking and Parameter-Efficient Fine-Tuning for Local Deployment

9. Masked Diffusion Language Models are Strong and Steerable Text-Based World Models for Agentic RL

10. It Takes 8 Tokens: Weak-to-Strong Off-Policy RL via Auxiliary Branches

11. PPO-HSC: An Exploratory Reinforcement Learning Framework Based on Wide-Area Policy Coverage Optimization

12. JUMP: Single-Pass Membership Inference on Fine-Tuned Diffusion Language Models

13. ColGraphRAG: Late-Interaction Evidence Retrieval for Multimodal GraphRAG

14. Shapley Context Pruning: A Cooperative Game Perspective for Context Reranking and Pruning

15. A Survey on the Verification of Reinforcement Learning Policies

16. Accurate and Efficient Long-Term Memory for LLM Agents

17. Symbolic Augmentation Closes a Canonical-Equivalence Blind Spot in Neural Fact-Checkers

18. SelKV: Selective KV Cache Merging with Per-Token Merge-or-Drop and Attention Compensation

19. RAIL Guard: Closing the Evaluation-to-Remediation Gap in Responsible AI for LLM Agents

20. Generalist AI Control: Towards Multi-purpose Adaptive Algorithms

21. LaCache: Exact Caching and Precision-Adaptive Inference for Diffusion Large Language Models

22. Interactive Task Alignment as a POMDP

23. When to Plan: Learning to Select Between Reactive Control and Deliberative Planning

24. Berkeley and Heiserman as an Unexhausted Architecture for Embodied Machine Intelligence

25. SEER: Supervised Learning to Control Energetic Reasoning

26. Nonuniformity Principle in Human-AI Coworking

27. From Modalities to Propositions: A Language-Centric Framework for Multimodal Intelligence

28. Exact Network Surgery: Functional Invariance and Gradient Plasticity in Reactive Computational Graphs

29. FST.ai 2.5: Explainable and Uncertainty-Aware AI for Olympic and Para-Taekwondo Decision Support, Athlete Digital Twins, and Federation-Scale Analytics

30. Just A Rather Very Intelligent Spoken Agent

31. A Research Prototype for Closed-Loop Generative Design of Customized Foot Orthoses via Semantic-Physics Alignment

32. TopoTuner: Topological Finetuning of Large Language Models

33. Diversity-Oriented Fine-Tuning for Uncertainty-Based Hallucination Detection

34. DS@GT ARC at eRisk 2026: Hybrid Multi-Agent LLM System with Structured Algorithmic Guidance for Conversational Depression Screening

35. Tractable Query Answering under Epistemic Confidentiality Policies in DL Ontologies (extended version)

36. RECON: Benchmarking Agent Memory for Compositional Reasoning over Long Contexts

37. Constraint-Anchored Reasoning Traces

38. Supporting Autonomous Process Execution within a Multi-Perspective Constraint Frame via Numeric Planning