arXiv cs.LG - 2026-07-24

263 items collected.

1. DataPrep-Bench: Benchmarking LLMs as Training Data Preparators

Author: Hao Liang, Qifeng Cai, Yibo Lin, Jianzhuo Du, Qifeng Xia, Sizhe Qiu, Linzhuang Sun, Meiyi Qiang, Zhaoyang Han, Xiaochen Ma, Bohan Zeng, Ruichuan An, Conghui He, Wentao Zhang
Published: 7/24/2026, 4:00:00 AM
Categories: cs.LG, cs.CL

arXiv:2607.20465v1 Announce Type: new Abstract: The quality of training data fundamentally determines the capabilities of large language models (LLMs), yet no unified benchmark exists to measure how well LLMs, agents, and data-centric workflows actually prepare training data end to end. We view LLM-...

arXiv cs.LG - 2026-07-24 ​

1. DataPrep-Bench: Benchmarking LLMs as Training Data Preparators ​

2. PhantomFill: When the Form Demands an Answer, Language Models Invent One ​

3. The Active Ingredient in Muon's Grokking ​

4. Scaling Closed-Loop Feature Channel Configuration with LLMs ​

5. Multimodal CoLRAG-TF: Triple-Filtered Retrieval for Complex PDFs ​

6. Adaptive Depth in Looped Transformers: Diagnosing Learned Halting Gates and Trajectory Readouts ​

7. Generative Bayesian Filtering for State Estimation ​

8. Do Active SAE Feature Planes Carry More Holonomy? A Preregistered Reversal in Gemma ​

9. Uncertainty-Aware Trust Estimation for Multi-LLM Systems via Structured Expert Judgement ​

10. CLOE: Christoffel Loss Autoencoder for Anomaly Detection ​

11. Position: Stop Reactively Patching Your Model Every Time and Start Proactive Test-Driven AI Development ​

12. Grounding Investor Views: Neural Predicates in the Black-Litterman Model ​

13. A Graph Neural Network approach to zero-shot Digital Twins ​

14. ReliableTableQA:How Much Supervision Does Reliability Annotation Need? ​

15. Codec-Gauge: Learning Compression-Friendly Gauges for Transformer KV Caches ​

16. Leveraging Biokinetic Knowledge Priors for Data-Scarce Bioprocess Modeling ​

17. From Atoms to Entropy: Optimal Noise Allocation for Diffusion Training in the Convex Regime ​

18. HypNO: A Graph-Based Neural Operator with Physics-Informed Message Passing for Hyperbolic Conservation Laws ​

19. Improving Access to Essential Medicines via Decision-Aware Machine Learning ​

20. When RLVR Shrinks the Reasoning Boundary: Diagnosing Pass@k Inversion ​

21. Conflict Resolution under Degraded Surveillance in Air Corridors Using Multi-Agent Reinforcement Learning ​

22. SOAP, Muon, and Beyond: Pushing LLM Pretraining Scales ​

23. SevDiff: Severity-Conditioned Diffusion for Long-Tail Conflict Trajectory Generation ​

24. Beyond SBDD: Geometric Deep Learning in Polypharmacology and Multi-target Drug Design ​

25. SenCos-GEM: SENet-Calibrated and Law-of-Cosines-Constrained Geometry-Enhanced Molecular Representation for Property Prediction ​

26. Thermodynamic Weight Decay: Exploring Grokking Acceleration via Attention Specific Heat ​

27. Double-Scoring: Reliable Extraction of Strong Lottery Tickets ​

28. Monkey King Bang: A Unified Scientific Multimodal Foundation Model ​

29. StabilityBench: Benchmarking Instability in LLMs ​

30. Joint Utilization of Geospatial and census proxies for Autoencoder-Assisted Downscaling (JUGAAD) of socioeconomic indicators in India ​

31. Chronofy: A Temporal-Logical Decay Architecture for Information Validity in Time-Aware Retrieval-Augmented Generation ​

32. CT-Merging: Consensus Directions and Task-Level Scaling for LoRA Adapter Merging ​

33. AI-Driven Surrogate Models for Predicting Electrode-Scale Discharge Behavior in Lithium-Ion Batteries ​

34. Fisher Widths: Local Learning Geometry and Anisotropic Recovery ​

35. Bayesian uncertainty estimation improves clinical decision making in medical AI agents ​

36. Exact ReLU realization of affine one-dimensional refinement iterates via residual memory and offset frames ​

37. Detecting Neural Network Failures through Spectral Analysis of Internal Activations ​

38. STeMP: Spatio-Temporal Modelling Protocol ​

arXiv cs.LG - 2026-07-24

1. DataPrep-Bench: Benchmarking LLMs as Training Data Preparators

2. PhantomFill: When the Form Demands an Answer, Language Models Invent One

3. The Active Ingredient in Muon's Grokking

4. Scaling Closed-Loop Feature Channel Configuration with LLMs

5. Multimodal CoLRAG-TF: Triple-Filtered Retrieval for Complex PDFs

6. Adaptive Depth in Looped Transformers: Diagnosing Learned Halting Gates and Trajectory Readouts

7. Generative Bayesian Filtering for State Estimation

8. Do Active SAE Feature Planes Carry More Holonomy? A Preregistered Reversal in Gemma

9. Uncertainty-Aware Trust Estimation for Multi-LLM Systems via Structured Expert Judgement

10. CLOE: Christoffel Loss Autoencoder for Anomaly Detection

11. Position: Stop Reactively Patching Your Model Every Time and Start Proactive Test-Driven AI Development

12. Grounding Investor Views: Neural Predicates in the Black-Litterman Model

13. A Graph Neural Network approach to zero-shot Digital Twins

14. ReliableTableQA:How Much Supervision Does Reliability Annotation Need?

15. Codec-Gauge: Learning Compression-Friendly Gauges for Transformer KV Caches

16. Leveraging Biokinetic Knowledge Priors for Data-Scarce Bioprocess Modeling

17. From Atoms to Entropy: Optimal Noise Allocation for Diffusion Training in the Convex Regime

18. HypNO: A Graph-Based Neural Operator with Physics-Informed Message Passing for Hyperbolic Conservation Laws

19. Improving Access to Essential Medicines via Decision-Aware Machine Learning

20. When RLVR Shrinks the Reasoning Boundary: Diagnosing Pass@k Inversion

21. Conflict Resolution under Degraded Surveillance in Air Corridors Using Multi-Agent Reinforcement Learning

22. SOAP, Muon, and Beyond: Pushing LLM Pretraining Scales

23. SevDiff: Severity-Conditioned Diffusion for Long-Tail Conflict Trajectory Generation

24. Beyond SBDD: Geometric Deep Learning in Polypharmacology and Multi-target Drug Design

25. SenCos-GEM: SENet-Calibrated and Law-of-Cosines-Constrained Geometry-Enhanced Molecular Representation for Property Prediction

26. Thermodynamic Weight Decay: Exploring Grokking Acceleration via Attention Specific Heat

27. Double-Scoring: Reliable Extraction of Strong Lottery Tickets

28. Monkey King Bang: A Unified Scientific Multimodal Foundation Model

29. StabilityBench: Benchmarking Instability in LLMs

30. Joint Utilization of Geospatial and census proxies for Autoencoder-Assisted Downscaling (JUGAAD) of socioeconomic indicators in India

31. Chronofy: A Temporal-Logical Decay Architecture for Information Validity in Time-Aware Retrieval-Augmented Generation

32. CT-Merging: Consensus Directions and Task-Level Scaling for LoRA Adapter Merging

33. AI-Driven Surrogate Models for Predicting Electrode-Scale Discharge Behavior in Lithium-Ion Batteries

34. Fisher Widths: Local Learning Geometry and Anisotropic Recovery

35. Bayesian uncertainty estimation improves clinical decision making in medical AI agents

36. Exact ReLU realization of affine one-dimensional refinement iterates via residual memory and offset frames

37. Detecting Neural Network Failures through Spectral Analysis of Internal Activations

38. STeMP: Spatio-Temporal Modelling Protocol