arXiv cs.LG - 2026-07-16

237 items collected.

1. Automatic Differentiation from Scratch: How PyTorch Computes Gradients in Physics-Informed Neural Networks

Author: Abdeladhim Tahimi
Published: 7/16/2026, 4:00:00 AM
Categories: cs.LG, cs.MS, cs.NA, math.NA

arXiv:2607.13042v1 Announce Type: new Abstract: This paper traces, with explicit numerical values, how PyTorch's automatic differentiation (AD) engine computes gradients for Physics-Informed Neural Network (PINN) training -- a setting that requires two levels of differentiation: computing the physic...

arXiv cs.LG - 2026-07-16 ​

1. Automatic Differentiation from Scratch: How PyTorch Computes Gradients in Physics-Informed Neural Networks ​

2. Beyond Backbone Backpropagation: A Decoupled Strategy for Efficient Transfer Learning ​

3. Federated Explainable Artificial Intelligence: Roles, Architectures, Evaluation, and Open Challenges ​

4. What Your Model Threw Away and Why You'll Want It Back: Masking, Fingerprinting, and Privacy from Discarded Geometry ​

5. Targeted Recovery of Weight-Space Mechanisms From Neural Networks ​

6. Uncertainty-Aware Sequential Decision Rules for Event-Triggered LLM Invocation in Streaming Systems ​

7. TSSM: Triaxial State Space Model for Global Station Weather Forecasting with Temporal-Variable-Historical Modeling ​

8. Disentangling Knowledge States with Ability and Proficiency Modeling for Knowledge Tracing ​

9. STKAN: Kolmogorov-Arnold Networks for Spatio-Temporal Forecasting ​

10. A Hybrid Mamba for Audio-Visual Navigation ​

11. CoDiffGRN: Rethinking Gene Regulatory Network Inference via the BEELINE-KGC Benchmark and Co-evolutionary Discrete Diffusion ​

12. ShortOPD: Recovering Pruned LLMs with Short-to-Long On-Policy Distillation ​

13. HEDGEHOG: Hierarchical Evaluation of Drug Generators Through Rigorous Filtration ​

14. SteinGate: Tail-Sensitive Safe Reinforcement Learning via Stein Discrepancy ​

15. Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes ​

16. EMAGN: Efficient Multi-Attention Graph Network via Learned Clustering for Scalable Traffic Forecasting ​

17. Reassessing Muon for Matrix Factorization ​

18. Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners ​

19. Tabular Foundation Models for Discrete Choice Estimation ​

20. Accuracy-Preserving Stability Regularization for Large-Scale Retail Demand Forecasting ​

21. Agora: Collective and Permissionless Internet-Scale Pretraining of Large Language Models ​

22. Weight Feedback Computes the Jacobian Transpose Locally in Modern Deep Networks ​

23. Where Should RL Post-Training Compute Go? Model Size, Search, Learning, and Feedback ​

24. Self-Improving is Often Sudden: Enlightenment-style Finetuning for Large-Scale Models ​

25. Is the Statistical Advantage Worth the Cost? An Empirical Comparison of KANs and MLPs for Structured Data Classification ​

26. EXPLORE: Exploration with Guided Search for Analog Topology Generation using Language Models ​

27. OrDA: Orthogonal Disentanglement of Access Habits Framework for Homepage Marketing Block Recommendations ​

28. Temperature Scaling Is Not Enough: Calibration Gaps Under Human Label Distributions ​

29. Data-Efficient Adaptation of LLMs via Attention Head Reweighting ​

30. PUe: Biased Positive-Unlabeled Learning Enhancement by Causal Inference ​

31. Discrete Diffusion Models: A Unified Framework from Tokenization to Generation ​

32. Local Redundancy: An Information-Theoretic Measure of Plasticity from Synthetic Memorization ​

33. Distributionally Robust and Safe Imitation Learning ​

34. PQFA: Parallel Quantum Feature Augmentation of Fused Representations for Multimodal Classification ​

35. Explainable Artificial Intelligence for Anomaly Detection in Banking Transactions: An Internal Audit Perspective ​

36. DeepLoop: Depth Scaling for Looped Transformers ​

37. A VAE-Driven Multi-Task Satellite-Aided Semantic Communication Framework for 6G-Enabled Connected Autonomous Vehicles ​

38. Factorized Spectral Representations for Reinforcement Learning ​

arXiv cs.LG - 2026-07-16

1. Automatic Differentiation from Scratch: How PyTorch Computes Gradients in Physics-Informed Neural Networks

2. Beyond Backbone Backpropagation: A Decoupled Strategy for Efficient Transfer Learning

3. Federated Explainable Artificial Intelligence: Roles, Architectures, Evaluation, and Open Challenges

4. What Your Model Threw Away and Why You'll Want It Back: Masking, Fingerprinting, and Privacy from Discarded Geometry

5. Targeted Recovery of Weight-Space Mechanisms From Neural Networks

6. Uncertainty-Aware Sequential Decision Rules for Event-Triggered LLM Invocation in Streaming Systems

7. TSSM: Triaxial State Space Model for Global Station Weather Forecasting with Temporal-Variable-Historical Modeling

8. Disentangling Knowledge States with Ability and Proficiency Modeling for Knowledge Tracing

9. STKAN: Kolmogorov-Arnold Networks for Spatio-Temporal Forecasting

10. A Hybrid Mamba for Audio-Visual Navigation

11. CoDiffGRN: Rethinking Gene Regulatory Network Inference via the BEELINE-KGC Benchmark and Co-evolutionary Discrete Diffusion

12. ShortOPD: Recovering Pruned LLMs with Short-to-Long On-Policy Distillation

13. HEDGEHOG: Hierarchical Evaluation of Drug Generators Through Rigorous Filtration

14. SteinGate: Tail-Sensitive Safe Reinforcement Learning via Stein Discrepancy

15. Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes

16. EMAGN: Efficient Multi-Attention Graph Network via Learned Clustering for Scalable Traffic Forecasting

17. Reassessing Muon for Matrix Factorization

18. Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners

19. Tabular Foundation Models for Discrete Choice Estimation

20. Accuracy-Preserving Stability Regularization for Large-Scale Retail Demand Forecasting

21. Agora: Collective and Permissionless Internet-Scale Pretraining of Large Language Models

22. Weight Feedback Computes the Jacobian Transpose Locally in Modern Deep Networks

23. Where Should RL Post-Training Compute Go? Model Size, Search, Learning, and Feedback

24. Self-Improving is Often Sudden: Enlightenment-style Finetuning for Large-Scale Models

25. Is the Statistical Advantage Worth the Cost? An Empirical Comparison of KANs and MLPs for Structured Data Classification

26. EXPLORE: Exploration with Guided Search for Analog Topology Generation using Language Models

27. OrDA: Orthogonal Disentanglement of Access Habits Framework for Homepage Marketing Block Recommendations

28. Temperature Scaling Is Not Enough: Calibration Gaps Under Human Label Distributions

29. Data-Efficient Adaptation of LLMs via Attention Head Reweighting

30. PUe: Biased Positive-Unlabeled Learning Enhancement by Causal Inference

31. Discrete Diffusion Models: A Unified Framework from Tokenization to Generation

32. Local Redundancy: An Information-Theoretic Measure of Plasticity from Synthetic Memorization

33. Distributionally Robust and Safe Imitation Learning

34. PQFA: Parallel Quantum Feature Augmentation of Fused Representations for Multimodal Classification

35. Explainable Artificial Intelligence for Anomaly Detection in Banking Transactions: An Internal Audit Perspective

36. DeepLoop: Depth Scaling for Looped Transformers

37. A VAE-Driven Multi-Task Satellite-Aided Semantic Communication Framework for 6G-Enabled Connected Autonomous Vehicles

38. Factorized Spectral Representations for Reinforcement Learning