Artificial Intelligence · 01.09.2026, 14:33 UTC
Selection, Representation, and Execution in Sparse Fourier Neural Operators
| Schweregrad | info |
|---|---|
| Kategorie | Artificial Intelligence |
| Quelle | arXiv cs.LG ↗ |
| Veröffentlicht | 01.09.2026 UTC |
Sicherheitsmeldung mit Schweregrad noch nicht bewertet. Technische Details im Tab „Originaltext“; empfohlene Schritte in der Checkliste.
arXiv:2608.30070v1 Announce Type: new Abstract: Sparse representations are often expected to make models smaller and also reduce inference cost. For Fourier Neural Operators (FNOs), these objectives are not equivalent or do not always align: removing parts of the learned operator can leave the underlying transforms and dense computations unchanged, while changing the grid on which the model is evaluated can introduce overhead of its own. We therefore distinguish sparsity in the representation, in the stored parameters, in the theoretical operation count, and in measured runtime, and present an empirical study of several routes toward sparse FNOs that tests each transition between them separately. Coarsening the execution grid reduces the theoretical cost without reducing measured latency, and adding a correction term recovers accuracy at the cost of making the model slower. Even an 83\% parameter reduction remains slower than the dense baseline under ordinary execution. These results motivate a stricter definition of useful sparsity: the deployed operator must preserve solution accuracy and map its reduced support to a genuinely cheaper execution path.
Maßnahmen
⬇ Als MarkdownVerwandte Beiträge
- info Reciprocity Separates Gradient Flow from Rotation in Conservative Physical Learning
- info PAC: Progress-Augmented Advantage Curriculum for Multi-Task Reinforcement Learning of LLMs
- info When the Martingale Never Stops Firing: Anytime-Valid Gating on Real Forecast Streams
- info Generative multi-domain transfer learning for fault detection in data-scarce wind turbines