Artificial Intelligence · 01.09.2026, 17:02 UTC
Riemannian Optimization for Hadamard Products of Low-Rank Matrices
| Schweregrad | info |
|---|---|
| Kategorie | Artificial Intelligence |
| Quelle | arXiv cs.LG ↗ |
| Veröffentlicht | 01.09.2026 UTC |
Sicherheitsmeldung mit Schweregrad noch nicht bewertet. Technische Details im Tab „Originaltext“; empfohlene Schritte in der Checkliste.
arXiv:2606.01216v2 Announce Type: replace Abstract: The elementwise Hadamard product of two low-rank matrices provides a parameter-efficient model for data with multiplicative structure, but its modeling is challenging due to the presence of additional symmetries under coupled row/column scalings between the two factors. In order to leverage the geometry of the space, we formulate the learning of such matrices as optimization on a Riemannian quotient manifold. We propose a novel block-diagonal Riemannian metric derived from the pullback of the Frobenius inner product. The metric is shown to be invariant under these symmetries. We develop a Riemannian gradient descent algorithm that uses a tuning-free Gauss--Newton step size and scales linearly in the number of observed entries per iteration. The versatile framework of Riemannian quotient optimization enables both first-order and second-order Riemannian methods, the latter through a closed-form connection and the Riemannian Hessian. Experiments on real and synthetic datasets illustrate the efficacy of our proposed Riemannian approach.
Maßnahmen
⬇ Als MarkdownVerwandte Beiträge
- info Cloud and On-Premises Deployment of Uzbek Legal RAG via Targeted Retriever Fine-Tuning
- info Modality Fault Lines: Structural Corruptions Reveal Fragile Omni-Modal Reasoning
- info Large Language Models Systematically Favor Popular Options: Evidence and Mitigation Across MCQs
- info When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptions