Artificial Intelligence · 18.08.2026, 17:25 UTC
Encoding of musical structures in hidden units of restricted Boltzmann machines
| Schweregrad | info |
|---|---|
| Kategorie | Artificial Intelligence |
| Quelle | arXiv cs.LG ↗ |
| Veröffentlicht | 18.08.2026 UTC |
Sicherheitsmeldung mit Schweregrad noch nicht bewertet. Technische Details im Tab „Originaltext“; empfohlene Schritte in der Checkliste.
arXiv:2509.04899v4 Announce Type: replace-cross Abstract: Restricted Boltzmann machines (RBMs) are energy-based models originating from statistical physics, in which hidden units mediate the probability distribution of high-dimensional visible configurations. In this study, we use symbolic music as a structured non-physical dataset and investigate how musical regularities are encoded in the hidden layer of a Bernoulli-Bernoulli RBM. Musical scores by J.~S.~Bach are converted into binary piano-roll representations and used to train the model in an unsupervised manner. We then analyze the visible-layer patterns induced by individual hidden units by activating hidden units separately and computing the corresponding expected visible configurations. The trained RBM reconstructs piano-roll-like inputs and assigns lower energies to piano-roll configurations than to most non-musical binary images, indicating that the learned energy function captures statistical features of the piano-roll dataset. The hidden units mainly encode local temporal and pitch-statistical structures, such as sparse piano-roll-like textures, rather than directly separable musical concepts such as melodies, chords, or keys. We also analyze hidden-layer representations using t-SNE and find that transposed versions of the same musical pieces are not necessarily mapped to nearby regions in the hidden space. This behavior indicates that the trained RBM does not robustly capture transposition equivalence, which is naturally explained by the lack of translational invariance in standard RBM architectures. Samples …