Artificial Intelligence · 28.08.2026, 07:32 UTC
REPREC: Representation Driven Parameter-Efficient Recommendation System
| Schweregrad | info |
|---|---|
| Kategorie | Artificial Intelligence |
| Quelle | arXiv cs.AI ↗ |
| Veröffentlicht | 28.08.2026 UTC |
Sicherheitsmeldung mit Schweregrad noch nicht bewertet. Technische Details im Tab „Originaltext“; empfohlene Schritte in der Checkliste.
arXiv:2607.24845v3 Announce Type: replace-cross Abstract: Large language models (LLMs) have been applied to sequential recommendation by formulating it as a natural language task. Previous work has improved personalization by incorporating collaborative and sequential signals through input conditioning or LLM fine-tuning. However, existing approaches often rely on one or more of the following: LLM fine-tuning, additional architectural modules, representation distillation, or item-level conditioning over long interaction histories, increasing training complexity and deployment cost. We propose REPREC, a lightweight framework that reformulates LLM-based sequential recommendation through lightweight user representation alignment. REPREC maps a fixed-size user embedding from a frozen sequential encoder into a small set of learned soft tokens through a lightweight MLP injector that conditions a frozen LLM, leaving both pretrained backbones unchanged while training only the injector. We conducted exhaustive experiments on multiple benchmark datasets and demonstrate that REPREC consistently outperforms LoRA while remaining compatible with different pretrained sequential encoders and LLM backbones, enabling a modular and production-friendly recommendation pipeline without modifying either pretrained component. The gains are particularly pronounced for casual and core users across all datasets, highlighting REPREC's effectiveness in low-data regimes. Finally, when trained on short prompt histories and evaluated with longer contexts, REPREC maintains 85-100% of LoRA's performance …
Maßnahmen
⬇ Als MarkdownVerwandte Beiträge
- info Scaling Model-Generated Distillation Data Can Make Latent Teacher Traits More Recoverable
- info A Layer Importance Metric for Quantization Accounting for the Speed-Quality Trade-off in Autoregressive Models
- info Mitigating Strong-Modality Collapse in Multimodal Learning via Inverted Asymmetric Fusion
- info When Is the Sharp Covariance Envelope Tight? Feature-Only Geometry for Volume-Sampled Least Squares