2601.19109

Total: 1

#1 Interpretable and Perceptually-Aligned Music Similarity with Pretrained Embeddings [PDF] [Copy] [Kimi] [REL]

Authors: Arhan Vohra, Taketo Akama

Perceptual similarity representations enable music retrieval systems to determine which songs sound most similar to listeners. State-of-the-art approaches based on task-specific training via self-supervised metric learning show promising alignment with human judgment, but are difficult to interpret or generalize due to limited dataset availability. We show that pretrained text-audio embeddings (CLAP and MuQ-MuLan) offer comparable perceptual alignment on similarity tasks without any additional fine-tuning. To surpass this baseline, we introduce a novel method to perceptually align pretrained embeddings with source separation and linear optimization on ABX preference data from listening tests. Our model provides interpretable and controllable instrument-wise weights, allowing music producers to retrieve stem-level loops and samples based on mixed reference songs.

Subject: Sound

Publish: 2026-01-27 02:21:52 UTC