2506.02858

Total: 1

#1 DGMO: Training-Free Audio Source Separation through Diffusion-Guided Mask Optimization [PDF2] [Copy] [Kimi3] [REL]

Authors: Geonyoung Lee, Geonhee Han, Paul Hongsuck Seo

Language-queried Audio Source Separation (LASS) enables open-vocabulary sound separation via natural language queries. While existing methods rely on task-specific training, we explore whether pretrained diffusion models, originally designed for audio generation, can inherently perform separation without further training. In this study, we introduce a training-free framework leveraging generative priors for zero-shot LASS. Analyzing naive adaptations, we identify key limitations arising from modality-specific challenges. To address these issues, we propose Diffusion-Guided Mask Optimization (DGMO), a test-time optimization framework that refines spectrogram masks for precise, input-aligned separation. Our approach effectively repurposes pretrained diffusion models for source separation, achieving competitive performance without task-specific supervision. This work expands the application of diffusion models beyond generation, establishing a new paradigm for zero-shot audio separation. The code is available at: https://wltschmrz.github.io/DGMO/

Subjects: Audio and Speech Processing , Artificial Intelligence , Sound

Publish: 2025-06-03 13:24:57 UTC