2601.03450

Total: 1

#1 Soft Contextualized Encoder For User Defined Text Classification [PDF] [Copy] [Kimi] [REL]

Authors: Charu Maheshwari, Vyas Raina

User-Defined Text Classification (UDTC) considers the challenge of classifying input text to user-specified, previously unseen classes, a setting that arises frequently in real-world applications such as enterprise analytics, content moderation, and domain-specific information retrieval. We propose a soft-contextualized encoder architecture for UDTC which contextualizes each candidate label with the label set and a static soft prompt representation of the input query. Training on diverse, multi-source datasets enables the model to generalize effectively to zero-shot classification over entirely unseen topic sets drawn from arbitrary domains. We evaluate the proposed architecture both on held-out in-distribution test data and on multiple unseen UDTC benchmarks. Across datasets, the model achieves state-of-the-art performance, consistently outperforming or matching the baselines.

Subjects: Machine Learning , Artificial Intelligence

Publish: 2026-01-06 22:34:50 UTC