Processing math: 100%

2504.18376

Total: 1

#1 Pushing the boundary on Natural Language Inference [PDF6] [Copy] [Kimi6] [REL]

Authors: Pablo Miralles-González, Javier Huertas-Tato, Alejandro Martín, David Camacho

Natural Language Inference (NLI) is a central task in natural language understanding with applications in fact-checking, question answering, and information retrieval. Despite its importance, current NLI systems heavily rely on supervised learning with datasets that often contain annotation artifacts and biases, limiting generalization and real-world applicability. In this work, we apply a reinforcement learning-based approach using Group Relative Policy Optimization (GRPO) for Chain-of-Thought (CoT) learning in NLI, eliminating the need for labeled rationales and enabling this type of training on more challenging datasets such as ANLI. We fine-tune 7B, 14B, and 32B language models using parameter-efficient techniques (LoRA and QLoRA), demonstrating strong performance across standard and adversarial NLI benchmarks. Our 32B AWQ-quantized model surpasses state-of-the-art results on 7 out of 11 adversarial setsor on all of them considering our replicationwithin a 22GB memory footprint, showing that robust reasoning can be retained under aggressive quantization. This work provides a scalable and practical framework for building robust NLI systems without sacrificing inference quality.

Subjects: Computation and Language , Artificial Intelligence

Publish: 2025-04-25 14:20:57 UTC