2504.13125

Total: 1

#1 LLMs Meet Finance: Fine-Tuning Foundation Models for the Open FinLLM Leaderboard [PDF9] [Copy] [Kimi6] [REL]

Authors: Varun Rao, Youran Sun, Mahendra Kumar, Tejas Mutneja, Agastya Mukherjee, Haizhao Yang

This paper investigates the application of large language models (LLMs) to financial tasks. We fine-tuned foundation models using the Open FinLLM Leaderboard as a benchmark. Building on Qwen2.5 and Deepseek-R1, we employed techniques including supervised fine-tuning (SFT), direct preference optimization (DPO), and reinforcement learning (RL) to enhance their financial capabilities. The fine-tuned models demonstrated substantial performance gains across a wide range of financial tasks. Moreover, we measured the data scaling law in the financial domain. Our work demonstrates the potential of large language models (LLMs) in financial applications.

Subjects: Computation and Language , Artificial Intelligence , Machine Learning

Publish: 2025-04-17 17:42:02 UTC