5 papers
FinAuditing: A Financial Taxonomy-Structured Multi-Document Benchmark for Evaluating LLMs
Yan Wang, Keyi Wang, Shanshan Yang +12
Going beyond simple text processing, financial auditing requires detecting semantic, structural, and numerical inconsistencies across large-scale disclosures. As financial reports…
Evaluation and Benchmarking Suite for Financial Large Language Models and Agents
Shengyuan Lin, Kaiwen He, Jaisal Patel +10
Over the past three years, the financial services industry has witnessed Large Language Models (LLMs) and agents transitioning from the exploration stage to readiness and governanc…
Reasoning Models Ace the CFA Exams
Jaisal Patel, Yunzhe Chen, Kaiwen He +4
Previous research has reported that large language models (LLMs) demonstrate poor performance on the Chartered Financial Analyst (CFA) exams. However, recent reasoning models have…
FinLoRA: Benchmarking LoRA Methods for Fine-Tuning LLMs on Financial Datasets
Dannong Wang, Jaisal Patel, Daochen Zha +2
Low-rank adaptation (LoRA) methods show great potential for scaling pre-trained general-purpose Large Language Models (LLMs) to hundreds or thousands of use scenarios. However, the…
A Report on Financial Regulations Challenge at COLING 2025
Keyi Wang, Jaisal Patel, Charlie Shen +9
Financial large language models (FinLLMs) have been applied to various tasks in business, finance, accounting, and auditing. Complex financial regulations and standards are critica…