12 citations · 13 across the 7 of their papers we have counts for
3 papers · 1 filter
How Small Can You Go? LoRA Fine-Tuning 270M-8B Models for Merchant Information Extraction in Financial Transactions
Donghao Huang, Tomas Drietomsky, Benjamin Barrett +1
Merchant information extraction turns noisy financial transaction descriptors into structured fields at production scale. Our deployed LoRA-fine-tuned LLaMA~3.1-8B reaches 96.95\%…
Beyond Task Success: Measuring Workflow Fidelity in LLM-Based Agentic Payment Systems
Donghao Huang, Joon Kiat Chua, Zhaoxia Wang
LLM-based multi-agent systems are increasingly deployed for payment workflows, yet prevailing metrics, Task Success Rate (TSR) and Agent Handoff F1-Score (HF1), capture only final…
When Agents Fail to Act: A Diagnostic Framework for Tool Invocation Reliability in Multi-Agent LLM Systems
Donghao Huang, Gauri Malwe, Zhaoxia Wang
Multi-agent systems powered by large language models (LLMs) are transforming enterprise automation, yet systematic evaluation methodologies for assessing tool-use reliability remai…