4 papers
SysTradeBench: An Iterative Build-Test-Patch Benchmark for Strategy-to-Code Trading Systems with Drift-Aware Diagnostics
Yuchen Cao, Hanlin Zhang, Jacky Wai Keung +2
Large language models (LLMs) are increasingly used as quantitative research copilots to translate natural-language strategy specifications into executable trading code. Yet most ex…
ASearch: Ambiguity-Aware Question Answering with Reinforcement Learning
Fengji Zhang, Xinyao Niu, Chengyang Ying +7
Recent advances in Large Language Models (LLMs) and Reinforcement Learning (RL) have led to strong performance in open-domain question answering (QA). However, existing models stil…
Towards Understanding Bugs in Distributed Training and Inference Frameworks for Large Language Models
Xiao Yu, Haoxuan Chen, Feifei Niu +3
With the rapid development of large language models (LLMs), distributed training and inference frameworks like DeepSpeed have become essential for scaling model training and infere…
HumanEval-V: Benchmarking High-Level Visual Reasoning with Complex Diagrams in Coding Tasks
Fengji Zhang, Linquan Wu, Huiyu Bai +6
Understanding and reasoning over diagrams is a fundamental aspect of human intelligence. While Large Multimodal Models (LMMs) have demonstrated impressive capabilities across vario…