13 citations · 31 across the 33 of their papers we have counts for
34 papers
RobustSGPO: Search-Space Control for Agent Harness Evolution
Zibo Zhao, Jijun Shi, Mo Zhou +9
Semantic-gradient-based prompt optimization (SGPO) improves agent harnesses using execution feedback, but its local update rule leaves the choice of edit scope and operation unreso…
Schema as Parameterized Tools for Universal Information Extraction
Sheng Liang, Yongyue Zhang, Yaxiong Wu +2
Universal information extraction (UIE) primarily employs an extractive generation approach with large language models (LLMs), typically outputting structured information based on p…
Humanity's Last Code Exam: Can Advanced LLMs Conquer Human's Hardest Code Competition?
Xiangyang Li, Xiaopeng Li, Kuicai Dong +7
Code generation is a core capability of large language models (LLMs), yet mainstream benchmarks (e.g., APPs and LiveCodeBench) contain questions with medium-level difficulty and po…
Pangu Pro MoE: Mixture of Grouped Experts for Efficient Sparsity
Yehui Tang, Xiaosong Li, Fangcheng Liu +19
The surgence of Mixture of Experts (MoE) in Large Language Models promises a small price of execution cost for a much larger model parameter count and learning capacity, because on…
Pangu Light: Weight Re-Initialization for Pruning and Accelerating LLMs
Hanting Chen, Jiarui Qin, Jialong Guo +15
Large Language Models (LLMs) deliver state-of-the-art capabilities across numerous tasks, but their immense size and inference costs pose significant computational challenges for p…
InfoDeepSeek: Benchmarking Agentic Information Seeking for Retrieval-Augmented Generation
Yunjia Xi, Jianghao Lin, Menghui Zhu +10
Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by grounding responses with retrieved information. As an emerging paradigm, Agentic RAG further enhances…
Instruction-Tuning Data Synthesis from Scratch via Web Reconstruction
Yuxin Jiang, Yufei Wang, Chuhan Wu +8
The improvement of LLMs' instruction-following capabilities depends critically on the availability of high-quality instruction-response pairs. While existing automatic data synthet…
ToolACE-DEV: Self-Improving Tool Learning via Decomposition and EVolution
Xu Huang, Weiwen Liu, Xingshan Zeng +8
The tool-using capability of large language models (LLMs) enables them to access up-to-date external information and handle complex tasks. Current approaches to enhancing this capa…
Pangu Ultra MoE: How to Train Your Big MoE on Ascend NPUs
Yehui Tang, Yichun Yin, Yaoyuan Wang +71
Sparse large language models (LLMs) with Mixture of Experts (MoE) and close to a trillion parameters are dominating the realm of most capable language models. However, the massive…
Advancing and Benchmarking Personalized Tool Invocation for LLMs
Xu Huang, Yuefeng Huang, Weiwen Liu +5
Tool invocation is a crucial mechanism for extending the capabilities of Large Language Models (LLMs) and has recently garnered significant attention. It enables LLMs to solve comp…
Position: The Real Barrier to LLM Agent Usability is Agentic ROI
Weiwen Liu, Jiarui Qin, Xu Huang +10
Large Language Model (LLM) agents represent a promising shift in human-AI interaction, moving beyond passive prompt-response systems to autonomous agents capable of reasoning, plan…
Benchmarking Retrieval-Augmented Multimodal Generation for Document Question Answering
Kuicai Dong, Yujing Chang, Shijie Huang +3
Document Visual Question Answering (DocVQA) faces dual challenges in processing lengthy multimodal documents (text, images, tables) and performing cross-modal reasoning. Current do…
NL-Debugging: Exploiting Natural Language as an Intermediate Representation for Code Debugging
Weiming Zhang, Qingyao Li, Xinyi Dai +7
Debugging is a critical aspect of LLM's coding ability. Early debugging efforts primarily focused on code-level analysis, which often falls short when addressing complex programmin…
Pangu Ultra: Pushing the Limits of Dense Large Language Models on Ascend NPUs
Yichun Yin, Wenyong Huang, Kaikai Song +49
We present Pangu Ultra, a Large Language Model (LLM) with 135 billion parameters and dense Transformer modules trained on Ascend Neural Processing Units (NPUs). Although the field…
AdvKT: An Adversarial Multi-Step Training Framework for Knowledge Tracing
Lingyue Fu, Ting Long, Jianghao Lin +6
Knowledge Tracing (KT) monitors students' knowledge states and simulates their responses to question sequences. Existing KT models typically follow a single-step training paradigm,…
ToolACE-R: Model-aware Iterative Training and Adaptive Refinement for Tool Learning
Xingshan Zeng, Weiwen Liu, Xu Huang +8
Tool learning, which allows Large Language Models (LLMs) to leverage external tools for solving complex user tasks, has emerged as a promising avenue for extending model capabiliti…
Boost, Disentangle, and Customize: A Robust System2-to-System1 Pipeline for Code Generation
Kounianhua Du, Hanjing Wang, Jianxing Liu +7
Large language models (LLMs) have demonstrated remarkable capabilities in various domains, particularly in system 1 tasks, yet the intricacies of their problem-solving mechanisms i…
FuXi-: Scaling Recommendation Model with Feature Interaction Enhanced Transformer
Yufei Ye, Wei Guo, Jin Yao Chin +8
Inspired by scaling laws and large language models, research on large-scale recommendation models has gained significant attention. Recent advancements have shown that expanding se…
Adaptive Tool Use in Large Language Models with Meta-Cognition Trigger
Wenjun Li, Dexun Li, Kuicai Dong +6
Large language models (LLMs) have shown remarkable emergent capabilities, transforming the execution of functional tasks by leveraging external tools for complex problems that requ…
Crowd Comparative Reasoning: Unlocking Comprehensive Evaluations for LLM-as-a-Judge
Qiyuan Zhang, Yufei Wang, Yuxin Jiang +8
LLM-as-a-Judge, which generates chain-of-thought (CoT) judgments, has become a widely adopted auto-evaluation method. However, its reliability is compromised by the CoT reasoning's…
A Survey on Multi-Turn Interaction Capabilities of Large Language Models
Chen Zhang, Xinyi Dai, Yaxiong Wu +4
Multi-turn interaction in the dialogue system research refers to a system's ability to maintain context across multiple dialogue turns, enabling it to generate coherent and context…
MMDocIR: Benchmarking Multimodal Retrieval for Long Documents
Kuicai Dong, Yujing Chang, Xin Deik Goh +3
Multimodal document retrieval aims to identify and retrieve various forms of multimodal content, such as figures, tables, charts, and layout information from extensive documents. D…
Scaling New Frontiers: Insights into Large Recommendation Models
Wei Guo, Hao Wang, Luankang Zhang +16
Recommendation systems are essential for filtering data and retrieving relevant information across various applications. Recent advancements have seen these systems incorporate inc…
Optimizing Sequential Recommendation Models with Scaling Laws and Approximate Entropy
Tingjia Shen, Hao Wang, Chuhan Wu +7
Scaling Laws have emerged as a powerful framework for understanding how model performance evolves as they increase in size, providing valuable insights for optimizing computational…