6 citations · 6 across the 9 of their papers we have counts for
6 papers · 1 filter
Mitigating Position Bias in Transformers via Layer-Specific Positional Embedding Scaling
Changze Lv, Zhenghua Wang, Yiran Ding +9
Large Language Models (LLMs) still struggle with the ``lost-in-the-middle'' problem, where critical information located in the middle of long-context inputs is often underrepresent…
Benchmark^2: Systematic Evaluation of LLM Benchmarks
Qi Qian, Chengsong Huang, Jingwen Xu +13
The rapid proliferation of benchmarks for evaluating large language models (LLMs) has created an urgent need for systematic methods to assess benchmark quality itself. We propose B…
Progressive Mastery: Customized Curriculum Learning with Guided Prompting for Mathematical Reasoning
Muling Wu, Qi Qian, Wenhao Liu +12
Large Language Models (LLMs) have achieved remarkable performance across various reasoning tasks, yet post-training is constrained by inefficient sample utilization and inflexible…
Layer-Specific Scaling of Positional Encodings for Superior Long-Context Modeling
Zhenghua Wang, Yiran Ding, Changze Lv +5
Although large language models (LLMs) have achieved significant progress in handling long-context inputs, they still suffer from the ``lost-in-the-middle'' problem, where crucial i…
Searching for Best Practices in Retrieval-Augmented Generation
Xiaohua Wang, Zhenghua Wang, Xuan Gao +11
Retrieval-augmented generation (RAG) techniques have proven to be effective in integrating up-to-date information, mitigating hallucinations, and enhancing response quality, partic…
UPLex: Fine-Grained Personality Control in Large Language Models via Unsupervised Lexical Modulation
Tianlong Li, Wenhao Liu, Muling Wu +6
Personality is a crucial factor that shapes human communication patterns, thereby regulating the personalities of large language models (LLMs) holds significant potential in enhanc…