most citedMid-Training of Large Language Models: A Survey

1 citations · 1 across the 9 of their papers we have counts for

collaborators

9 papers

cs.AI2026

WinDOM: Self-Family Distillation for Small-Model GUI Grounding

Chengheng Li-Chen, Zhiqian Zhou, Hao Chen +1

Small (2B) GUI-grounding agents are attractive for on-device deployment, accessibility tooling, and low-cost iteration, but at this scale they face two open recipe questions:…

cs.CL2026

FiLM-Coordinated Dual-Branch Transformer for Global-Local Dependency Modeling in Language Modeling

Zhiqiang Zhou, Xu Ling, Junliang Dai

Standard Transformers use a single self-attention pathway to model both global dependencies and local patterns, creating tension between long-range structural reasoning and fine-gr…

cs.CV2026

Gen-VCoT: Generative Visual Chain-of-Thought Reasoning via Diffusion-Based RGB Intermediate Representations

Zhiqiang Zhou, Junliang Dai, Xu ling

Multimodal large language models (MLLMs) excel at visual reasoning but rely on text-based chain-of-thought (CoT), lacking interpretable visual intermediates. Existing methods use o…

cs.LG2026

TriAdReview: Triangular Adversarial Review Architecture for Multi-Model Technical Document Generation

Zhiqiang Zhou, Junliang Dai, Xu Ling

Large language models (LLMs) are increasingly used for technical document generation, yet single-model outputs often suffer from over-engineering, security blind spots, and incompl…

cs.LG2026

CLP: Collocation-Length Prediction for Zero-Loss Adaptive Multi-Token Inference

Xuezhen Xie, Zhiqiang Zhou

Large language model inference is bottlenecked by autoregressive decoding, where each token requires a full forward pass. Multi-token prediction (MTP) offers a promising accelerati…

cs.CV2026

Feature Alignment Determines Fusion Strategy: A Comparative Study of Cross-Attention and Concatenation in Multimodal Learning

Zhiqiang Zhou, Xuezhen Xie

The choice between cross-attention and concatenation for multimodal fusion remains governed by practitioner intuition rather than principled understanding. In this paper, we demons…

cs.AI2025

Each Prompt Matters: Scaling Reinforcement Learning Without Wasting Rollouts on Hundred-Billion-Scale MoE

Anxiang Zeng, Haibo Zhang, Hailing Zhang +13

We present CompassMax-V3-Thinking, a hundred-billion-scale MoE reasoning model trained with a new RL framework built on one principle: each prompt must matter. Scaling RL to this s…

cs.AI2025

Towards Reliable Evaluation of Large Language Models for Multilingual and Multimodal E-Commerce Applications

Shuyi Xie, Ziqin Liew, Hailing Zhang +5

Large Language Models (LLMs) excel on general-purpose NLP benchmarks, yet their capabilities in specialized domains remain underexplored. In e-commerce, existing evaluations-such a…

cs.CL2025★ 1 cited

Mid-Training of Large Language Models: A Survey

Kaixiang Mo, Yuxin Shi, Weiwei Weng +4

Large language models (LLMs) are typically developed through large-scale pre-training followed by task-specific fine-tuning. Recent advances highlight the importance of an intermed…