most citedChallenges and Research Directions for Large Language Model Inference Hardware

5 citations · 5 across the 7 of their papers we have counts for

collaborators

8 papers

cs.LG2026

How Should Teachers Be Prepared? RL on Student-Induced States for On-Policy Distillation

Xiaoyu Ma, Haoyue Liu, Zhichao Wang +2

On-policy distillation (OPD) improves the reasoning capabilities of small language models through token-level teacher supervision on student-generated trajectories. Yet can teacher…

cs.SD2026

Do Language Models Need Music Supervision? Verifiable Rewards for Multi-Constraint Symbolic Music Generation

Haoyue Liu, Ye Chen, Zhichao Wang +3

Language models can now generate symbolic music from natural-language instructions. However, existing models still struggle to satisfy multiple explicit musical constraints simulta…

cs.AI2026

Why Sample What You Can Enumerate? Exact Policy Optimization for Genomic Tool Selection

Haoyue Liu, Xiaoyu Ma, Ye Chen +2

Reinforcement learning over a frozen reasoner has become a common recipe for teaching a policy which external tools to invoke. We show that this recipe becomes structurally mismatc…

cs.AI2026

SEPO: Evidence-Grounded Prompt Optimization via Structural Editing

Xiaoyu Ma, Haoyue Liu, Yiwen Li +4

Existing API-only prompt optimisers are often described as interpretable, but in practice, this usually means only post-hoc inspectability: each iteration still rewrites the prompt…

cs.AI2026

Are Prompt Optimizers Blind? Cross-Modal Visual Feedback for Automatic Prompt Optimization

Haoyue Liu, Xiaoyu Ma, Ye Chen +2

Automatic prompt optimization (APO) has been widely adopted to adapt vision-language models (VLMs) to downstream tasks without weight updates, yielding promising results. However,…

cs.AI2026

One Rewrite to Fix Them All? Type-Aware Repair Allocation for Text-to-Image Prompt Optimization

Haoyue Liu, Xiaoyu Ma, Ye Chen +2

Text-to-image (T2I) generators often fail to follow their prompts faithfully, producing wrong counts, swapped attributes, ambiguous relations, and illegible text. Prompt optimizati…

cs.AI2026

Select Smarter, Not More: Prompt-Aware Evaluation Scheduling with Submodular Guarantees

Xiaoyu Ma, Yiwen Li, Haoyue Liu +4

Automatic prompt optimization (APO) hinges on the quality of its evaluation signal, yet scoring every prompt candidate on the full training set is prohibitively expensive. Existing…

cs.AR2026★ 5 cited

Challenges and Research Directions for Large Language Model Inference Hardware

Xiaoyu Ma, David Patterson

Large Language Model (LLM) inference is hard. The autoregressive Decode phase of the underlying Transformer model makes LLM inference fundamentally different from training. Exacerb…