4 papers
RARE: Decoupling Representation Steering from Expert Routing in Mixture-of-Experts Language Models
Zhibo Zhang, Zhen Ouyang, Ling Shi +1
Representation engineering offers a lightweight means of controlling language-model behavior by modifying intermediate hidden states, but its direct application to Mixture-of-Exper…
TRUSS: Towards Task-Reliable and User-Safe Automated Agent Skill Generation
Zhibo Zhang, Zhen Ouyang, Ling Shi +1
Agent Skills package reusable natural language procedures with executable resources, enabling software agents to acquire task specific capabilities without model adaptation. Automa…
RASET: Router-Agnostic Safety-Critical Expert Tuning Exposes Localized Safety Enforcement Failures in Mixture-of-Experts LLMs
Zhibo Zhang, Yuxi Li, Zhen Ouyang +2
Mixture-of-Experts (MoE) LLMs rely on sparse, router-driven expert activation, yet how safety alignment interacts with routed expert specialization remains underexplored. A common…
Zenith: Scaling up Ranking Models for Billion-scale Livestreaming Recommendation
Ruifeng Zhang, Zexi Huang, Zikai Wang +11
Accurately capturing feature interactions is essential in recommender systems, and recent trends show that scaling up model capacity could be a key driver for next-level predictive…