Showing cs.AIShow all
3 papers · 1 filter
cs.AI2026
InferOpt: Constrained Multi-Objective Search for LLM Inference Configurations
Qi Chen, Yingying Cheng, Zhaoyi Sun +3
Serving an LLM means setting dozens of inference-time knobs, from per-layer KV retention to per-layer expert counts. Practice sets them with mechanism-specific heuristics that retu…
cs.AI2025
GridCodex: A RAG-Driven AI Framework for Power Grid Code Reasoning and Compliance
Jinquan Shi, Yingying Cheng, Fan Zhang +3
The global shift towards renewable energy presents unprecedented challenges for the electricity industry, making regulatory reasoning and compliance increasingly vital. Grid codes,…
cs.AI2025
Making Slow Thinking Faster: Compressing LLM Chain-of-Thought via Step Entropy
Zeju Li, Jianyuan Zhong, Ziyang Zheng +5
Large Language Models (LLMs) using Chain-of-Thought (CoT) prompting excel at complex reasoning but generate verbose thought processes with considerable redundancy, leading to incre…