11 papers
Model Evolution Under Zeroth-Order Optimization: A Neural Tangent Kernel Perspective
Chen Zhang, Yuxin Cheng, Chenchen Ding +5
Zeroth-order (ZO) optimization enables memory-efficient training of neural networks by estimating gradients via forward passes only, eliminating the need for backpropagation. Howev…
Can We Trust LLMs on Memristors? Diving into Reasoning Ability under Non-Ideality
Taiqiang Wu, Yuxin Cheng, Chenchen Ding +5
Memristor-based analog compute-in-memory (CIM) architectures provide a promising substrate for the efficient deployment of Large Language Models (LLMs), owing to superior energy ef…
InjectRBP: Steering Large Language Model Reasoning Behavior via Pattern Injection
Xiuping Wu, Zhao Yu, Yuxin Cheng +4
Reasoning can significantly enhance the performance of Large Language Models. While recent studies have exploited behavior-related prompts adjustment to enhance reasoning, these de…
OVD: On-policy Verbal Distillation
Jing Xiong, Hui Shen, Shansan Gong +7
Knowledge distillation offers a promising path to transfer reasoning capabilities from large teacher models to efficient student models; however, existing token-level on-policy dis…
Re-Activating Frozen Primitives for 3D Gaussian Splatting
Yuxin Cheng, Binxiao Huang, Wenyong Zhou +4
3D Gaussian Splatting (3D-GS) achieves real-time photorealistic novel view synthesis, yet struggles with complex scenes due to over-reconstruction artifacts, manifesting as local b…
Perspective-aware 3D Gaussian Inpainting with Multi-view Consistency
Yuxin Cheng, Binxiao Huang, Taiqiang Wu +5
3D Gaussian inpainting, a critical technique for numerous applications in virtual reality and multimedia, has made significant progress with pretrained diffusion models. However, e…