3 papers
cs.LG2026
IsoQuant: Hardware-Aligned SO(4) Isoclinic Rotations for LLM KV Cache Compression
Zhongping Ji
Orthogonal feature decorrelation is effective for low-bit online vector quantization, but dense random orthogonal transforms incur prohibitive storage and compute. RotorQu…
cs.CV2026
CliffordNet: All You Need is Geometric Algebra
Zhongping Ji
Modern computer vision architectures, from CNNs to Transformers, predominantly rely on the stacking of heuristic modules: spatial mixers (Attention/Conv) followed by channel mixers…
cs.LG2025
RiemannFormer: A Framework for Attention in Curved Spaces
Zhongping Ji
This research endeavors to offer insights into unlocking the further potential of transformer-based architectures. One of the primary motivations is to offer a geometric interpreta…