1 citations · 1 across the 6 of their papers we have counts for
4 papers · 1 filter
Beyond Length: Quantifying Long-Range Information for Long-Context LLM Pretraining Data
Haoran Deng, Yingyu Lin, Zhenghao Lin +4
Long-context language models unlock advanced capabilities in reasoning, code generation, and document summarization by leveraging dependencies across extended spans of text. Howeve…
On the -Free Inference Complexity of Absorbing Discrete Diffusion
Xunpeng Huang, Yingyu Lin, Nishant Jain +4
Absorbing discrete diffusion has emerged as a dominant framework for discrete data generation. However, a significant disparity remains between its empirical success and theoretica…
Almost Linear Convergence under Minimal Score Assumptions: Quantized Transition Diffusion
Xunpeng Huang, Yingyu Lin, Nikki Lijing Kuang +4
Continuous diffusion models have demonstrated remarkable performance in data generation across various domains, yet their efficiency remains constrained by two critical limitations…
Purifying Approximate Differential Privacy with Randomized Post-processing
Yingyu Lin, Erchi Wang, Yi-An Ma +1
We propose a framework to convert -approximate Differential Privacy (DP) mechanisms into -pure DP mechanisms under certain conditions, a proces…