4 papers
FLARE MCMC: Fidelity-based Layer-Adaptive REcursive proposals for MCMC
Harini Venkatesan, Christian Shelton, Ming-Feng Ho +2
Markov chain Monte Carlo (MCMC) requires only the ability to evaluate the likelihood, making it a common technique for inference in complex models. However, it can have a slow mixi…
ResearchGPT: Benchmarking and Training LLMs for End-to-End Computer Science Research Workflows
Penghao Wang, Yuhao Zhou, Mengxuan Wu +12
As large language models (LLMs) advance, the ultimate vision for their role in science is emerging: we could build an AI collaborator to effectively assist human beings throughout…
Data Efficient Any Transformer-to-Mamba Distillation via Attention Bridge
Penghao Wang, Yuhao Zhou, Mengxuan Wu +3
State-space models (SSMs) have emerged as promising alternatives to Transformers for sequence modeling. However, training competitive SSMs from scratch remains computationally inte…
Dynamic Vision Mamba
Mengxuan Wu, Zekai Li, Zhiyuan Liang +9
Mamba-based vision models have gained extensive attention as a result of being computationally more efficient than attention-based models. However, spatial redundancy still exists…