8 citations · 8 across the 2 of their papers we have counts for
4 papers
Ori: Drift-Aware Streaming -PCA for Very Low-Rank LLM Training
Xinyu Luo, Jincheng Zhou, Mengbo Wang +5
A prominent family of low-rank LLM optimizers, pioneered by GaLore, performs gradient-subspace projection: at each step, they project the gradient into a low-dimensional subspace a…
GeneFlow: Translation of Single-cell Gene Expression to Histopathological Images via Rectified Flow
Mengbo Wang, Shourya Verma, Aditya Malusare +6
Spatial transcriptomics (ST) technologies can be used to align transcriptomes with histopathological morphology, presenting exciting new opportunities for biomolecular discovery. U…
RestoRect: Degraded Image Restoration via Latent Rectified Flow & Feature Distillation
Shourya Verma, Mengbo Wang, Nadia Atallah Lanman +1
Current approaches for restoration of degraded images face a trade-off: high-performance models are slow for practical use, while fast models produce poor results. Knowledge distil…
Understanding the Natural Language of DNA using Encoder-Decoder Foundation Models with Byte-level Precision
Aditya Malusare, Harish Kothandaraman, Dipesh Tamboli +2
This paper presents the Ensemble Nucleotide Byte-level Encoder-Decoder (ENBED) foundation model, analyzing DNA sequences at byte-level precision with an encoder-decoder Transformer…