50 citations · 84 across the 8 of their papers we have counts for
9 papers
Block Parallelism For Efficient Distributed Long-Context Diffusion Language Model Training
Tarun Suresh, Pranshu Chaturvedi, Hangoo Kang +4
Block diffusion language models (BDLMs) combine autoregressive dependencies across blocks with parallel denoising within blocks, but long-context training is constrained by distrib…
Training Hybrid Block Diffusion Language Models with Partial Bidirectionality
Pranshu Chaturvedi, Parth Shroff, Tarun Suresh +2
High-throughput long-context generation is one of the central challenges for large language models. Generation is typically memory-bandwidth-bound rather than compute-bound: each d…
RelBench v2: A Large-Scale Benchmark and Repository for Relational Data
Justin Gu, Rishabh Ranjan, Charilaos Kanatsoulis +8
Relational deep learning (RDL) has emerged as a powerful paradigm for learning directly on relational databases by modeling entities and their relationships across multiple interco…
Secure Federated Learning Across Heterogeneous Cloud and High-Performance Computing Resources -- A Case Study on Federated Fine-tuning of LLaMA 2
Zilinghan Li, Shilan He, Pranshu Chaturvedi +4
Federated learning enables multiple data owners to collaboratively train robust machine learning models without transferring large or sensitive local datasets by only sharing the p…
Enabling End-to-End Secure Federated Learning in Biomedical Research on Heterogeneous Computing Environments with APPFLx
Trung-Hieu Hoang, Jordan Fuhrman, Ravi Madduri +8
Facilitating large-scale, cross-institutional collaboration in biomedical machine learning projects requires a trustworthy and resilient federated learning (FL) environment to ensu…
FedCompass: Efficient Cross-Silo Federated Learning on Heterogeneous Client Devices using a Computing Power Aware Scheduler
Zilinghan Li, Pranshu Chaturvedi, Shilan He +6
Cross-silo federated learning offers a promising solution to collaboratively train robust and generalized AI models without compromising the privacy of local datasets, e.g., health…