11 citations · 28 across the 17 of their papers we have counts for
17 papers
OpenMedReason: Scientific Reasoning Supervision for Medical Vision-Language Models
Negin Baghbanzadeh, Pritam Sarkar, Michael Colacci +6
High-stakes clinical use of large vision-language models (LVLMs) requires reasoning that is grounded in visual evidence and clinical knowledge, not just correct final answers. We i…
Fine-Grained Benchmark Generation for Comprehensive Evaluation of Foundation Models
Mohammed Saidul Islam, Negin Baghbanzadeh, Farnaz Kohankhaki +5
Evaluation of foundation models often rely on aggregate scores from benchmarks that lack comprehensive coverage and metadata for a fine-grained evaluation. We introduce a framework…
Open-PMC-18M: A High-Fidelity Large Scale Medical Dataset for Multimodal Representation Learning
Negin Baghbanzadeh, Mohammed Saidul Islam, Sajad Ashkezari +2
In biomedical vision-language modeling, datasets are typically mined from scientific literature, pairing compound figures with captions that are short, context-dependent, and ofter…
Automated Capability Evaluation of Foundation Models
Arash Afkanpour, Omkar Dige, Fatemeh Tavakoli +3
Current evaluation frameworks for foundation models rely heavily on static, manually curated benchmarks, limiting their ability to capture the full breadth of model capabilities. T…
Advancing Medical Representation Learning Through High-Quality Data
Negin Baghbanzadeh, Adibvafa Fallahpour, Yasaman Parhizkar +8
Despite the growing scale of medical Vision-Language datasets, the impact of dataset quality on model performance remains under-explored. We introduce Open-PMC, a high-quality medi…
A Shared Encoder Approach to Multimodal Representation Learning
Shuvendu Roy, Franklin Ogidi, Ali Etemad +2
Multimodal representation learning has demonstrated remarkable potential in enabling models to process and integrate diverse data modalities, such as text and images, for improved…
Benchmarking Vision-Language Contrastive Methods for Medical Representation Learning
Shuvendu Roy, Yasaman Parhizkar, Franklin Ogidi +5
We perform a comprehensive benchmarking of contrastive frameworks for learning multimodal representations in the medical domain. Through this study, we aim to answer the following…
Consistency-Guided Asynchronous Contrastive Tuning for Few-Shot Class-Incremental Tuning of Foundation Models
Shuvendu Roy, Elham Dolatabadi, Arash Afkanpour +1
We propose Consistency-guided Asynchronous Contrastive Tuning (CoACT), a novel method for continuously tuning foundation models to learn new classes in few-shot settings. CoACT con…
EHRMamba: Towards Generalizable and Scalable Foundation Models for Electronic Health Records
Adibvafa Fallahpour, Mahshid Alinoori, Wenqian Ye +3
Transformers have significantly advanced the modeling of Electronic Health Records (EHR), yet their deployment in real-world healthcare is limited by several key challenges. Firstl…
Can Generative Models Improve Self-Supervised Representation Learning?
Sana Ayromlou, Vahid Reza Khazaie, Fereshteh Forghani +1
The rapid advancement in self-supervised representation learning has highlighted its potential to leverage unlabeled data for learning rich visual representations. However, the exi…
Random Field Augmentations for Self-Supervised Representation Learning
Philip Andrew Mansfield, Arash Afkanpour, Warren Richard Morningstar +1
Self-supervised representation learning is heavily dependent on data augmentations to specify the invariances encoded in representations. Previous work has shown that applying dive…
Federated Variational Inference: Towards Improved Personalization and Generalization
Elahe Vedadi, Joshua V. Dillon, Philip Andrew Mansfield +3
Conventional federated learning algorithms train a single global model by leveraging all participating clients' data. However, due to heterogeneity in client generative distributio…
BERT for Long Documents: A Case Study of Automated ICD Coding
Arash Afkanpour, Shabir Adeel, Hansenclever Bassani +11
Transformer models have achieved great success across many NLP problems. However, previous studies in automated ICD coding concluded that these models fail to outperform some of th…
Federated Training of Dual Encoding Models on Small Non-IID Client Datasets
Raviteja Vemulapalli, Warren Richard Morningstar, Philip Andrew Mansfield +4
Dual encoding models that encode a pair of inputs are widely used for representation learning. Many approaches train dual encoding models by maximizing agreement between pairs of e…
Empirical analysis of representation learning and exploration in neural kernel bandits
Michal Lisicki, Arash Afkanpour, Graham W. Taylor
Neural bandits have been shown to provide an efficient solution to practical sequential decision tasks that have nonlinear reward functions. The main contributor to that success is…
Evaluating Curriculum Learning Strategies in Neural Combinatorial Optimization
Michal Lisicki, Arash Afkanpour, Graham W. Taylor
Neural combinatorial optimization (NCO) aims at designing problem-independent and efficient neural network-based strategies for solving combinatorial problems. The field recently e…
A Randomized Mirror Descent Algorithm for Large Scale Multiple Kernel Learning
Arash Afkanpour, András György, Csaba Szepesvári +1
We consider the problem of simultaneously learning to linearly combine a very large number of kernels and learn a good predictor based on the learnt kernel. When the number of kern…