activity
20242026
most citedQ-Heart: ECG Question Answering via Knowledge-Informed Multimodal LLMs

2 citations · 4 across the 18 of their papers we have counts for

collaborators

20 papers

cs.LG2026

SimAuthor: Harnessing Foundation Models for Persistent Scientific Simulator Authoring

Yishan Wang, Ran Piao, Mathias Funk +1

Foundation models can generate scientific code, but authoring a scientific simulator (an executable program encoding hypotheses about how mechanisms generate observable signals) re…

cs.LG2026

CardioState-JEPA: Delay-Aware Cross-Modal Learning of a Shared Cardiac Representation

Hamza Shafiq, Hung Manh Pham, Bin Zhu +3

Electrocardiography (ECG), photoplethysmography (PPG), and phonocardiography (PCG) provide complementary views of the same cardiac cycle, yet existing cardiac foundation models are…

cs.CL2026

Zero-Shot Respiratory Sound Classification through LLM-Augmented Audio-Text Alignment

Mustafa Talha İlerisoy, Hung Manh Pham, Mathias Funk +2

Self-supervised respiratory encoders lack semantic grounding in clinical domain needed for zero-shot inference, limiting their utility without task-specific labeled data. We propos…

cs.LG2026

Unlocking In-Context Learning in Audio-Language Models from Decentralized Medical Audio

Ran Piao, Tsai-Ning Wang, Martijn den Dekker +4

Clinical audio diagnosis in low-resource settings requires models that identify conditions from minimal examples without large annotated corpora. We propose Federated Self-Contextu…

cs.AI2026

VitalAgent: A Tool-Augmented Agent for Reactive and Proactive Physiological Monitoring over Wearable Health Data

Di Zhu, Yu Yvonne Wu, Hong Jia +3

Wearable devices enable continuous monitoring of physiological signals such as ECG and PPG, but existing mHealth systems are largely limited to task-specific prediction pipelines o…

cs.SD2026

Adaptive Test-Time Scaling for Zero-Shot Respiratory Audio Classification

Tsai-Ning Wang, Herman Teun den Dekker, Lin-Lin Chen +2

Automated respiratory audio analysis promises scalable, non-invasive disease screening, yet progress is limited by scarce labeled data and costly expert annotation. Zero-shot infer…

cs.LG2026

Learning ECG Image Representations via Dual Physiological-Aware Alignments

Hung Manh Pham, Jialu Tang, Aaqib Saeed +3

Electrocardiograms (ECGs) are among the most widely used diagnostic tools for cardiovascular diseases, and a large amount of ECG data worldwide appears only in image form. However,…

cs.CL2026

PulseLM: A Foundation Dataset and Benchmark for PPG-Text Learning

Hung Manh Pham, Jinyang Wu, Xiao Ma +6

Photoplethysmography (PPG) is a widely used non-invasive sensing modality for continuous cardiovascular and physiological monitoring across clinical, laboratory, and wearable setti…

cs.LG2026

StethoLM: Audio Language Model for Cardiopulmonary Analysis Across Clinical Tasks

Yishan Wang, Tsai-Ning Wang, Mathias Funk +1

Listening to heart and lung sounds - auscultation - is one of the first and most fundamental steps in a clinical examination. Despite being fast and non-invasive, it demands years…

cs.LG2026

UniPACT: A Multimodal Framework for Prognostic Question Answering on Raw ECG and Structured EHR

Jialu Tang, Tong Xia, Yuan Lu +1

Accurate clinical prognosis requires synthesizing structured Electronic Health Records (EHRs) with real-time physiological signals like the Electrocardiogram (ECG). Large Language…

cs.SD2025

Language Models as Semantic Teachers: Post-Training Alignment for Medical Audio Understanding

Tsai-Ning Wang, Lin-Lin Chen, Neil Zeghidour +1

Pre-trained audio models excel at detecting acoustic patterns in auscultation sounds but often fail to grasp their clinical significance, limiting their use and performance in diag…

cs.LG2025

Interpretable Multimodal Zero-Shot ECG Diagnosis via Structured Clinical Knowledge Alignment

Jialu Tang, Hung Manh Pham, Ignace De Lathauwer +4

Electrocardiogram (ECG) interpretation is essential for cardiovascular disease diagnosis, but current automated systems often struggle with transparency and generalization to unsee…

cs.SD2025★ 1 cited

Unified Acoustic Representations for Screening Neurological and Respiratory Pathologies from Voice

Ran Piao, Yuan Lu, Hareld Kemps +2

Voice-based health assessment offers unprecedented opportunities for scalable, non-invasive disease screening, yet existing approaches typically focus on single conditions and fail…

cs.LG2025

CaReAQA: A Cardiac and Respiratory Audio Question Answering Model for Open-Ended Diagnostic Reasoning

Tsai-Ning Wang, Lin-Lin Chen, Neil Zeghidour +1

Medical audio signals, such as heart and lung sounds, play a crucial role in clinical diagnosis. However, analyzing these signals remains challenging: traditional methods rely on h…

eess.SP2025★ 2 cited

Q-Heart: ECG Question Answering via Knowledge-Informed Multimodal LLMs

Hung Manh Pham, Jialu Tang, Aaqib Saeed +1

Electrocardiography (ECG) offers critical cardiovascular insights, such as identifying arrhythmias and myocardial ischemia, but enabling automated systems to answer complex clinica…

cs.HC2025

Reliable Physiological Monitoring on the Wrist Using Generative Deep Learning to Address Poor Skin-Sensor Contact

Manh Pham Hung, Matthew Yiwen Ho, Yiming Zhang +3

Photoplethysmography (PPG) is a widely adopted, non-invasive technique for monitoring cardiovascular health and physiological parameters in both consumer and clinical settings. Whi…

cs.LG2024★ 1 cited

RespLLM: Unifying Audio and Text with Multimodal LLMs for Generalized Respiratory Health Prediction

Yuwei Zhang, Tong Xia, Aaqib Saeed +1

The high incidence and mortality rates associated with respiratory diseases underscores the importance of early screening. Machine learning models can automate clinical consultatio…

cs.LG2024

Electrocardiogram-Language Model for Few-Shot Question Answering with Meta Learning

Jialu Tang, Tong Xia, Yuan Lu +2

Electrocardiogram (ECG) interpretation requires specialized expertise, often involving synthesizing insights from ECG signals with complex clinical queries posed in natural languag…

cs.LG2024

Boosting Masked ECG-Text Auto-Encoders as Discriminative Learners

Hung Manh Pham, Aaqib Saeed, Dong Ma

The accurate interpretation of Electrocardiogram (ECG) signals is pivotal for diagnosing cardiovascular diseases. Integrating ECG signals with accompanying textual reports further…

cs.LG2024

Electrocardiogram Report Generation and Question Answering via Retrieval-Augmented Self-Supervised Modeling

Jialu Tang, Tong Xia, Yuan Lu +2

Interpreting electrocardiograms (ECGs) and generating comprehensive reports remain challenging tasks in cardiology, often requiring specialized expertise and significant time inves…