31 citations · 43 across the 7 of their papers we have counts for
7 papers
Development and Evaluation of Ultrasound Image Learning Pipelines for MASLD Risk Stratification
Guangyi Zhang, Xiaohong Wang, Eugene Cheah +4
Metabolic dysfunction-associated steatotic liver disease (MASLD) affects approximately 30% of the general population. Ultrasound-based imaging, including B-mode imaging and shear w…
Ultrasound-Based Prediction of Cirrhosis Decompensation Using Large-Scale Computer Vision Models
Guangyi Zhang, Peiyun Ni, Eugene Cheah +4
Decompensation represents a critical transition in the course of cirrhosis, yet clinicians have limited non-invasive tools to reliably predict its onset. In this study, we propose…
Key-Value Means: Transformers with Expandable Block-Recurrent Compressed Memory
Daniel Goldstein, Navneel Singhal, Eugene Cheah
Recall presents a difficult choice: transformers have a linearly growing memory that slows each successive token, while linear RNNs typically have fixed costs but limited recall. W…
GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression
Daniel Goldstein, Fares Obeid, Eric Alcaide +2
We introduce GoldFinch, a hybrid Linear Attention/Transformer sequence model that uses a new technique to efficiently generate a highly compressed and reusable KV-Cache in linear t…
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
Bo Peng, Daniel Goldstein, Quentin Anthony +27
We present Eagle (RWKV-5) and Finch (RWKV-6), sequence models improving upon the RWKV (RWKV-4) architecture. Our architectural design advancements include multi-headed matrix-value…
Network-Agnostic Knowledge Transfer for Medical Image Segmentation
Shuhang Wang, Vivek Kumar Singh, Alex Benjamin +5
Conventional transfer learning leverages weights of pre-trained networks, but mandates the need for similar neural architectures. Alternatively, knowledge distillation can transfer…