Publications (63)
Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videos
Ke Li, Di Wang, Yongshan Zhu +5
IDEA Prune: An Integrated Enlarge-and-Prune Pipeline in Generative Language Model Pretraining
Yixiao Li, Xianzhi Du, Ajay Jaiswal +4
Medical Image Segmentation Using Deep Learning: A Survey
Risheng Wang, Tao Lei, Ruixia Cui +3
ProVG: Progressive Visual Grounding via Language Decoupling for Remote Sensing Imagery
Ke Li, Ting Wang, Di Wang +4
Effects of Oxygen Adsorption on the Surface State of Epitaxial Silicene on Ag(111)
Xun Xu, Jincheng Zhuang, Yi Du +9
Nutribullets Hybrid: Multi-document Health Summarization
Darsh J Shah, Lili Yu, Tao Lei +1
A New Improved Energy-Momentum Tensor and Its Possible Role in Gravity
Tao Lei, Zi-Wei Chen, Zhen-Lai Wang +1
Apple Intelligence Foundation Language Models: Tech Report 2025
Ethan Li, Anders Boesen Lindbo Larsen, Chen Zhang +395
Molding CNNs for text: non-linear, non-consecutive convolutions
Tao Lei, Regina Barzilay, Tommi Jaakkola
Style Transfer from Non-Parallel Text by Cross-Alignment
Tianxiao Shen, Tao Lei, Regina Barzilay +1
AXLearn: Modular, Hardware-Agnostic Large Model Training
Mark Lee, Chang Lan, Tom Gunter +34
Lightweight Facial Attractiveness Prediction Using Dual Label Distribution
Shu Liu, Enquan Huang, Ziyu Zhou +4
The mixing time of the Newman--Watts small world
Louigi Addario-Berry, Tao Lei
Autoregressive Knowledge Distillation through Imitation Learning
Alexander Lin, Jeremy Wohlwend, Howard Chen +1
Rationalizing Text Matching: Learning Sparse Alignments via Optimal Transport
Kyle Swanson, Lili Yu, Tao Lei
Conditional Adapters: Parameter-efficient Transfer Learning with Fast Inference
Tao Lei, Junwen Bai, Siddhartha Brahma +9
Building a Production Model for Retrieval-Based Chatbots
Kyle Swanson, Lili Yu, Christopher Fox +2
Small trees in supercritical random forests
Tao Lei
Spontaneous Formation of a Superconductor-Topological Insulator-Normal Metal Layered Heterostructure
Yu-Qi Wang, Xu Wu, Ye-Liang Wang +13
Representation Discrepancy Bridging Method for Remote Sensing Image-Text Retrieval
Hailong Ning, Siying Wang, Tao Lei +5
Simple Recurrent Units for Highly Parallelizable Recurrence
Tao Lei, Yu Zhang, Sida I. Wang +2
Distribution alignment based transfer fusion frameworks on quantum devices for seeking quantum advantages
Xi He, Feiyu Du, Xiaohan Yu +2
Scaling limit of random forests with prescribed degree sequences
Tao Lei
CiT-Net: Convolutional Neural Networks Hand in Hand with Vision Transformers for Medical Image Segmentation
Tao Lei, Rui Sun, Xuan Wang +3
MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training
Brandon McKinzie, Zhe Gan, Jean-Philippe Fauconnier +29
Rethinking the Role of Token Retrieval in Multi-Vector Retrieval
Jinhyuk Lee, Zhuyun Dai, Sai Meher Karthik Duddu +4
Service Capacity Enhanced Task Offloading and Resource Allocation in Multi-Server Edge Computing Environment
Wei Du, Tao Lei, Qiang He +4
RTS-Mono: A Real-Time Self-Supervised Monocular Depth Estimation Method for Real-World Deployment
Zeyu Cheng, Tongfei Liu, Tao Lei +3
When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute
Tao Lei
Quantum classifiers for domain adaptation
Xi He, Feiyu Du, Mingyuan Xue +3
Channel-Temporal Attention for First-Person Video Domain Adaptation
Xianyuan Liu, Shuo Zhou, Tao Lei +1
Learning to Skip for Language Modeling
Dewen Zeng, Nan Du, Tao Wang +4
Semi-supervised Question Retrieval with Gated Convolutions
Tao Lei, Hrishikesh Joshi, Regina Barzilay +4
SecRespond: Benchmarking AI Agents for Real-World Post-Compromise Incident Response
Lehan Wang, Boli Chen, Ruixue Ding +7
The paper presents SecRespond, a benchmark that evaluates large language model agents on post-compromise incident‑response tasks using forensic disk snapshots, alerts, and vulnerab…
Interactive Classification by Asking Informative Questions
Lili Yu, Howard Chen, Sida Wang +2
Instruction-Following Pruning for Large Language Models
Bairu Hou, Qibin Chen, Jianyu Wang +6
SPLA: Block Sparse Plus Linear Attention for Long Context Modeling
Bailin Wang, Dan Friedman, Tao Lei +1
Training Language Models with Memory Augmentation
Zexuan Zhong, Tao Lei, Danqi Chen
PMR-Net: Parallel Multi-Resolution Encoder-Decoder Network Framework for Medical Image Segmentation
Xiaogang Du, Dongxin Gu, Tao Lei +2
Lightweight Structure-aware Transformer Network for VHR Remote Sensing Image Change Detection
Tao Lei, Yetong Xu, Hailong Ning +4
Gravitational Coupling from Active Gravity
Tao Lei, Zi-Wei Chen, Zhen-Lai Wang +1
Parallel Track Transformers: Enabling Fast GPU Inference with Reduced Synchronization
Chong Wang, Nan Du, Tom Gunter +8
Structured Pruning of Large Language Models
Ziheng Wang, Jeremy Wohlwend, Tao Lei
Apple Intelligence Foundation Language Models
Tom Gunter, Zirui Wang, Chong Wang +152
Nutri-bullets: Summarizing Health Studies by Composing Segments
Darsh J Shah, Lili Yu, Tao Lei +1
Multi-Vector Retrieval as Sparse Alignment
Yujie Qian, Jinhyuk Lee, Sai Meher Karthik Duddu +5
Simple Recurrence Improves Masked Language Models
Tao Lei, Ran Tian, Jasmijn Bastings +1
New Energy-Momentum and Angular Momentum Tensors with Applications to Nucleon Structure
Zhen-Lai Wang, De-Tian Yang, Zi-Wei Chen +2
ASAPP-ASR: Multistream CNN and Self-Attentive SRU for SOTA Speech Recognition
Jing Pan, Joshua Shapiro, Jeremy Wohlwend +3
Rationalizing Neural Predictions
Tao Lei, Regina Barzilay, Tommi Jaakkola
Metric Learning for Dynamic Text Classification
Jeremy Wohlwend, Ethan R. Elenberg, Samuel Altschul +2
Towards Comprehensive Information-theoretic Multi-view Learning
Long Shi, Yunshan Ye, Wenjie Wang +4
EC-DIT: Scaling Diffusion Transformers with Adaptive Expert-Choice Routing
Haotian Sun, Tao Lei, Bowen Zhang +5
Team PyKale (xy9) Submission to the EPIC-Kitchens 2021 Unsupervised Domain Adaptation Challenge for Action Recognition
Xianyuan Liu, Raivo Koot, Shuo Zhou +2
Mixture-of-Experts with Expert Choice Routing
Yanqi Zhou, Tao Lei, Hanxiao Liu +7
SPEGC: Continual Test-Time Adaptation via Semantic-Prompt-Enhanced Graph Clustering for Medical Image Segmentation
Xiaogang Du, Jiawei Zhang, Tongfei Liu +2
CoLT5: Faster Long-Range Transformers with Conditional Computation
Joshua Ainslie, Tao Lei, Michiel de Jong +9
Gold nanocone array with wide angles and high absorptivity for light absorber
Xu Jiawei, Huang Ran, Tao Lei +5
Deriving Neural Architectures from Sequence and Graph Kernels
Tao Lei, Wengong Jin, Regina Barzilay +1
Adversarial Domain Adaptation for Duplicate Question Detection
Darsh J Shah, Tao Lei, Alessandro Moschitti +2
TEC-Net: Vision Transformer Embrace Convolutional Neural Networks for Medical Image Segmentation
Rui Sun, Tao Lei, Weichuan Zhang +3
Adaptive Morphological Reconstruction for Seeded Image Segmentation
Tao Lei, Xiaohong Jia, Tongliang Liu +3
SRU++: Pioneering Fast Recurrence with Attention for Speech Recognition
Jing Pan, Tao Lei, Kwangyoun Kim +2