18 citations · 22 across the 6 of their papers we have counts for
6 papers
Adamas: Hadamard Sparse Attention for Efficient Long-Context Inference
Siyuan Yan, Guo-Qing Jiang, Yuchen Zhang +4
Large language models (LLMs) now support context windows of hundreds of thousands to millions of tokens, enabling applications such as long-document summarization, large-scale code…
Neuro-symbolic Learning Yielding Logical Constraints
Zenan Li, Yunpeng Huang, Zhaoyu Li +5
Neuro-symbolic systems combine the abilities of neural perception and logical reasoning. However, end-to-end learning of neuro-symbolic systems is still an unsolved challenge. This…
LASER: Script Execution by Autonomous Agents for On-demand Traffic Simulation
Hao Gao, Jingyue Wang, Wenyang Fang +4
Autonomous Driving Systems (ADS) require diverse and safety-critical traffic scenarios for effective training and testing, but the existing data generation methods struggle to prov…
Securing Reliability: A Brief Overview on Enhancing In-Context Learning for Foundation Models
Yunpeng Huang, Yaonan Gu, Jingwei Xu +3
As foundation models (FMs) continue to shape the landscape of AI, the in-context learning (ICL) paradigm thrives but also encounters issues such as toxicity, hallucination, dispari…
The Right Prompts for the Job: Repair Code-Review Defects with Large Language Model
Zelin Zhao, Zhaogui Xu, Jialong Zhu +3
Automatic program repair (APR) techniques have the potential to reduce manual efforts in uncovering and repairing program defects during the code review (CR) process. However, the…
Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Survey
Yunpeng Huang, Jingwei Xu, Junyu Lai +9
Transformer-based Large Language Models (LLMs) have been applied in diverse areas such as knowledge bases, human interfaces, and dynamic agents, and marking a stride towards achiev…