5 papers · 1 filter
FLARE++: Low-rank attention with dynamic attention routing
Vedant Puri, Yongjie Jessica Zhang, Levent Burak Kara
Full self-attention is a strong token mixer for PDE surrogates on irregular domains, but its quadratic cost limits its use on large problems. Latent-space attention methods such as…
Accelerated Discovery of Cryoprotectant Cocktails via Multi-Objective Bayesian Optimization
Daniel Emerson, Nora Gaby-Biegel, Purva Joshi +3
Designing cryoprotectant agent (CPA) cocktails for vitrification is challenging because formulations must be concentrated enough to suppress ice formation yet non-toxic enough to p…
Heterogeneous Metamaterials Design via Multiscale Neural Implicit Representation
Hongrui Chen, Liwei Wang, Levent Burak Kara
Metamaterials are engineered materials composed of specially designed unit cells that exhibit extraordinary properties beyond those of natural materials. Complex engineering tasks…
FLARE: Fast Low-rank Attention Routing Engine
Vedant Puri, Aditya Joglekar, Sri Datta Ganesh Bandreddi +4
The quadratic complexity of self-attention limits the scalability of transformers on long sequences. We introduce Fast Low-rank Attention Routing Engine (FLARE), a token-mixing ope…
Attention to Detail: Fine-Scale Feature Preservation-Oriented Geometric Pre-training for AI-Driven Surrogate Modeling
Yu-hsuan Chen, Jing Bi, Cyril Ngo Ngoc +3
AI-driven surrogate modeling has become an increasingly effective alternative to physics-based simulations for 3D design, analysis, and manufacturing. These models leverage data-dr…