8 citations · 25 across the 18 of their papers we have counts for
20 papers
Refined Grid Sampling for Efficient Implicit Neural Representations of Large-Scale Scientific Data
Guang Zhao, Xihaier Luo, Sean McCue +5
Implicit neural representations (INRs) offer a powerful framework for modeling high-dimensional physical fields, but their training remains inefficient because evaluating dense coo…
Efficient Neural Field Learning via Adaptive Coverage and Focused Sampling
Guang Zhao, Xihaier Luo, Huan-Hsin Tseng +4
Implicit neural representations (INRs) provide a flexible framework for modeling high-dimensional continuous fields, but their training is often inefficient due to uniform subsampl…
LeJOT-AutoML: LLM-Driven Feature Engineering for Job Execution Time Prediction in Databricks Cost Optimization
Lizhi Ma, Yi-Xiang Hu, Yihui Ren +2
Databricks job orchestration systems (e.g., LeJOT) reduce cloud costs by selecting low-priced compute configurations while meeting latency and dependency constraints. Accurate exec…
LeJOT: An Intelligent Job Cost Orchestration Solution for Databricks Platform
Lizhi Ma, Yi-Xiang Hu, Yuke Wang +5
With the rapid advancements in big data technologies, the Databricks platform has become a cornerstone for enterprises and research institutions, offering high computational effici…
Data Management System Analysis for Distributed Computing Workloads
Kuan-Chieh Hsu, Sairam Sri Vatsavai, Ozgur O. Kilic +20
Large-scale international collaborations such as ATLAS rely on globally distributed workflows and data management to process, move, and store vast volumes of data. ATLAS's Producti…
CGSim: A Simulation Framework for Large Scale Distributed Computing Environment
Sairam Sri Vatsavai, Raees Khan, Kuan-Chieh Hsu +20
Large-scale distributed computing infrastructures such as the Worldwide LHC Computing Grid (WLCG) require comprehensive simulation tools for evaluating performance, testing new alg…
TPCpp-10M: Simulated proton-proton collisions in a Time Projection Chamber for AI Foundation Models
Shuhang Li, Yi Huang, David Park +10
Scientific foundation models hold great promise for advancing nuclear and particle physics by improving analysis precision and accelerating discovery. Yet, progress in this field i…
Machine Learning-Driven Predictive Resource Management in Complex Science Workflows
Tasnuva Chowdhury, Tadashi Maeno, Fatih Furkan Akman +23
The collaborative efforts of large communities in science experiments, often comprising thousands of global members, reflect a monumental commitment to exploration and discovery. R…
FM4NPP: A Scaling Foundation Model for Nuclear and Particle Physics
David Park, Shuhang Li, Yi Huang +9
Large language models have revolutionized artificial intelligence by enabling large, generalizable models trained through self-supervision. This paradigm has inspired the developme…
Towards an Introspective Dynamic Model of Globally Distributed Computing Infrastructures
Ozgur O. Kilic, David K. Park, Yihui Ren +18
Large-scale scientific collaborations like ATLAS, Belle II, CMS, DUNE, and others involve hundreds of research institutes and thousands of researchers spread across the globe. Thes…
Alternative Mixed Integer Linear Programming Optimization for Joint Job Scheduling and Data Allocation in Grid Computing
Shengyu Feng, Jaehyung Kim, Yiming Yang +18
This paper presents a novel approach to the joint optimization of job scheduling and data allocation in grid computing environments. We formulate this joint optimization problem as…
Efficient Compression of Sparse Accelerator Data Using Implicit Neural Representations and Importance Sampling
Xihaier Luo, Samuel Lurvey, Yi Huang +3
High-energy, large-scale particle colliders in nuclear and high-energy physics generate data at extraordinary rates, reaching up to terabyte and several petabytes per second, r…
Variable Rate Neural Compression for Sparse Detector Data
Yi Huang, Yeonju Go, Jin Huang +9
High-energy large-scale particle colliders generate data at extraordinary rates. Developing real-time high-throughput data compression algorithms to reduce data volume and meet the…
AI Surrogate Model for Distributed Computing Workloads
David K. Park, Yihui Ren, Ozgur O. Kilic +18
Large-scale international scientific collaborations, such as ATLAS, Belle II, CMS, and DUNE, generate vast volumes of data. These experiments necessitate substantial computational…
Automated and Holistic Co-design of Neural Networks and ASICs for Enabling In-Pixel Intelligence
Shubha R. Kharel, Prashansa Mukim, Piotr Maj +4
Extreme edge-AI systems, such as those in readout ASICs for radiation detection, must operate under stringent hardware constraints such as micron-level dimensions, sub-milliwatt po…
Effectiveness of denoising diffusion probabilistic models for fast and high-fidelity whole-event simulation in high-energy heavy-ion experiments
Yeonju Go, Dmitrii Torbunov, Timothy Rinn +6
Artificial intelligence (AI) generative models, such as generative adversarial networks (GANs), variational auto-encoders, and normalizing flows, have been widely used and studied…
Studying the Impact of Latent Representations in Implicit Neural Networks for Scientific Continuous Field Reconstruction
Wei Xu, Derek Freeman DeSantis, Xihaier Luo +5
Learning a continuous and reliable representation of physical fields from sparse sampling is challenging and it affects diverse scientific disciplines. In a recent work, we present…
Continuous Field Reconstruction from Sparse Observations with Implicit Neural Networks
Xihaier Luo, Wei Xu, Yihui Ren +2
Reliably reconstructing physical fields from sparse sensor data is a challenge that frequently arises in many scientific domains. In practice, the process generating the data often…
Fast 2D Bicephalous Convolutional Autoencoder for Compressing 3D Time Projection Chamber Data
Yi Huang, Yihui Ren, Shinjae Yoo +1
High-energy large-scale particle colliders produce data at high speed in the order of 1 terabytes per second in nuclear physics and petabytes per second in high-energy physics. Dev…
DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
Shuaiwen Leon Song, Bonnie Kruft, Minjia Zhang +89
In the upcoming decade, deep learning may revolutionize the natural sciences, enhancing our capacity to model and predict natural occurrences. This could herald a new era of scient…