1 citations · 1 across the 16 of their papers we have counts for
17 papers
Probing the 3D Object-Level Understanding of Pre-Trained Detection Transformers
Robin Kim, Colin Samplawski, Benjamin M. Marlin
Detection transformer models, including DETR and its extensions, learn to output a set of object-level embeddings that can be simultaneously decoded into 2D bounding boxes and clas…
Bayesian Adaptation Gym: A Benchmark for the Bayesian Low-Rank Adaptation of Multi-Modal Language Models
Colin Samplawski, Ramneet Kaur, Manoj Acharya +2
Large multi-modal language models are increasingly deployed in high-stakes domains, making well-calibrated uncertainty essential. Traditional Bayesian methods approximate posterior…
Formally Verified Code Synthesis for Structured Data Translation in a Medical Internet of Things
Colin Samplawski, Adam D. Cobb
In this work we present a LLM powered, evolutionary code synthesis system for structured data translation in a Medical Internet of Things settings. A key challenge in this domain i…
Breaking Bad: Interpretability-Based Safety Audits of State-of-the-Art LLMs
Krishiv Agarwal, Ramneet Kaur, Colin Samplawski +6
Effective safety auditing of large language models (LLMs) demands tools that go beyond black-box probing and systematically uncover vulnerabilities rooted in model internals. We pr…
From Actions to Understanding: Conformal Interpretability of Temporal Concepts in LLM Agents
Trilok Padhi, Ramneet Kaur, Krishiv Agarwal +9
Large Language Models (LLMs) are increasingly deployed as autonomous agents capable of reasoning, planning, and acting within interactive environments. Despite their growing capabi…
Do Diffusion Models Dream of Electric Planes? Discrete and Continuous Simulation-Based Inference for Aircraft Design
Aurelien Ghiglino, Daniel Elenius, Anirban Roy +7
In this paper, we generate conceptual engineering designs of electric vertical take-off and landing (eVTOL) aircraft. We follow the paradigm of simulation-based inference (SBI), wh…
Privacy Preserving In-Context-Learning Framework for Large Language Models
Bishnu Bhusal, Manoj Acharya, Ramneet Kaur +5
Large language models (LLMs) have significantly transformed natural language understanding and generation, but they raise privacy concerns due to potential exposure of sensitive in…
Scalable Bayesian Low-Rank Adaptation of Large Language Models via Stochastic Variational Subspace Inference
Colin Samplawski, Adam D. Cobb, Manoj Acharya +2
Despite their widespread use, large language models (LLMs) are known to hallucinate incorrect information and be poorly calibrated. This makes the uncertainty quantification of the…
Calibrating Uncertainty Quantification of Multi-Modal LLMs using Grounding
Trilok Padhi, Ramneet Kaur, Adam D. Cobb +7
We introduce a novel approach for calibrating uncertainty quantification (UQ) tailored for multi-modal large language models (LLMs). Existing state-of-the-art UQ methods rely on co…
AGENT: An Aerial Vehicle Generation and Design Tool Using Large Language Models
Colin Samplawski, Adam D. Cobb, Susmit Jha
Computer-aided design (CAD) is a promising application area for emerging artificial intelligence methods. Traditional workflows for cyberphysical systems create detailed digital mo…
Addressing Uncertainty in LLMs to Enhance Reliability in Generative AI
Ramneet Kaur, Colin Samplawski, Adam D. Cobb +8
In this paper, we present a dynamic semantic clustering approach inspired by the Chinese Restaurant Process, aimed at addressing uncertainty in the inference of Large Language Mode…
Temporally Multi-Scale Sparse Self-Attention for Physical Activity Data Imputation
Hui Wei, Maxwell A. Xu, Colin Samplawski +3
Wearable sensors enable health researchers to continuously collect data pertaining to the physiological state of individuals in real-world settings. However, such data can be subje…
FlexLoc: Conditional Neural Networks for Zero-Shot Sensor Perspective Invariance in Object Localization with Distributed Multimodal Sensors
Jason Wu, Ziqi Wang, Xiaomin Ouyang +5
Localization is a critical technology for various applications ranging from navigation and surveillance to assisted living. Localization systems typically fuse information from sen…
GDTM: An Indoor Geospatial Tracking Dataset with Distributed Multimodal Sensors
Ho Lyun Jeong, Ziqi Wang, Colin Samplawski +6
Constantly locating moving objects, i.e., geospatial tracking, is essential for autonomous building infrastructure. Accurate and robust geospatial tracking often leverages multimod…
Heteroskedastic Geospatial Tracking with Distributed Camera Networks
Colin Samplawski, Shiwei Fang, Ziqi Wang +3
Visual object tracking has seen significant progress in recent years. However, the vast majority of this work focuses on tracking objects within the image plane of a single camera…
Learning Graph-Based Priors for Generalized Zero-Shot Learning
Colin Samplawski, Jannik Wolff, Tassilo Klein +1
The task of zero-shot learning (ZSL) requires correctly predicting the label of samples from classes which were unseen at training time. This is achieved by leveraging side informa…
Integrating Propositional and Relational Label Side Information for Hierarchical Zero-Shot Image Classification
Colin Samplawski, Heesung Kwon, Erik Learned-Miller +1
Zero-shot learning (ZSL) is one of the most extreme forms of learning from scarce labeled data. It enables predicting that images belong to classes for which no labeled training in…