8 papers
AquiLLM: An Architecture for Supporting Tacit Knowledge Capture in Research Groups
Jack Stark, Srinath Saikrishnan, Vikram Seenivasan +3
Recent advances in retrieval-augmented generation (RAG) and large language models (LLMs) enable researchers to integrate AI into scientific workflows. However, using proprietary co…
Combining datasets with different ground truths using Low-Rank Adaptation to generalize image-based CNN models for photometric redshift prediction
Vikram Seenivasan, Srinath Saikrishnan, Andrew Lizarraga +3
In this work, we demonstrate how Low-Rank Adaptation (LoRA) can be used to combine different galaxy imaging datasets to improve redshift estimation with CNN models for cosmology. L…
Multi-Modal Masked Autoencoders for Learning Image-Spectrum Associations for Galaxy Evolution and Cosmology
Morgan Himes, Samiksha Krishnamurthy, Andrew Lizarraga +5
Upcoming surveys will produce billions of galaxy images but comparatively few spectra, motivating models that learn cross-modal representations. We build a dataset of 134,533 galax…
Latent Adaptive Planner for Dynamic Manipulation
Donghun Noh, Deqian Kong, Minglu Zhao +4
We present the Latent Adaptive Planner (LAP), a trajectory-level latent-variable policy for dynamic nonprehensile manipulation (e.g., box catching) that formulates planning as infe…
Latent Plan Transformer for Trajectory Abstraction: Planning as Latent Space Inference
Deqian Kong, Dehong Xu, Minglu Zhao +6
In tasks aiming for long-term returns, planning becomes essential. We study generative modeling for planning with datasets repurposed from offline reinforcement learning. Specifica…
Efficient Modular Learning through Naive LoRA Summation: Leveraging Orthogonality in High-Dimensional Models
Zhanhao Cao, Clement Truong, Andrew Lizarraga
Recent advances in large language models are driven by scale, while parameter-efficient fine-tuning (PEFT) enables updating only a small fraction of parameters. Low-Rank Adaptation…