10 papers · 1 filter
TabQL: In-Context Q-Learning with Tabular Foundation Models
Qisai Liu, Zhanhong Jiang, Timilehin Ayanlade +4
We propose Tabular Q-Learning (TabQL), a reinforcement learning framework that replaces the conventional parametric Q-network in Deep Q-Learning (DQN) with a tabular foundation mod…
COOPO: Cyclic Offline-Online Policy Optimization Algorithm
Qisai Liu, Zhanhong Jiang, Joshua Russell Waite +3
Offline reinforcement learning struggles with distributional shift and constrained performance due to static dataset limitations, while online RL demands prohibitive environment in…
ADKO: Agentic Decentralized Knowledge Optimization
Lucas Nerone Rillo, Zhanhong Jiang, Nastaran Saadati +4
We present Agentic Decentralized Knowledge Optimization (ADKO), a framework for collaborative black-box optimization across autonomous agents that achieves sample efficiency, priva…
Balancing Utility and Privacy: Dynamically Private SGD with Random Projection
Zhanhong Jiang, Md Zahid Hasan, Nastaran Saadati +3
Stochastic optimization is a pivotal enabler in modern machine learning, producing effective models for various tasks. However, several existing works have shown that model paramet…
Towards Large Reasoning Models for Agriculture
Hossein Zaremehrjerdi, Shreyan Ganguly, Ashlyn Rairdin +17
Agricultural decision-making involves complex, context-specific reasoning, where choices about crops, practices, and interventions depend heavily on geographic, climatic, and econo…
DeCAF: Decentralized Consensus-And-Factorization for Low-Rank Adaptation of Foundation Models
Nastaran Saadati, Zhanhong Jiang, Joshua R. Waite +4
Low-Rank Adaptation (LoRA) has emerged as one of the most effective, computationally tractable fine-tuning approaches for training Vision-Language Models (VLMs) and Large Language…