2 papers
cs.LG2026
Accelerating PayPal's Commerce Agent with Speculative Decoding: An Empirical Study on EAGLE3 with Fine-Tuned Nemotron Models
Ally Qin, Jian Wan, Sarat Mudunuri +1
We evaluate speculative decoding with EAGLE3 as an inference-time optimization for PayPal's Commerce Agent, powered by a fine-tuned llama3.1-nemotron-nano-8B-v1 model. Building on…
cs.SE2026
Semantic Tool Discovery for Large Language Models: A Vector-Based Approach to MCP Tool Selection
Sarat Mudunuri, Jian Wan, Ally Qin +1
Large Language Models (LLMs) with tool-calling capabilities have demonstrated remarkable potential in executing complex tasks through external tool integration. The Model Context P…