397 citations · 1.7k across the 82 of their papers we have counts for
17 papers · 1 filter
TextGenSHAP: Scalable Post-hoc Explanations in Text Generation with Long Documents
James Enouen, Hootan Nakhost, Sayna Ebrahimi +3
Large language models (LLMs) have attracted huge interest in practical applications given their increasingly accurate responses and coherent reasoning abilities. Given their nature…
Adaptation with Self-Evaluation to Improve Selective Prediction in LLMs
Jiefeng Chen, Jinsung Yoon, Sayna Ebrahimi +3
Large language models (LLMs) have recently shown great advances in a variety of tasks, including natural language understanding and generation. However, their use in high-stakes de…
SQLPrompt: In-Context Text-to-SQL with Minimal Labeled Data
Ruoxi Sun, Sercan Ö. Arik, Rajarishi Sinha +4
Text-to-SQL aims to automate the process of generating SQL queries on a database from natural language text. In this work, we propose "SQLPrompt", tailored to improve the few-shot…
Effective Large Language Model Adaptation for Improved Grounding and Citation Generation
Xi Ye, Ruoxi Sun, Sercan Ö. Arik +1
Large language models (LLMs) have achieved remarkable advancements in natural language understanding and generation. However, one major issue towards their widespread deployment in…
COSTAR: Improved Temporal Counterfactual Estimation with Self-Supervised Learning
Chuizheng Meng, Yihe Dong, Sercan Ö. Arık +2
Estimation of temporal counterfactual outcomes from observed history is crucial for decision-making in many domains such as healthcare and e-commerce, particularly when randomized…
Search-Adaptor: Embedding Customization for Information Retrieval
Jinsung Yoon, Sercan O Arik, Yanfei Chen +1
Embeddings extracted by pre-trained Large Language Models (LLMs) have significant potential to improve information retrieval and search. Beyond the zero-shot setup in which they ar…
TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting
Defu Cao, Furong Jia, Sercan O Arik +4
The past decade has witnessed significant advances in time series modeling with deep learning. While achieving state-of-the-art results, the best-performing architectures vary high…
PAITS: Pretraining and Augmentation for Irregularly-Sampled Time Series
Nicasia Beebe-Wang, Sayna Ebrahimi, Jinsung Yoon +2
Real-world time series data that commonly reflect sequential human behavior are often uniquely irregularly sampled and sparse, with highly nonuniform sampling over time and entitie…
Business Metric-Aware Forecasting for Inventory Management
Helen Zhou, Sercan O. Arik, Jingtao Wang
Time-series forecasts play a critical role in business planning. However, forecasters typically optimize objectives that are agnostic to downstream business goals and thus can prod…
SQL-PaLM: Improved Large Language Model Adaptation for Text-to-SQL (extended)
Ruoxi Sun, Sercan Ö. Arik, Alex Muzio +8
Text-to-SQL, the process of translating natural language into Structured Query Language (SQL), represents a transformative application of large language models (LLMs), potentially…
Better Zero-Shot Reasoning with Self-Adaptive Prompting
Xingchen Wan, Ruoxi Sun, Hanjun Dai +2
Modern large language models (LLMs) have demonstrated impressive capabilities at sophisticated tasks, often through step-by-step reasoning similar to humans. This is made possible…
LANISTR: Multimodal Learning from Structured and Unstructured Data
Sayna Ebrahimi, Sercan O. Arik, Yihe Dong +1
Multimodal large-scale pretraining has shown impressive performance for unstructured data such as language and image. However, a prevalent real-world scenario involves structured d…
Universal Self-Adaptive Prompting
Xingchen Wan, Ruoxi Sun, Hootan Nakhost +4
A hallmark of modern large language models (LLMs) is their impressive general zero-shot and few-shot abilities, often elicited through in-context learning (ICL) via prompting. Howe…
SLM: End-to-end Feature Selection via Sparse Learnable Masks
Yihe Dong, Sercan O. Arik
Feature selection has been widely used to alleviate compute requirements during training, elucidate model interpretability, and improve model generalizability. We propose SLM -- Sp…
ASPEST: Bridging the Gap Between Active Learning and Selective Prediction
Jiefeng Chen, Jinsung Yoon, Sayna Ebrahimi +3
Selective prediction aims to learn a reliable model that abstains from making predictions when uncertain. These predictions can then be deferred to humans for further evaluation. A…
TSMixer: An All-MLP Architecture for Time Series Forecasting
Si-An Chen, Chun-Liang Li, Nate Yoder +2
Real-world time-series datasets are often multivariate with complex dynamics. To capture this complexity, high capacity architectures like recurrent- or attention-based sequential…
Neural Spline Search for Quantile Probabilistic Modeling
Ruoxi Sun, Chun-Liang Li, Sercan O. Arik +3
Accurate estimation of output quantiles is crucial in many use cases, where it is desired to model the range of possibility. Modeling target distribution at arbitrary quantile leve…