output
20032025
most citedNatural Language Processing (almost) from Scratch

5.2k citations

Showing 2021Show all

167 papers · 1 filter

cs.LG2021★ 1 cited

AutoDrop: Training Deep Learning Models with Automatic Learning Rate Drop

Yunfei Teng, Jing Wang, Anna Choromanska

Modern deep learning (DL) architectures are trained using variants of the SGD algorithm that is run with a defined learning rate schedule, i.e., the learning ra…

cs.LG2021

Quantile Filtered Imitation Learning

David Brandfonbrener, William F. Whitney, Rajesh Ranganath +1

We introduce quantile filtered imitation learning (QFIL), a novel policy improvement operator designed for offline reinforcement learning. QFIL performs policy improvement by runni…

math.PR2021

On the Gaussian surface area of spectrahedra

Srinivasan Arunachalam, Oded Regev, Penghui Yao

We show that for sufficiently large and for some universal constant , a random spectrahedron with matrices drawn from Gaussian orthogonal ensemble has…

hep-ph2021★ 10 cited

Constraints on GeV Dark Matter interaction with baryons, from a novel Dewar experiment

Xingchen Xu, Glennys R. Farrar

Dark matter which scatters off ordinary matter with a relatively large cross section cannot be constrained by deep underground WIMP experiments, due to the energy loss of DM along…

cs.CV2021

A Dataset-Dispersion Perspective on Reconstruction Versus Recognition in Single-View 3D Reconstruction Networks

Yefan Zhou, Yiru Shen, Yujun Yan +2

Neural networks (NN) for single-view 3D reconstruction (SVR) have gained in popularity. Recent work points out that for SVR, most cutting-edge NNs have limited performance on recon…

cs.LG2021

Optimizing High-Dimensional Physics Simulations via Composite Bayesian Optimization

Wesley Maddox, Qing Feng, Max Balandat

Physical simulation-based optimization is a common task in science and engineering. Many such simulations produce image- or tensor-based outputs where the desired objective is a fu…

cs.CV2021

Active Learning at the ImageNet Scale

Zeyad Ali Sami Emam, Hong-Min Chu, Ping-Yeh Chiang +4

Active learning (AL) algorithms aim to identify an optimal subset of data for annotation, such that deep neural networks (DNN) can achieve better performance when trained on this l…

stat.ML2021

PAC-Learning Uniform Ergodic Communicative Networks

Yihan He

This work addressed the problem of learning a network with communication between vertices. The communication between vertices is presented in the form of perturbation on the measur…

cs.CL2021

MEDCOD: A Medically-Accurate, Emotive, Diverse, and Controllable Dialog System

Rhys Compton, Ilya Valmianski, Li Deng +4

We present MEDCOD, a Medically-Accurate, Emotive, Diverse, and Controllable Dialog system with a unique approach to the natural language generator module. MEDCOD has been developed…

cs.IT2021

Six Critical Challenges for 6G Wireless Systems

Harsh Tataria, Mansoor Shafi, Mischa Dohler +1

A large number of papers are now appearing on sixth-generation (6G) wireless systems, covering different aspects, ranging from vision, architecture, applications, and technology br…

cs.LG2021★ 1 cited

A Simple and Fast Baseline for Tuning Large XGBoost Models

Sanyam Kapoor, Valerio Perrone

XGBoost, a scalable tree boosting algorithm, has proven effective for many prediction tasks of practical interest, especially using tabular datasets. Hyperparameter tuning can furt…

cs.CL2021★ 1 cited

A Word on Machine Ethics: A Response to Jiang et al. (2021)

Zeerak Talat, Hagen Blix, Josef Valvoda +3

Ethics is one of the longest standing intellectual endeavors of humanity. In recent years, the fields of AI and NLP have attempted to wrangle with how learning systems that interac…

eess.IV2021

Towards dynamic multi-modal phenotyping using chest radiographs and physiological data

Nasir Hayat, Krzysztof J. Geras, Farah E. Shamout

The healthcare domain is characterized by heterogeneous data modalities, such as imaging and physiological data. In practice, the variety of medical data assists clinicians in deci…

cs.LG2021★ 21 cited

AlphaD3M: Machine Learning Pipeline Synthesis

Iddo Drori, Yamuna Krishnamurthy, Remi Rampin +5

We introduce AlphaD3M, an automatic machine learning (AutoML) system based on meta reinforcement learning using sequence models with self play. AlphaD3M is based on edit operations…

stat.AP2021

Measurement That Matches Theory: Theory-Driven Identification in IRT Models

Marco Morucci, Margaret Foster, Kaitlyn Webster +2

Measurement bridges theory and empirics. Without measures that appropriately capture theoretical concepts, description will fail to represent reality and true causal inference will…

cs.LG2021

Fairness-aware Online Price Discrimination with Nonparametric Demand Models

Xi Chen, Jiameng Lyu, Xuan Zhang +1

Price discrimination, which refers to the strategy of setting different prices for different customer groups, has been widely used in online retailing. Although it helps boost the…

cs.LG2021

Inverse-Weighted Survival Games

Xintian Han, Mark Goldstein, Aahlad Puli +3

Deep models trained through maximum likelihood have achieved state-of-the-art results for survival analysis. Despite this training scheme, practitioners evaluate models under other…

cs.CR2021

CryptoNite: Revealing the Pitfalls of End-to-End Private Inference at Scale

Karthik Garimella, Nandan Kumar Jha, Zahra Ghodsi +2

The privacy concerns of providing deep learning inference as a service have underscored the need for private inference (PI) protocols that protect users' data and the service provi…

math.NA2021

Periodic Fast Multipole Method

Ruqi Pei, Travis Askham, Leslie Greengard +1

A new scheme is presented for imposing periodic boundary conditions on unit cells with arbitrary source distributions. We restrict our attention here to the Poisson, modified Helmh…

cs.LG2021★ 4 cited

Dynamic population-based meta-learning for multi-agent communication with natural language

Abhinav Gupta, Marc Lanctot, Angeliki Lazaridou

In this work, our goal is to train agents that can coordinate with seen, unseen as well as human partners in a multi-agent communication environment involving natural language. Pre…

cs.SI2021★ 1 cited

How to Quantify Polarization in Models of Opinion Dynamics

Christopher Musco, Indu Ramesh, Johan Ugander +1

It is widely believed that society is becoming increasingly polarized around important issues, a dynamic that does not align with common mathematical models of opinion formation in…

cs.IT2021

Channel Eigenvalues and Effective Degrees of Freedom of Reconfigurable Intelligent Surfaces

Shu Sun

As a promising candidate technology for the next-generation wireless communications, reconfigurable intelligent surface (RIS) has gained tremendous research interest in both the ac…

astro-ph.EP2021

The effect of late giant collisions on the atmospheres of protoplanets and the formation of cold sub-Saturns

Mohamad Ali-Dib, Andrew Cumming, Douglas N. C. Lin

We investigate the origins of cold sub-Saturns (CSS), an exoplanetary population inferred from microlensing surveys. If confirmed, these planets would rebut a theorised gap in plan…

eess.SP2021★ 9 cited

Fetal Gender Identification using Machine and Deep Learning Algorithms on Phonocardiogram Signals

Reza Khanmohammadi, Mitra Sadat Mirshafiee, Mohammad Mahdi Ghassemi +1

Phonocardiogram (PCG) signal analysis is a critical, widely-studied technology to noninvasively analyze the heart's mechanical activity. Through evaluating heart sounds, this techn…