Decoupled Weight Decay Regularization

Abstract

L${}_2$ regularization and weight decay regularization are equivalent for standard stochastic gradient descent (when rescaled by the learning rate), but as we demonstrate this is \emph{not} the case for adaptive gradient algorithms, such as Adam. While common implementations of these algorithms employ L${}_2$ regularization (often calling it "weight decay" in what may be misleading due to the inequivalence we expose), we propose a simple modification to recover the original formulation of weight decay regularization by \emph{decoupling} the weight decay from the optimization steps taken w.r.t. the loss function. We provide empirical evidence that our proposed modification (i) decouples the optimal choice of weight decay factor from the setting of the learning rate for both standard SGD and Adam and (ii) substantially improves Adam's generalization performance, allowing it to compete with SGD with momentum on image classification datasets (on which it was previously typically outperformed by the latter). Our proposed decoupled weight decay has already been adopted by many researchers, and the community has implemented it in TensorFlow and PyTorch; the complete source code for our experiments is available at https://github.com/loshchil/AdamW-and-SGDW

Published as a conference paper at ICLR 2019

Cited by in corpus (1263)

• HuggingFace's Transformers: State-of-the-art Natural Language Processing
• LoRA: Low-Rank Adaptation of Large Language Models
• Attention Mechanisms in Computer Vision: A Survey
• PVT v2: Improved Baselines with Pyramid Vision Transformer
• FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence
• E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials
• WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
• Transformer in Transformer
• Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
• Align before Fuse: Vision and Language Representation Learning with Momentum Distillation
• Atomistic Line Graph Neural Network for Improved Materials Property Predictions
• HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis
• AdaBins: Depth Estimation using Adaptive Bins
• Twins: Revisiting the Design of Spatial Attention in Vision Transformers
• Reproducible scaling laws for contrastive language-image learning
• MixMatch: A Holistic Approach to Semi-Supervised Learning
• ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision
• MedViT: A Robust Vision Transformer for Generalized Medical Image Classification
• Hyperspectral Image Classification-Traditional to Deep Models: A Survey for Future Prospects
• Conditional Positional Encodings for Vision Transformers
• Lookahead Optimizer: k steps forward, 1 step back
• TransTrack: Multiple Object Tracking with Transformer
• Early Convolutions Help Transformers See Better
• Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networks
• SimVLM: Simple Visual Language Model Pretraining with Weak Supervision
• TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech
• Compute Trends Across Three Eras of Machine Learning
• Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecasting
• MetaFormer Baselines for Vision
• Prefix-Tuning: Optimizing Continuous Prompts for Generation
• Automated Pavement Crack Segmentation Using U-Net-based Convolutional Neural Network
• VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts
• WILDS: A Benchmark of in-the-Wild Distribution Shifts
• End-to-end Temporal Action Detection with Transformer
• Variational Diffusion Models
• Measuring Mathematical Problem Solving With the MATH Dataset
• Action Transformer: A Self-Attention Model for Short-Time Pose-Based Human Action Recognition
• MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformer
• A Benchmark Study of Machine Learning Models for Online Fake News Detection
• RoFormer: Enhanced Transformer with Rotary Position Embedding
• Time-to-Event Prediction with Neural Networks and Cox Regression
• Multi-Modal Self-Supervised Learning for Recommendation
• Efficient Training of Audio Transformers with Patchout
• UNETR: Transformers for 3D Medical Image Segmentation
• Real-Time Apple Detection System Using Embedded Systems With Hardware Accelerators: An Edge AI Application
• On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
• TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformers
• Masked Autoencoders Are Scalable Vision Learners
• K-Net: Towards Unified Image Segmentation
• H-vmunet: High-order Vision Mamba UNet for Medical Image Segmentation
• Unifying Vision-and-Language Tasks via Text Generation
• Self-supervised representation learning from 12-lead ECG data
• On Empirical Comparisons of Optimizers for Deep Learning
• UNITER: UNiversal Image-TExt Representation Learning
• FCN-Transformer Feature Fusion for Polyp Segmentation
• A Simple Baseline for Bayesian Uncertainty in Deep Learning
• UltraLight VM-UNet: Parallel Vision Mamba Significantly Reduces Parameters for Skin Lesion Segmentation
• Contrastive Masked Autoencoders are Stronger Vision Learners
• Per-Pixel Classification is Not All You Need for Semantic Segmentation
• Change Guiding Network: Incorporating Change Prior to Guide Change Detection in Remote Sensing Imagery
• Large Batch Optimization for Deep Learning: Training BERT in 76 minutes
• A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark
• Learning for Vehicle-to-Vehicle Cooperative Perception under Lossy Communication
• ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Bias
• A Label Attention Model for ICD Coding from Clinical Text
• MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer
• No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligence
• A Gated Cross-domain Collaborative Network for Underwater Object Detection
• ResT: An Efficient Transformer for Visual Recognition
• The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes
• All Tokens Matter: Token Labeling for Training Better Vision Transformers
• Measuring Coding Challenge Competence With APPS
• RAFT: Recurrent All-Pairs Field Transforms for Optical Flow
• Toward Transformer-Based Object Detection
• Collaborative Discrepancy Optimization for Reliable Image Anomaly Localization
• Masked-attention Mask Transformer for Universal Image Segmentation
• CenterCLIP: Token Clustering for Efficient Text-Video Retrieval
• Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labels
• Pix2seq: A Language Modeling Framework for Object Detection
• Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modeling
• HRFormer: High-Resolution Transformer for Dense Prediction
• MP-SENet: A Speech Enhancement Model with Parallel Denoising of Magnitude and Phase Spectra
• CMGAN: Conformer-based Metric GAN for Speech Enhancement
• SwinFace: A Multi-task Transformer for Face Recognition, Expression Recognition, Age Estimation and Attribute Estimation
• Practical Deep Learning with Bayesian Principles
• An Efficient Lorentz Equivariant Graph Neural Network for Jet Tagging
• AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients
• Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech
• RaSa: Relation and Sensitivity Aware Representation Learning for Text-based Person Search
• Revisiting Deep Learning Models for Tabular Data
• 3DSAM-adapter: Holistic adaptation of SAM from 2D to 3D for promptable tumor segmentation
• Self-Supervised Learning with Swin Transformers
• Uformer: A General U-Shaped Transformer for Image Restoration
• CMTR: Cross-modality Transformer for Visible-infrared Person Re-identification
• One Model to Synthesize Them All: Multi-contrast Multi-scale Transformer for Missing Data Imputation
• ChartGPT: Leveraging LLMs to Generate Charts from Abstract Natural Language
• Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!
• Sparse R-CNN: End-to-End Object Detection with Learnable Proposals
• CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows
• CycleMLP: A MLP-like Architecture for Dense Prediction
• TrAISformer -- A Transformer Network with Sparse Augmented Data Representation and Cross Entropy Loss for AIS-based Vessel Trajectory Prediction
• Physically Motivated Recursively Embedded Atom Neural Networks: Incorporating Local Completeness and Nonlocality
• Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Concepts
• Dynamic Prefix-Tuning for Generative Template-based Event Extraction
• Attention-Based Transformers for Instance Segmentation of Cells in Microstructures
• Cough Against COVID: Evidence of COVID-19 Signature in Cough Sounds
• DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations
• AFDet: Anchor Free One Stage 3D Object Detection
• TransCAM: Transformer Attention-based CAM Refinement for Weakly Supervised Semantic Segmentation
• RegionViT: Regional-to-Local Attention for Vision Transformers
• Vector-quantized Image Modeling with Improved VQGAN
• Contrast to Divide: Self-Supervised Pre-Training for Learning with Noisy Labels
• VIOLET : End-to-End Video-Language Transformers with Masked Visual-token Modeling
• Zoom Out and Observe: News Environment Perception for Fake News Detection
• Massively Parallel Universal Linear Transformations using a Wavelength-Multiplexed Diffractive Optical Network
• Tracker Meets Night: A Transformer Enhancer for UAV Tracking
• An End-to-End Earthquake Detection Method for Joint Phase Picking and Association using Deep Learning
• MEMO: Test Time Robustness via Adaptation and Augmentation
• Best Practices for Scientific Research on Neural Architecture Search
• Vision Transformers, a new approach for high-resolution and large-scale mapping of canopy heights
• Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks
• AS-MLP: An Axial Shifted MLP Architecture for Vision
• Taming the Power of Diffusion Models for High-Quality Virtual Try-On with Appearance Flow
• Does the Magic of BERT Apply to Medical Code Assignment? A Quantitative Study
• Stochastic Gradient Methods with Layer-wise Adaptive Moments for Training of Deep Networks
• ViscNet: Neural network for predicting the fragility index and the temperature-dependency of viscosity
• AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights
• HTR-VT: Handwritten Text Recognition with Vision Transformer
• How to train your MAML
• Negativity Spreads Faster: A Large-Scale Multilingual Twitter Analysis on the Role of Sentiment in Political Communication
• Video Object Segmentation with Adaptive Feature Bank and Uncertain-Region Refinement
• Hopfield Networks is All You Need
• Lip-reading with Densely Connected Temporal Convolutional Networks
• Prompt Learning for News Recommendation
• Benchmarking Detection Transfer Learning with Vision Transformers
• KLUE: Korean Language Understanding Evaluation
• Zero-shot Text Classification With Generative Language Models
• FireFly: A High-Throughput Hardware Accelerator for Spiking Neural Networks with Efficient DSP and Memory Optimization
• LDMVFI: Video Frame Interpolation with Latent Diffusion Models
• End-to-end Wind Turbine Wake Modelling with Deep Graph Representation Learning
• Referring Transformer: A One-step Approach to Multi-task Visual Grounding
• GATE: Graph CCA for Temporal SElf-supervised Learning for Label-efficient fMRI Analysis
• Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora
• CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion Recognition
• GPT-GNN: Generative Pre-Training of Graph Neural Networks
• Glass Segmentation with RGB-Thermal Image Pairs
• Modular machine learning-based elastoplasticity: generalization in the context of limited data
• The CAMELS Multifield Dataset: Learning the Universe's Fundamental Parameters with Artificial Intelligence
• Equivariant Flows: Exact Likelihood Generative Learning for Symmetric Densities
• Layer-adaptive sparsity for the Magnitude-based Pruning
• A newcomer's guide to deep learning for inverse design in nano-photonics
• Center-based 3D Object Detection and Tracking
• Latent Weights Do Not Exist: Rethinking Binarized Neural Network Optimization
• AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts
• End-to-end Autonomous Driving with Semantic Depth Cloud Mapping and Multi-agent
• Image Captioning for Effective Use of Language Models in Knowledge-Based Visual Question Answering
• End-to-End Video Instance Segmentation with Transformers
• g2tmn at Constraint@AAAI2021: Exploiting CT-BERT and Ensembling Learning for COVID-19 Fake News Detection
• Entropy-based Logic Explanations of Neural Networks
• CCTrans: Simplifying and Improving Crowd Counting with Transformer
• TreeLearn: A deep learning method for segmenting individual trees from ground-based LiDAR forest point clouds
• Rethinking the Hyperparameters for Fine-tuning
• Asymmetric Loss For Multi-Label Classification
• Combining 3D Image and Tabular Data via the Dynamic Affine Feature Map Transform
• CNN-LSTM and Transfer Learning Models for Malware Classification based on Opcodes and API Calls
• Transformers in Self-Supervised Monocular Depth Estimation with Unknown Camera Intrinsics
• TabularNet: A Neural Network Architecture for Understanding Semantic Structures of Tabular Data
• Do We Need Zero Training Loss After Achieving Zero Training Error?
• CMT: Convolutional Neural Networks Meet Vision Transformers
• Self-Supervised Monocular Depth Estimation with Self-Reference Distillation and Disparity Offset Refinement
• LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding
• Training Strategies for Improved Lip-reading
• Video Instance Segmentation using Inter-Frame Communication Transformers
• RDP-Net: Region Detail Preserving Network for Change Detection
• T-former: An Efficient Transformer for Image Inpainting
• On Transferability of Prompt Tuning for Natural Language Processing
• InterBERT: Vision-and-Language Interaction for Multi-modal Pretraining
• Efficient Modelling of Trivializing Maps for Lattice ${\varphi }^4$ Theory Using Normalizing Flows: A First Look at Scalability
• ISTR: End-to-End Instance Segmentation with Transformers
• How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers
• ktrain: A Low-Code Library for Augmented Machine Learning
• LiDAR-aid Inertial Poser: Large-scale Human Motion Capture by Sparse Inertial and LiDAR Sensors
• RobustART: Benchmarking Robustness on Architecture Design and Training Techniques
• CTRAN: CNN-Transformer-based Network for Natural Language Understanding
• Unraveling Complex Data Diversity in Underwater Acoustic Target Recognition through Convolution-based Mixture of Experts
• EmoNeXt: an Adapted ConvNeXt for Facial Emotion Recognition
• HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training
• Multispectral Vineyard Segmentation: A Deep Learning approach
• Sparse Compressed Spiking Neural Network Accelerator for Object Detection
• Object DGCNN: 3D Object Detection using Dynamic Graphs
• Towards duration robust weakly supervised sound event detection
• Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling
• Three Mechanisms of Weight Decay Regularization
• SparsePoser: Real-time Full-body Motion Reconstruction from Sparse Data
• A neural operator-based surrogate solver for free-form electromagnetic inverse design
• Fully Sparse Fusion for 3D Object Detection
• Luna: Linear Unified Nested Attention
• Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling
• HANNA: Hard-constraint Neural Network for Consistent Activity Coefficient Prediction
• Primordial non-Gaussianity from the Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey I: Catalogue Preparation and Systematic Mitigation
• SwinTrack: A Simple and Strong Baseline for Transformer Tracking
• EmoBERTa: Speaker-Aware Emotion Recognition in Conversation with RoBERTa
• Self-Supervised RF Signal Representation Learning for NextG Signal Classification with Deep Learning
• On the Effects of Different Types of Label Noise in Multi-Label Remote Sensing Image Classification
• SparseSwin: Swin Transformer with Sparse Transformer Block
• Differentially Private Fine-tuning of Language Models
• Coordinated Sum-Rate Maximization in Multicell MU-MIMO with Deep Unrolling
• CenterNet3D: An Anchor Free Object Detector for Point Cloud
• Force-Field-Enhanced Neural Network Interactions: from Local Equivariant Embedding to Atom-in-Molecule properties and long-range effects
• ViDT: An Efficient and Effective Fully Transformer-based Object Detector
• Using convolutional neural networks to predict galaxy metallicity from three-color images
• Multiway Non-rigid Point Cloud Registration via Learned Functional Map Synchronization
• Reweighted Proximal Pruning for Large-Scale Language Representation
• A 23 $\mu$W Keyword Spotting IC with Ring-Oscillator-Based Time-Domain Feature Extraction
• Towards an astronomical foundation model for stars with a Transformer-based model
• Is Heterophily A Real Nightmare For Graph Neural Networks To Do Node Classification?
• A Survey of Optimization Methods from a Machine Learning Perspective
• Jasper: An End-to-End Convolutional Neural Acoustic Model
• Permutationless Many-Jet Event Reconstruction with Symmetry Preserving Attention Networks
• Toward Accurate Interpretable Predictions of Materials Properties within Transformer Language Models
• Vision Transformers with Patch Diversification
• An Attention Free Transformer
• Mask and Reason: Pre-Training Knowledge Graph Transformers for Complex Logical Queries
• A Heterogeneous Graph-Based Multi-Task Learning for Fault Event Diagnosis in Smart Grid
• ObjFormer: Learning Land-Cover Changes From Paired OSM Data and Optical High-Resolution Imagery via Object-Guided Transformer
• Radial Basis Function Networks for Convolutional Neural Networks to Learn Similarity Distance Metric and Improve Interpretability
• Video Moment Retrieval from Text Queries via Single Frame Annotation
• Machine learning for molecular dynamics with strongly correlated electrons
• Underwater Acoustic Target Recognition based on Smoothness-inducing Regularization and Spectrogram-based Data Augmentation
• A Recurrent Vision-and-Language BERT for Navigation
• Vector Quantized Diffusion Model for Text-to-Image Synthesis
• P2C: Self-Supervised Point Cloud Completion from Single Partial Clouds
• Distilling Knowledge from Reader to Retriever for Question Answering
• QueryProp: Object Query Propagation for High-Performance Video Object Detection
• Graph-based Modeling of Online Communities for Fake News Detection
• Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation
• DenseCLIP: Language-Guided Dense Prediction with Context-Aware Prompting
• VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation
• Fluid Simulation on Neural Flow Maps
• An Overview of Indian Spoken Language Recognition from Machine Learning Perspective
• A Dataset for Answering Time-Sensitive Questions
• Parameter Efficient Multimodal Transformers for Video Representation Learning
• Faster On-Device Training Using New Federated Momentum Algorithm
• Molecule Identification with Rotational Spectroscopy and Probabilistic Deep Learning
• SineKAN: Kolmogorov-Arnold Networks Using Sinusoidal Activation Functions
• Structured Prediction as Translation between Augmented Natural Languages
• The Lottery Ticket Hypothesis for Pre-trained BERT Networks
• Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biology
• 12-in-1: Multi-Task Vision and Language Representation Learning
• Automated HER2 Scoring in Breast Cancer Images Using Deep Learning and Pyramid Sampling
• BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modeling
• Greedy-layer Pruning: Speeding up Transformer Models for Natural Language Processing
• MatSynth: A Modern PBR Materials Dataset
• A cascade network for Detecting COVID-19 using chest x-rays
• SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers
• Mining the Benefits of Two-stage and One-stage HOI Detection
• Gibbs-Helmholtz Graph Neural Network: capturing the temperature dependency of activity coefficients at infinite dilution
• Finding universal relations in subhalo properties with artificial intelligence
• Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers
• Exploiting Cultural Biases via Homoglyphs in Text-to-Image Synthesis
• MINN: Learning the dynamics of differential-algebraic equations and application to battery modeling
• Enhancing Network Initialization for Medical AI Models Using Large-Scale, Unlabeled Natural Images
• PSLT: A Light-weight Vision Transformer with Ladder Self-Attention and Progressive Shift
• Detecting Replay Attacks Using Multi-Channel Audio: A Neural Network-Based Method
• InversionNet3D: Efficient and Scalable Learning for 3D Full Waveform Inversion
• Concurrent ischemic lesion age estimation and segmentation of CT brain using a Transformer-based network
• UP-DETR: Unsupervised Pre-training for Object Detection with Transformers
• Local primordial non-Gaussianity from the large-scale clustering of photometric DESI luminous red galaxies
• Fully Transformer Networks for Semantic Image Segmentation
• PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers
• Alternating Recurrent Dialog Model with Large-scale Pre-trained Language Models
• MatFuse: Controllable Material Generation with Diffusion Models
• Asking and Answering Questions to Evaluate the Factual Consistency of Summaries
• PointNetKL: Deep Inference for GICP Covariance Estimation in Bathymetric SLAM
• BinaryDuo: Reducing Gradient Mismatch in Binary Activation Network by Coupling Binary Activations
• MetaFormer Is Actually What You Need for Vision
• HateCheck: Functional Tests for Hate Speech Detection Models
• IQAGPT: Image Quality Assessment with Vision-language and ChatGPT Models
• Symplectic Learning for Hamiltonian Neural Networks
• TAda! Temporally-Adaptive Convolutions for Video Understanding
• Investigating the Limitations of Transformers with Simple Arithmetic Tasks
• Few-Shot Segmentation via Cycle-Consistent Transformer
• ChipNet: Budget-Aware Pruning with Heaviside Continuous Approximations
• Heterogeneous Graph Transformer
• DeepSVG: A Hierarchical Generative Network for Vector Graphics Animation
• Spatiotemporal Transformer for Video-based Person Re-identification
• Automatic Personalized Impression Generation for PET Reports Using Large Language Models
• CLAMP: Prompt-based Contrastive Learning for Connecting Language and Animal Pose
• How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness?
• ænet-PyTorch: a GPU-supported implementation for machine learning atomic potentials training
• ElasticTrainer: Speeding Up On-Device Training with Runtime Elastic Tensor Selection
• CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP
• Synthesizing Speech from Intracranial Depth Electrodes using an Encoder-Decoder Framework
• MST: Masked Self-Supervised Transformer for Visual Representation
• S${}^2$-MLP: Spatial-Shift MLP Architecture for Vision
• Impedance-optical Dual-modal Cell Culture Imaging with Learning-based Information Fusion
• Towards constraining warm dark matter with stellar streams through neural simulation-based inference
• A Memory Efficient Baseline for Open Domain Question Answering
• DIAS: A Dataset and Benchmark for Intracranial Artery Segmentation in DSA sequences
• Hierarchical Vision Transformers for Cardiac Ejection Fraction Estimation
• MiniVLM: A Smaller and Faster Vision-Language Model
• Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models
• Conditional Motion In-betweening
• Prot2Text: Multimodal Protein's Function Generation with GNNs and Transformers
• Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization Gap
• DiffDance: Cascaded Human Motion Diffusion Model for Dance Generation
• Exploring Prompt-based Few-shot Learning for Grounded Dialog Generation
• StepNet: Spatial-temporal Part-aware Network for Isolated Sign Language Recognition
• Pixel super-resolved virtual staining of label-free tissue using diffusion models
• A Closer Look at the Robustness of Vision-and-Language Pre-trained Models
• Convolution, aggregation and attention based deep neural networks for accelerating simulations in mechanics
• Deep Indexed Active Learning for Matching Heterogeneous Entity Representations
• N-best T5: Robust ASR Error Correction using Multiple Input Hypotheses and Constrained Decoding Space
• Improving Word Translation via Two-Stage Contrastive Learning
• Complex-valued universal linear transformations and image encryption using spatially incoherent diffractive networks
• Hybrid Learning of Time-Series Inverse Dynamics Models for Locally Isotropic Robot Motion
• Enhancing MRI-Based Classification of Alzheimer's Disease with Explainable 3D Hybrid Compact Convolutional Transformers
• DeepQMC: an open-source software suite for variational optimization of deep-learning molecular wave functions
• Transformer-Unet: Raw Image Processing with Unet
• Enhancing Heterogeneous Knowledge Graph Completion with a Novel GAT-based Approach
• Denoise Pretraining on Nonequilibrium Molecules for Accurate and Transferable Neural Potentials
• Tracking perovskite crystallization via deep learning-based feature detection on 2D X-ray scattering data
• CgT-GAN: CLIP-guided Text GAN for Image Captioning
• Delving Globally into Texture and Structure for Image Inpainting
• Training Deep Spiking Neural Networks
• Fake or Genuine? Contextualised Text Representation for Fake Review Detection
• New Benchmarks for Learning on Non-Homophilous Graphs
• ATST: Audio Representation Learning with Teacher-Student Transformer
• SynthEnsemble: A Fusion of CNN, Vision Transformer, and Hybrid Models for Multi-Label Chest X-Ray Classification
• IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages
• Accurate Deep Learning-aided Density-free Strategy for Many-Body Dispersion-corrected Density Functional Theory
• An Energy-Efficient Spiking Neural Network for Finger Velocity Decoding for Implantable Brain-Machine Interface
• ProGraML: Graph-based Deep Learning for Program Optimization and Analysis
• X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers
• AdaX: Adaptive Gradient Descent with Exponential Long Term Memory
• Well-calibrated Model Uncertainty with Temperature Scaling for Dropout Variational Inference
• Pollux: Co-adaptive Cluster Scheduling for Goodput-Optimized Deep Learning
• SpellGCN: Incorporating Phonological and Visual Similarities into Language Models for Chinese Spelling Check
• Efficient Neural Query Auto Completion
• A community-powered search of machine learning strategy space to find NMR property prediction models
• Sensitive Data Detection and Classification in Spanish Clinical Text: Experiments with BERT
• Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loop
• Token-Level Supervised Contrastive Learning for Punctuation Restoration
• Meta-DETR: Image-Level Few-Shot Object Detection with Inter-Class Correlation Exploitation
• LTC-SUM: Lightweight Client-driven Personalized Video Summarization Framework Using 2D CNN
• NOPE-SAC: Neural One-Plane RANSAC for Sparse-View Planar 3D Reconstruction
• UniCATS: A Unified Context-Aware Text-to-Speech Framework with Contextual VQ-Diffusion and Vocoding
• Towards Robust Learning-Based Pose Estimation of Noncooperative Spacecraft
• VOLO: Vision Outlooker for Visual Recognition
• A large-scale climate-aware satellite image dataset for domain adaptive land-cover semantic segmentation
• Physics-Guided Neural Networks for Intraventricular Vector Flow Mapping
• Perfect is the enemy of test oracle
• QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queries
• A Comprehensive Review of State-of-The-Art Methods for Java Code Generation from Natural Language Text
• Giving Commands to a Self-Driving Car: How to Deal with Uncertain Situations?
• An Empirical Study of Training End-to-End Vision-and-Language Transformers
• Constrained Neural Ordinary Differential Equations with Stability Guarantees
• Self-Supervised and Invariant Representations for Wireless Localization
• Object as Hotspots: An Anchor-Free 3D Object Detection Approach via Firing of Hotspots
• Navigating by Touch: Haptic Monte Carlo Localization via Geometric Sensing and Terrain Classification
• Human-Adversarial Visual Question Answering
• On the adequacy of untuned warmup for adaptive optimization
• Meta-Learning Deep Energy-Based Memory Models
• Anti-Spoofing Using Transfer Learning with Variational Information Bottleneck
• CLIP-ReIdent: Contrastive Training for Player Re-Identification
• CODEBench: A Neural Architecture and Hardware Accelerator Co-Design Framework
• Deep Learning for Segmentation of Cracks in High-Resolution Images of Steel Bridges
• The NTT DCASE2020 Challenge Task 6 system: Automated Audio Captioning with Keywords and Sentence Length Estimation
• MVT: Multi-view Vision Transformer for 3D Object Recognition
• Enquire One's Parent and Child Before Decision: Fully Exploit Hierarchical Structure for Self-Supervised Taxonomy Expansion
• Characterizing signal propagation to close the performance gap in unnormalized ResNets
• AngularGrad: A New Optimization Technique for Angular Convergence of Convolutional Neural Networks
• Towards Efficient Post-training Quantization of Pre-trained Language Models
• Magnetohydrodynamics with Physics Informed Neural Operators
• Time Matters in Regularizing Deep Networks: Weight Decay and Data Augmentation Affect Early Learning Dynamics, Matter Little Near Convergence
• The Loss Surfaces of Neural Networks with General Activation Functions
• An Explanation of In-context Learning as Implicit Bayesian Inference
• HOTR: End-to-End Human-Object Interaction Detection with Transformers
• KG-BART: Knowledge Graph-Augmented BART for Generative Commonsense Reasoning
• Distribution-aware Margin Calibration for Semantic Segmentation in Images
• Discriminative Nearest Neighbor Few-Shot Intent Detection by Transferring Natural Language Inference
• S3: A Spectral-Spatial Structure Loss for Pan-Sharpening Networks
• Amplifying Pathological Detection in EEG Signaling Pathways through Cross-Dataset Transfer Learning
• Associating Objects with Transformers for Video Object Segmentation
• Enhancing Few-shot Image Classification with Cosine Transformer
• Normalized Direction-preserving Adam
• Differentiable Model Compression via Pseudo Quantization Noise
• Multimap targeted free energy estimation
• Hardware-Robust In-RRAM-Computing for Object Detection
• SFace: An Efficient Network for Face Detection in Large Scale Variations
• Taming Visually Guided Sound Generation
• Improving Pre-trained Language Model Fine-tuning with Noise Stability Regularization
• DNN-MG: A Hybrid Neural Network/Finite Element Method with Applications to 3D Simulations of the Navier-Stokes Equations
• 1st Place Solution for Waymo Open Dataset Challenge -- 3D Detection and Domain Adaptation
• Landslide Detection in Real-Time Social Media Image Streams
• SGTBN: Generating Dense Depth Maps from Single-Line LiDAR
• Simplifying Hamiltonian and Lagrangian Neural Networks via Explicit Constraints
• Global Filter Networks for Image Classification
• An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks
• Multifield Cosmology with Artificial Intelligence
• SafeGen: Mitigating Sexually Explicit Content Generation in Text-to-Image Models
• Connecting optical morphology, environment, and HI mass fraction for low-redshift galaxies using deep learning
• Kernelized information bottleneck leads to biologically plausible 3-factor Hebbian learning in deep networks
• Knowledge Amalgamation for Object Detection with Transformers
• LOANet: A Lightweight Network Using Object Attention for Extracting Buildings and Roads from UAV Aerial Remote Sensing Images
• RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching
• Node-weighted Graph Convolutional Network for Depression Detection in Transcribed Clinical Interviews
• Cross-Domain Aspect Extraction using Transformers Augmented with Knowledge Graphs
• HODOR: High-level Object Descriptors for Object Re-segmentation in Video Learned from Static Images
• Face Morphing Attack Detection with Denoising Diffusion Probabilistic Models
• Hypersolvers: Toward Fast Continuous-Depth Models
• EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets
• Investigating Shift-Variance of Convolutional Neural Networks in Ultrasound Image Segmentation
• BodyFormer: Semantics-guided 3D Body Gesture Synthesis with Transformer
• ReCycle: Resilient Training of Large DNNs using Pipeline Adaptation
• MUCM-Net: A Mamba Powered UCM-Net for Skin Lesion Segmentation
• Attention-aware non-rigid image registration for accelerated MR imaging
• Transfer Learning with Foundational Models for Time Series Forecasting using Low-Rank Adaptations
• M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining
• Learning from Context or Names? An Empirical Study on Neural Relation Extraction
• From system models to class models: An in-context learning paradigm
• QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Information
• Adversarial multi-task underwater acoustic target recognition: towards robustness against various influential factors
• Regularization Matters in Policy Optimization
• On the Optimal Weighted ${\ell }_2$ Regularization in Overparameterized Linear Regression
• Multi-queue Momentum Contrast for Microvideo-Product Retrieval
• MORE: A Multimodal Object-Entity Relation Extraction Dataset with a Benchmark Evaluation
• UnifiedGesture: A Unified Gesture Synthesis Model for Multiple Skeletons
• Robust Lottery Tickets for Pre-trained Language Models
• Automated Concatenation of Embeddings for Structured Prediction
• Estimating Redundancy in Clinical Text
• Language Modelling with Pixels
• Attention Aided CSI Wireless Localization
• Deep neural networks for choice analysis: Enhancing behavioral regularity with gradient regularization
• Cooperative data-driven modeling
• Astroconformer: The Prospects of Analyzing Stellar Light Curves with Transformer-Based Deep Learning Models
• A Cascade Transformer-based Model for 3D Dose Distribution Prediction in Head and Neck Cancer Radiotherapy
• Towards Human-like Perception: Learning Structural Causal Model in Heterogeneous Graph
• Keep the Gradients Flowing: Using Gradient Flow to Study Sparse Network Optimization
• Evaluating histopathology transfer learning with ChampKit
• Accelerating Plasmonic Hydrogen Sensors for Inert Gas Environments by Transformer-Based Deep Learning
• CondLaneNet: a Top-to-down Lane Detection Framework Based on Conditional Convolution
• A case for new neural network smoothness constraints
• Unfolding AIS transmission behavior for vessel movement modeling on noisy data leveraging machine learning
• Variational principle to regularize machine-learned density functionals: the non-interacting kinetic-energy functional
• Diverse Image Inpainting with Bidirectional and Autoregressive Transformers
• IntFormer: Predicting pedestrian intention with the aid of the Transformer architecture
• Ultra Fast Speech Separation Model with Teacher Student Learning
• Multimodal machine learning with large language embedding model for polymer property prediction
• OnDev-LCT: On-Device Lightweight Convolutional Transformers towards federated learning
• Distill-SODA: Distilling Self-Supervised Vision Transformer for Source-Free Open-Set Domain Adaptation in Computational Pathology
• Vehicle Occurrence-based Parking Space Detection
• UniNeXt: Exploring A Unified Architecture for Vision Recognition
• RAGO: Recurrent Graph Optimizer For Multiple Rotation Averaging
• Eliminating polarization leakage effect for neutral hydrogen intensity mapping with deep learning
• Inverse molecular design and parameter optimization with Hückel theory using automatic differentiation
• Multi-View Reasoning: Consistent Contrastive Learning for Math Word Problem
• Jack and Masters of all Trades: One-Pass Learning Sets of Model Sets From Large Pre-Trained Models
• USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translation
• AdaViT: Adaptive Vision Transformers for Efficient Image Recognition
• Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs
• DocScanner: Robust Document Image Rectification with Progressive Learning
• Regularization Matters: A Nonparametric Perspective on Overparametrized Neural Network
• NFAD: Fixing anomaly detection using normalizing flows
• Convolutional L2LFlows: Generating Accurate Showers in Highly Granular Calorimeters Using Convolutional Normalizing Flows
• Are we Forgetting about Compositional Optimisers in Bayesian Optimisation?
• Optimizer Benchmarking Needs to Account for Hyperparameter Tuning
• EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurement
• A Transformer-based Neural Language Model that Synthesizes Brain Activation Maps from Free-Form Text Queries
• LaProp: Separating Momentum and Adaptivity in Adam
• FLERT: Document-Level Features for Named Entity Recognition
• Multi-Scale and Multi-Layer Contrastive Learning for Domain Generalization
• Learning To Retrieve: How to Train a Dense Retrieval Model Effectively and Efficiently
• RG-Flow: A hierarchical and explainable flow model based on renormalization group and sparse prior
• Hate-Alert@DravidianLangTech-EACL2021: Ensembling strategies for Transformer-based Offensive language Detection
• From Universal Language Model to Downstream Task: Improving RoBERTa-Based Vietnamese Hate Speech Detection
• An Ensemble of Knowledge Sharing Models for Dynamic Hand Gesture Recognition
• Automatic Differentiation-based Full Waveform Inversion with Flexible Workflows
• Search-Engine-augmented Dialogue Response Generation with Cheaply Supervised Query Production
• Normalized Flat Minima: Exploring Scale Invariant Definition of Flat Minima for Neural Networks using PAC-Bayesian Analysis
• $S^2$Net: Accurate Panorama Depth Estimation on Spherical Surface
• Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extraction
• Audio Event-Relational Graph Representation Learning for Acoustic Scene Classification
• Using a thousand optimization tasks to learn hyperparameter search strategies
• MultiMAE-DER: Multimodal Masked Autoencoder for Dynamic Emotion Recognition
• Objects are Different: Flexible Monocular 3D Object Detection
• Neural Lyapunov Differentiable Predictive Control
• TransVOS: Video Object Segmentation with Transformers
• Event Transformer+. A multi-purpose solution for efficient event data processing
• SpecTNT: a Time-Frequency Transformer for Music Audio
• M6-T: Exploring Sparse Expert Models and Beyond
• Encoding protein dynamic information in graph representation for functional residue identification
• A Neural Span-Based Continual Named Entity Recognition Model
• Improved Difference Images for Change Detection Classifiers in SAR Imagery Using Deep Learning
• Condition-Invariant Semantic Segmentation
• GUing: A Mobile GUI Search Engine using a Vision-Language Model
• The Phonetic Footprint of Parkinson's Disease
• MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning
• Response Generation with Context-Aware Prompt Learning
• Sam2Rad: A Segmentation Model for Medical Images with Learnable Prompts
• Neural Ordinary Differential Equations for Model Order Reduction of Stiff Systems
• Learning Bounds for Risk-sensitive Learning
• Generalizing MLPs With Dropouts, Batch Normalization, and Skip Connections
• NLNDE at SemEval-2023 Task 12: Adaptive Pretraining and Source Language Selection for Low-Resource Multilingual Sentiment Analysis
• Multi-granularity Contrastive Cross-modal Collaborative Generation for End-to-End Long-term Video Question Answering
• A Probabilistic Autoencoder for Type Ia Supernovae Spectral Time Series
• Sound Event Detection Transformer: An Event-based End-to-End Model for Sound Event Detection
• SegDiff: Image Segmentation with Diffusion Probabilistic Models
• ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning
• Unified Multi-Criteria Chinese Word Segmentation with BERT
• Ask "Who", Not "What": Bitcoin Volatility Forecasting with Twitter Data
• DeViT: Deformed Vision Transformers in Video Inpainting
• SimPLE: Similar Pseudo Label Exploitation for Semi-Supervised Classification
• ChartSumm: A Comprehensive Benchmark for Automatic Chart Summarization of Long and Short Summaries
• PECI-Net: Bolus segmentation from video fluoroscopic swallowing study images using preprocessing ensemble and cascaded inference
• Supervised Learning on Relational Databases with Graph Neural Networks
• A Deep Learning Based Attack for The Chaos-based Image Encryption
• ClipCap: CLIP Prefix for Image Captioning
• The gap between theory and practice in function approximation with deep neural networks
• Tucano: Advancing Neural Text Generation for Portuguese
• Single-/Multi-Source Cross-Lingual NER via Teacher-Student Learning on Unlabeled Data in Target Language
• HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Data
• Incorporating Anatomical Awareness for Enhanced Generalizability and Progression Prediction in Deep Learning-Based Radiographic Sacroiliitis Detection
• Regress Before Construct: Regress Autoencoder for Point Cloud Self-supervised Learning
• Guiding the underwater acoustic target recognition with interpretable contrastive learning
• Deep Forest: Neural Network reconstruction of the Lyman-alpha forest
• P-CRITICAL: A Reservoir Autoregulation Plasticity Rule for Neuromorphic Hardware
• Bag of Tricks for Adversarial Training
• INSPIRED: Toward Sociable Recommendation Dialog Systems
• BigBIO: A Framework for Data-Centric Biomedical Natural Language Processing
• Exploring the Landscape of Natural Language Processing Research
• Double Graph Based Reasoning for Document-level Relation Extraction
• Word Alignment by Fine-tuning Embeddings on Parallel Corpora
• Table Detection for Visually Rich Document Images
• GPTSee: Enhancing Moment Retrieval and Highlight Detection via Description-Based Similarity Features
• Multitask Recalibrated Aggregation Network for Medical Code Prediction
• Visual Transformers for Primates Classification and Covid Detection
• Muesli: Combining Improvements in Policy Optimization
• InforMask: Unsupervised Informative Masking for Language Model Pretraining
• Histopathological Image Classification based on Self-Supervised Vision Transformer and Weak Labels
• MM-ALT: A Multimodal Automatic Lyric Transcription System
• The Causal-Neural Connection: Expressiveness, Learnability, and Inference
• Geometric and Physical Quantities Improve E(3) Equivariant Message Passing
• Diverse Title Generation for Stack Overflow Posts with Multiple Sampling Enhanced Transformer
• GRAPPA -- A Hybrid Graph Neural Network for Predicting Pure Component Vapor Pressures
• Aspect and Opinion Term Extraction for Hotel Reviews using Transfer Learning and Auxiliary Labels
• DirectMultiStep: Direct Route Generation for Multistep Retrosynthesis
• User Training with Error Augmentation for Electromyogram-based Gesture Classification
• Continuous Speech Separation with Conformer
• Automated Olfactory Bulb Segmentation on High Resolutional T2-Weighted MRI
• Heterogeneous Graph Neural Networks with Post-hoc Explanations for Multi-modal and Explainable Land Use Inference
• SLOctolyzer: Fully automatic analysis toolkit for segmentation and feature extracting in scanning laser ophthalmoscopy images
• Proxy-based Item Representation for Attribute and Context-aware Recommendation
• Text-only domain adaptation for end-to-end ASR using integrated text-to-mel-spectrogram generator
• Beyond the Eye: A Relational Model for Early Dementia Detection Using Retinal OCTA Images
• End-to-End Zero-Shot Voice Conversion with Location-Variable Convolutions
• A Hierarchical Transformer with Speaker Modeling for Emotion Recognition in Conversation
• Reformulating HOI Detection as Adaptive Set Prediction
• Dense Voxel 3D Reconstruction Using a Monocular Event Camera
• Morphosyntactic probing of multilingual BERT models
• UFO-ViT: High Performance Linear Vision Transformer without Softmax
• MOT-DETR: 3D Single Shot Detection and Tracking with Transformers to build 3D representations for Agro-Food Robots
• Learning Active Subspaces and Discovering Important Features with Gaussian Radial Basis Functions Neural Networks
• Robust Unsupervised Video Anomaly Detection by Multi-Path Frame Prediction
• Automotive Object Detection via Learning Sparse Events by Spiking Neurons
• Subhalo effective density slope measurements from HST strong lensing data with neural likelihood-ratio estimation
• MXR-U-Nets for Real Time Hyperspectral Reconstruction
• Learning to Adapt Domain Shifts of Moral Values via Instance Weighting
• "You might think about slightly revising the title": identifying hedges in peer-tutoring interactions
• Unified Question Generation with Continual Lifelong Learning
• Reconciling Modern Deep Learning with Traditional Optimization Analyses: The Intrinsic Learning Rate
• Scan-specific Self-supervised Bayesian Deep Non-linear Inversion for Undersampled MRI Reconstruction
• CCS Explorer: Relevance Prediction, Extractive Summarization, and Named Entity Recognition from Clinical Cohort Studies
• Towards Foundation Models for Materials Science: The Open MatSci ML Toolkit
• Deep neural networks approach to microbial colony detection -- a comparative analysis
• Simple data balancing achieves competitive worst-group-accuracy
• GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training
• Goal-Oriented Multi-Task BERT-Based Dialogue State Tracker
• PTT5: Pretraining and validating the T5 model on Brazilian Portuguese data
• Continual BERT: Continual Learning for Adaptive Extractive Summarization of COVID-19 Literature
• TernaryBERT: Distillation-aware Ultra-low Bit BERT
• Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting
• MICDIR: Multi-scale Inverse-consistent Deformable Image Registration using UNetMSS with Self-Constructing Graph Latent
• Finite-difference-informed graph network for solving steady-state incompressible flows on block-structured grids
• Enhancing Dual-Encoders with Question and Answer Cross-Embeddings for Answer Retrieval
• End-to-End Trainable Multi-Instance Pose Estimation with Transformers
• MonoRUn: Monocular 3D Object Detection by Reconstruction and Uncertainty Propagation
• A Lightweight NMS-free Framework for Real-time Visual Fault Detection System of Freight Trains
• Positive-Negative Momentum: Manipulating Stochastic Gradient Noise to Improve Generalization
• Towards Biologically Plausible Convolutional Networks
• CoCoSum: Contextual Code Summarization with Multi-Relational Graph Neural Network
• LANA: Towards Personalized Deep Knowledge Tracing Through Distinguishable Interactive Sequences
• HisynSeg: Weakly-Supervised Histopathological Image Segmentation via Image-Mixing Synthesis and Consistency Regularization
• 3D-RETR: End-to-End Single and Multi-View 3D Reconstruction with Transformers
• Privacy-Preserving Models for Legal Natural Language Processing
• Weakly Supervised Learning for Analyzing Political Campaigns on Facebook
• Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning
• FusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detection
• Generative modeling of spatio-temporal weather patterns with extreme event conditioning
• Automated crack propagation measurement on asphalt concrete specimens using an optical flow-based deep neural network
• Factorized Fourier Neural Operators
• IMG2SMI: Translating Molecular Structure Images to Simplified Molecular-input Line-entry System
• Diffusion-Augmented Depth Prediction with Sparse Annotations
• Dynamic Frame Interpolation in Wavelet Domain
• Boosting multi-demographic federated learning for chest radiograph analysis using general-purpose self-supervised representations
• LibAUC: A Deep Learning Library for X-Risk Optimization
• Freeform surface topology prediction for prescribed illumination via semi-supervised learning
• LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relations
• Rethinking Token-Mixing MLP for MLP-based Vision Backbone
• Learning Rates as a Function of Batch Size: A Random Matrix Theory Approach to Neural Network Training
• Towards Suicide Prevention from Bipolar Disorder with Temporal Symptom-Aware Multitask Learning
• A User-Friendly Framework for Generating Model-Preferred Prompts in Text-to-Image Synthesis
• Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments
• Improving the Accuracy of Analog-Based In-Memory Computing Accelerators Post-Training
• Topic-Guided Sampling For Data-Efficient Multi-Domain Stance Detection
• 3DVSR: 3D EPI Volume-based Approach for Angular and Spatial Light field Image Super-resolution
• It Takes Two to Tango: Mixup for Deep Metric Learning
• An Adaptive Gradient Method with Energy and Momentum
• Learning Vision Transformer with Squeeze and Excitation for Facial Expression Recognition
• Learning of viscosity functions in rarefied gas flows with physics-informed neural networks
• CATE: Computation-aware Neural Architecture Encoding with Transformers
• Identifying Exoplanets with Deep Learning. IV. Removing Stellar Activity Signals from Radial Velocity Measurements Using Neural Networks
• DeeperForensics Challenge 2020 on Real-World Face Forgery Detection: Methods and Results
• Learning Multi-Stage Multi-Grained Semantic Embeddings for E-Commerce Search
• HybridPoint: Point Cloud Registration Based on Hybrid Point Sampling and Matching
• SST: Self-training with Self-adaptive Thresholding for Semi-supervised Learning
• SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequences
• E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning
• MaIL: A Unified Mask-Image-Language Trimodal Network for Referring Image Segmentation
• Weakly Supervised Airway Orifice Segmentation in Video Bronchoscopy
• Revisiting BFloat16 Training
• SAPAG: A Self-Adaptive Privacy Attack From Gradients
• Improved OOD Generalization via Adversarial Training and Pre-training
• SALR: Sharpness-aware Learning Rate Scheduler for Improved Generalization
• Sound2Synth: Interpreting Sound via FM Synthesizer Parameters Estimation
• HAD-Net: A Hierarchical Adversarial Knowledge Distillation Network for Improved Enhanced Tumour Segmentation Without Post-Contrast Images
• SIRE: Separate Intra- and Inter-sentential Reasoning for Document-level Relation Extraction
• Transform and Tell: Entity-Aware News Image Captioning
• Proxy Anchor Loss for Deep Metric Learning
• Physics-informed generative model for drug-like molecule conformers
• Fusing Context Into Knowledge Graph for Commonsense Question Answering
• Parameterization of Cross-Token Relations with Relative Positional Encoding for Vision MLP
• 3DTINC: Time-Equivariant Non-Contrastive Learning for Predicting Disease Progression from Longitudinal OCTs
• Does Yoga Make You Happy? Analyzing Twitter User Happiness using Textual and Temporal Information
• Robust and Decomposable Average Precision for Image Retrieval
• Cross-Attention in Coupled Unmixing Nets for Unsupervised Hyperspectral Super-Resolution
• Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Models
• Interactive Neural Painting
• Number of Attention Heads vs Number of Transformer-Encoders in Computer Vision
• Progressive Motion Context Refine Network for Efficient Video Frame Interpolation
• Improving Bilingual Lexicon Induction with Cross-Encoder Reranking
• A Multimodal Approach to Device-Directed Speech Detection with Large Language Models
• Modern French Poetry Generation with RoBERTa and GPT-2
• Learning the Geodesic Embedding with Graph Neural Networks
• Open-World Lifelong Graph Learning
• Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoning
• Knowledge Injection into Dialogue Generation via Language Models
• A Comparison-Relationship-Surrogate Evolutionary Algorithm for Multi-Objective Optimization
• PyBOP: A Python package for battery model optimisation and parameterisation
• Text-to-SQL in the Wild: A Naturally-Occurring Dataset Based on Stack Exchange Data
• Detecting Narrative Elements in Informational Text
• Self-supervised Semi-supervised Learning for Data Labeling and Quality Evaluation
• OSDMamba: Enhancing Oil Spill Detection from Remote Sensing Images Using Selective State Space Model
• Pose Recognition with Cascade Transformers
• Unsupervised Pre-Training for 3D Leaf Instance Segmentation
• Precise Length Control in Large Language Models
• SelfDoc: Self-Supervised Document Representation Learning
• Grounded Situation Recognition with Transformers
• Escaping Saddle Points Faster with Stochastic Momentum
• It's All Around You: Range-Guided Cylindrical Network for 3D Object Detection
• Cross-Lingual Knowledge Distillation for Answer Sentence Selection in Low-Resource Languages
• Analysis of Twitter Users' Lifestyle Choices using Joint Embedding Model
• MissFormer: (In-)attention-based handling of missing observations for trajectory filtering and prediction
• DeRi-Bot: Learning to Collaboratively Manipulate Rigid Objects via Deformable Objects
• TopicRefine: Joint Topic Prediction and Dialogue Response Generation for Multi-turn End-to-End Dialogue System
• Order in the Court: Explainable AI Methods Prone to Disagreement
• AuGPT: Auxiliary Tasks and Data Augmentation for End-To-End Dialogue with Pre-Trained Language Models
• A General Family of Stochastic Proximal Gradient Methods for Deep Learning
• on the effectiveness of generative adversarial network on anomaly detection
• Neural Sentence Ordering Based on Constraint Graphs
• SkillSpan: Hard and Soft Skill Extraction from English Job Postings
• High-Resolution Optical Flow from 1D Attention and Correlation
• FPANet: Frequency-based Video Demoireing using Frame-level Post Alignment
• Fre-GAN: Adversarial Frequency-consistent Audio Synthesis
• Artificial Neural Variability for Deep Learning: On Overfitting, Noise Memorization, and Catastrophic Forgetting
• CATs: Cost Aggregation Transformers for Visual Correspondence
• Scaling Graph Neural Networks to Large Proteins
• Adaptive L2 Regularization in Person Re-Identification
• SpVOS: Efficient Video Object Segmentation with Triple Sparse Convolution
• Approximating Instance-Dependent Noise via Instance-Confidence Embedding
• The Battleship Approach to the Low Resource Entity Matching Problem
• Model Extraction and Adversarial Transferability, Your BERT is Vulnerable!
• aSAGA: Automatic Sleep Analysis with Gray Areas
• End-to-End Chess Recognition
• Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor
• Cross-Modal Conceptualization in Bottleneck Models
• Visual Reasoning: from State to Transformation
• Cold-start Active Learning through Self-supervised Language Modeling
• A new method for structural diagnostics with muon tomography and deep learning
• Weisfeiler and Lehman Go Paths: Learning Topological Features via Path Complexes
• 3D Multiphase Heterogeneous Microstructure Generation Using Conditional Latent Diffusion Models
• POPNASv2: An Efficient Multi-Objective Neural Architecture Search Technique
• Fusing Modalities by Multiplexed Graph Neural Networks for Outcome Prediction in Tuberculosis
• Visually-Guided Sound Source Separation with Audio-Visual Predictive Coding
• Enhancing Language Representation with Constructional Information for Natural Language Understanding
• Symmetric Regularization based BERT for Pair-wise Semantic Reasoning
• Real-Time Anchor-Free Single-Stage 3D Detection with IoU-Awareness
• Discourse-level Relation Extraction via Graph Pooling
• Calibrating and Improving Graph Contrastive Learning
• On the convergence of PINNs
• Extending Lagrangian and Hamiltonian Neural Networks with Differentiable Contact Models
• A Two-part Transformer Network for Controllable Motion Synthesis
• Homography-Based Loss Function for Camera Pose Regression
• Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions
• Likelihood Training of Schrödinger Bridge using Forward-Backward SDEs Theory
• Towards General Purpose Vision Systems
• Fine-tuning of Pre-trained Transformers for Hate, Offensive, and Profane Content Detection in English and Marathi
• Are the Multilingual Models Better? Improving Czech Sentiment with Transformers
• Hire-MLP: Vision MLP via Hierarchical Rearrangement
• On the Trade-off between Redundancy and Local Coherence in Summarization
• SideControl: Controlled Open-domain Dialogue Generation via Additive Side Networks
• Self-Supervised Learning by Estimating Twin Class Distributions
• Chunked Autoregressive GAN for Conditional Waveform Synthesis
• Tissue Concepts: supervised foundation models in computational pathology
• FNet II: Spectral Classification of Quasars, Galaxies, Stars, and broad absorption line (BAL) Quasars
• LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval
• A Survey of Spatio-Temporal EEG data Analysis: from Models to Applications
• Inferring Actual Treatment Pathways from Patient Records
• Persona Authentication through Generative Dialogue
• Multimedia Generative Script Learning for Task Planning
• GAN Vocoder: Multi-Resolution Discriminator Is All You Need
• Reconstruction of Cardiac Cine MRI Using Motion-Guided Deformable Alignment and Multi-Resolution Fusion
• AdaGDA: Faster Adaptive Gradient Descent Ascent Methods for Minimax Optimization
• v2e: From Video Frames to Realistic DVS Events
• verBERT: Automating Brazilian Case Law Document Multi-label Categorization Using BERT
• An Empirical Study on Few-shot Knowledge Probing for Pretrained Language Models
• An Image Patch is a Wave: Phase-Aware Vision MLP
• ViNTER: Image Narrative Generation with Emotion-Arc-Aware Transformer
• Conversations Are Not Flat: Modeling the Dynamic Information Flow across Dialogue Utterances
• Improving Sentence-Level Relation Extraction through Curriculum Learning
• FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models
• LaRa: Latents and Rays for Multi-Camera Bird's-Eye-View Semantic Segmentation
• MISIM: A Neural Code Semantics Similarity System Using the Context-Aware Semantics Structure
• Twitter User Representation Using Weakly Supervised Graph Embedding
• NeuralProphet: Explainable Forecasting at Scale
• AdaSGD: Bridging the gap between SGD and Adam
• Towards Balanced Active Learning for Multimodal Classification
• A Unified Pruning Framework for Vision Transformers
• All Attention U-NET for Semantic Segmentation of Intracranial Hemorrhages In Head CT Images
• Table-to-Text Generation with Pretrained Diffusion Models
• Dartmouth CS at WNUT-2020 Task 2: Informative COVID-19 Tweet Classification Using BERT
• S.T.A.R.-Track: Latent Motion Models for End-to-End 3D Object Tracking with Adaptive Spatio-Temporal Appearance Representations
• A real-time anomaly detection method for robots based on a flexible and sparse latent space
• Numerically Solving Parametric Families of High-Dimensional Kolmogorov Partial Differential Equations via Deep Learning
• From Disfluency Detection to Intent Detection and Slot Filling
• Large-Scale Gradient-Free Deep Learning with Recursive Local Representation Alignment
• Can we Estimate Truck Accident Risk from Telemetric Data using Machine Learning?
• AeroReformer: Aerial Referring Transformer for UAV-based Referring Image Segmentation
• Adaptive Multi-view Rule Discovery for Weakly-Supervised Compatible Products Prediction
• Energy-GNoME: A Living Database of Selected Materials for Energy Applications
• Hybrid Generative-Contrastive Representation Learning
• BanglaBait: Semi-Supervised Adversarial Approach for Clickbait Detection on Bangla Clickbait Dataset
• Temporal Sentence Grounding in Streaming Videos
• Learning word-referent mappings and concepts from raw inputs
• Context-Aware Classification of Legal Document Pages
• Intra-Batch Supervision for Panoptic Segmentation on High-Resolution Images
• Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach
• Towards Practical Lipreading with Distilled and Efficient Models
• Mention Memory: incorporating textual knowledge into Transformers through entity mention attention
• A Neural Network Perturbation Theory Based on the Born Series
• Embedding Transfer with Label Relaxation for Improved Metric Learning
• An Empirical Study on Hyperparameter Optimization for Fine-Tuning Pre-trained Language Models
• CiteFusion: An Ensemble Framework for Citation Intent Classification Harnessing Dual-Model Binary Couples and SHAP Analyses
• cosmosage: A Natural-Language Assistant for Cosmologists
• Self-Supervised Pillar Motion Learning for Autonomous Driving
• A Bayesian Flow Network Framework for Chemistry Tasks
• Reduced Data-Driven Turbulence Closure for Capturing Long-Term Statistics
• Offensive Language Identification in Low-resourced Code-mixed Dravidian languages using Pseudo-labeling
• Physics-regularized neural network of the ideal-MHD solution operator in Wendelstein 7-X configurations
• Query-Based Keyphrase Extraction from Long Documents
• Training Deep Neural Networks with Adaptive Momentum Inspired by the Quadratic Optimization
• IDIAPers @ Causal News Corpus 2022: Efficient Causal Relation Identification Through a Prompt-based Few-shot Approach
• Proto: A Neural Cocktail for Generating Appealing Conversations
• Are Training Resources Insufficient? Predict First Then Explain!
• Deep Learning-Based Position Detection for Hydraulic Cylinders Using Scattering Parameters
• Sentiment Analysis of the COVID-related r/Depression Posts
• Few-NERD: A Few-Shot Named Entity Recognition Dataset
• Multi-Fact Correction in Abstractive Text Summarization
• ZRIGF: An Innovative Multimodal Framework for Zero-Resource Image-Grounded Dialogue Generation
• A Hybrid Vision Transformer Approach for Mathematical Expression Recognition
• Neural-powered unit disk graph embedding: qubits connectivity for some QUBO problems
• Pediatric brain tumor classification using digital histopathology and deep learning: evaluation of SOTA methods on a multi-center Swedish cohort
• Illicit object detection in X-ray images using Vision Transformers
• Impact of Ground Truth Quality on Handwriting Recognition
• BarcodeBERT: Transformers for Biodiversity Analysis
• A Simple and Robust Framework for Cross-Modality Medical Image Segmentation applied to Vision Transformers
• Local Boosting for Weakly-Supervised Learning
• NoSENSE: Learned unrolled cardiac MRI reconstruction without explicit sensitivity maps
• Triggering Dark Showers with Conditional Dual Auto-Encoders
• Improved Multimodal Fusion for Small Datasets with Auxiliary Supervision
• X-SCITLDR: Cross-Lingual Extreme Summarization of Scholarly Documents
• The Nonlinearity Coefficient - A Practical Guide to Neural Architecture Design
• Beyond Distributional Hypothesis: Let Language Models Learn Meaning-Text Correspondence
• The Brier Score under Administrative Censoring: Problems and Solutions
• AdvPicker: Effectively Leveraging Unlabeled Data via Adversarial Discriminator for Cross-Lingual NER
• Accelerating BERT Inference for Sequence Labeling via Early-Exit
• Multi-Scale High-Resolution Vision Transformer for Semantic Segmentation
• ConDA: Unsupervised Domain Adaptation for LiDAR Segmentation via Regularized Domain Concatenation
• Voint Cloud: Multi-View Point Cloud Representation for 3D Understanding
• Mesa: A Memory-saving Training Framework for Transformers
• Robustness Challenges in Model Distillation and Pruning for Natural Language Understanding
• The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization
• What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers
• Boosting Salient Object Detection with Transformer-based Asymmetric Bilateral U-Net
• Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning
• M-FAC: Efficient Matrix-Free Approximations of Second-Order Information
• Atomistic Graph Neural Networks for metals: Application to bcc iron
• S3Net: A Single Stream Structure for Depth Guided Image Relighting
• A Streaming End-to-End Framework For Spoken Language Understanding
• Deep Learning for Rheumatoid Arthritis: Joint Detection and Damage Scoring in X-rays
• Knodle: Modular Weakly Supervised Learning with PyTorch
• ImageNet-21K Pretraining for the Masses
• Continual Learning for Text Classification with Information Disentanglement Based Regularization
• EfficientQA : a RoBERTa Based Phrase-Indexed Question-Answering System
• Detecting and Exorcising Statistical Demons from Language Models with Anti-Models of Negative Data
• Deep Neural Network Training with Frank-Wolfe
• On the Transformer Growth for Progressive BERT Training
• On the Convergence of Step Decay Step-Size for Stochastic Optimization
• OkwuGbé: End-to-End Speech Recognition for Fon and Igbo
• Frequency Domain Transformer Networks for Video Prediction
• Visually Grounded Continual Learning of Compositional Phrases
• A Dynamic Reduction Network for Point Clouds
• A comprehensive study on the prediction reliability of graph neural networks for virtual screening
• Classifying CMB time-ordered data through deep neural networks
• Adaptive Sampling Distributed Stochastic Variance Reduced Gradient for Heterogeneous Distributed Datasets
• LinCE: A Centralized Benchmark for Linguistic Code-switching Evaluation
• Lite Training Strategies for Portuguese-English and English-Portuguese Translation
• VOMTC: Vision Objects for Millimeter and Terahertz Communications
• Unified Multi-modal Diagnostic Framework with Reconstruction Pre-training and Heterogeneity-combat Tuning
• Evaluating the structure of cognitive tasks with transfer learning
• Multi-modal Fusion and Query Refinement Network for Video Moment Retrieval and Highlight Detection
• HodgeNet: Learning Spectral Geometry on Triangle Meshes
• ViBERTgrid: A Jointly Trained Multi-Modal 2D Document Representation for Key Information Extraction from Documents
• WHO 2016 subtyping and automated segmentation of glioma using multi-task deep learning
• Interactive Refinement of Cross-Lingual Word Embeddings
• Teaching deep neural networks to localize single molecules for super-resolution microscopy
• Don't shoot butterfly with rifles: Multi-channel Continuous Speech Separation with Early Exit Transformer
• Explainable Health Risk Predictor with Transformer-based Medicare Claim Encoder
• Multi-Task Time Series Forecasting With Shared Attention
• DM${}^2$S${}^2$: Deep Multi-Modal Sequence Sets with Hierarchical Modality Attention
• Augmented Natural Language for Generative Sequence Labeling
• S2VC: A Framework for Any-to-Any Voice Conversion with Self-Supervised Pretrained Representations
• Lex-BERT: Enhancing BERT based NER with lexicons
• Benchmarking Commercial Intent Detection Services with Practice-Driven Evaluations
• Dialogue Graph Modeling for Conversational Machine Reading
• Neural Text Generation with Artificial Negative Examples
• PowerTransformer: Unsupervised Controllable Revision for Biased Language Correction
• Temporal LiDAR Frame Prediction for Autonomous Driving
• CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade
• A Spatiotemporal Radar-Based Precipitation Model for Water Level Prediction and Flood Forecasting
• The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks
• Low-Resource Multi-Granularity Academic Function Recognition Based on Multiple Prompt Knowledge
• Adversarially Regularized Policy Learning Guided by Trajectory Optimization
• How Have We Reacted To The COVID-19 Pandemic? Analyzing Changing Indian Emotions Through The Lens of Twitter
• Planning from Pixels using Inverse Dynamics Models
• Benchmarking Energy-Conserving Neural Networks for Learning Dynamics from Data
• On Pursuit of Designing Multi-modal Transformer for Video Grounding
• Incorporating Question Answering-Based Signals into Abstractive Summarization via Salient Span Selection
• Learning Covariance-Based Multi-Scale Representation of Neuroimaging Measures for Alzheimer Classification
• CAFENet: Class-Agnostic Few-Shot Edge Detection Network
• Fine-tuning Strategies for Domain Specific Question Answering under Low Annotation Budget Constraints
• Neural network for multi-exponential sound energy decay analysis
• PointNu-Net: Keypoint-assisted Convolutional Neural Network for Simultaneous Multi-tissue Histology Nuclei Segmentation and Classification
• Lightweight Gaze Estimation Model Via Fusion Global Information
• Learning Low-Level Causal Relations using a Simulated Robotic Arm
• Multilingual Transformers for Product Matching -- Experiments and a New Benchmark in Polish
• Doubly Adaptive Scaled Algorithm for Machine Learning Using Second-Order Information
• VidLanKD: Improving Language Understanding via Video-Distilled Knowledge Transfer
• MUNet: Motion Uncertainty-aware Semi-supervised Video Object Segmentation
• DragPoser: Motion Reconstruction from Variable Sparse Tracking Signals via Latent Space Optimization
• AdaTag: Multi-Attribute Value Extraction from Product Profiles with Adaptive Decoding
• Scaling Object Detection by Transferring Classification Weights
• Dynamically Mitigating Data Discrepancy with Balanced Focal Loss for Replay Attack Detection
• Learning Camera Localization via Dense Scene Matching
• LNPT: Label-free Network Pruning and Training
• Invariance Measures for Neural Networks
• CodeNeRF: Disentangled Neural Radiance Fields for Object Categories
• NeuralPDR: Neural Differential Equations as surrogate models for Photodissociation Regions
• Revisiting Deep Generalized Canonical Correlation Analysis
• Structured Sparse R-CNN for Direct Scene Graph Generation
• Localizing Infinity-shaped fishes: Sketch-guided object localization in the wild
• Discriminative Reasoning for Document-level Relation Extraction
• Large Batch Simulation for Deep Reinforcement Learning
• PhytNet -- Tailored Convolutional Neural Networks for Custom Botanical Data
• Advanced Graph-Based Deep Learning for Probabilistic Type Inference
• Camera Control at the Edge with Language Models for Scene Understanding
• Multi-Attribute Relation Extraction (MARE) -- Simplifying the Application of Relation Extraction
• Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue State Tracking
• Neural optimization for quantum architectures: graph embedding problems with Distance Encoder Networks
• Exploiting Contextual Information with Deep Neural Networks
• Open Question Answering over Tables and Text
• Exploring Transformer Based Models to Identify Hate Speech and Offensive Content in English and Indo-Aryan Languages
• Smooth Proxy-Anchor Loss for Noisy Metric Learning
• Scalable Deep Graph Clustering with Random-walk based Self-supervised Learning
• TE-YOLOF: Tiny and efficient YOLOF for blood cell detection
• Speeding up Deep Model Training by Sharing Weights and Then Unsharing
• On the Sins of Image Synthesis Loss for Self-supervised Depth Estimation
• ChainCQG: Flow-Aware Conversational Question Generation
• On Sample Based Explanation Methods for NLP:Efficiency, Faithfulness, and Semantic Evaluation
• Neural Language Modeling for Contextualized Temporal Graph Generation
• Fokker-Planck Score Learning: Efficient Free-Energy Estimation under Periodic Boundary Conditions
• Cognate Transformer for Automated Phonological Reconstruction and Cognate Reflex Prediction
• Calibration and Uncertainty for multiRater Volume Assessment in multiorgan Segmentation (CURVAS) challenge results
• Improving Irregularly Sampled Time Series Learning with Dense Descriptors of Time
• Speech-Forensics: Towards Comprehensive Synthetic Speech Dataset Establishment and Analysis
• CoSQA: 20,000+ Web Queries for Code Search and Question Answering
• Towards Structured Dynamic Sparse Pre-Training of BERT
• DSEE: Dually Sparsity-embedded Efficient Tuning of Pre-trained Language Models
• MAX: Masked Autoencoder for X-ray Fluorescence in Geological Investigation
• Learning from Aggregate Observations
• Aemulus $\nu$: Precision halo mass functions in w$\nu$CDM cosmologies
• 1st Place Solution for YouTubeVOS Challenge 2021:Video Instance Segmentation
• AViTMP: A Tracking-Specific Transformer for Single-Branch Visual Tracking
• Generalization Error Analysis of Neural networks with Gradient Based Regularization
• Tatum-Level Drum Transcription Based on a Convolutional Recurrent Neural Network with Language Model-Based Regularized Training
• Unsupervised Geometric Disentanglement for Surfaces via CFAN-VAE
• Nested and Balanced Entity Recognition using Multi-Task Learning
• Local Slot Attention for Vision-and-Language Navigation
• On the One-sided Convergence of Adam-type Algorithms in Non-convex Non-concave Min-max Optimization
• The Unreasonable Effectiveness of Large Language-Vision Models for Source-free Video Domain Adaptation
• Dynamic Sliding Window for Meeting Summarization
• DILBERT: Customized Pre-Training for Domain Adaptation withCategory Shift, with an Application to Aspect Extraction
• Regime Learning for Differentiable Particle Filters
• Finding New Diagnostic Information for Detecting Glaucoma using Neural Networks
• SituationalLLM: Proactive language models with scene awareness for dynamic, contextual task guidance
• Deep Spiking Neural Networks with Resonate-and-Fire Neurons
• On Bilingual Lexicon Induction with Large Language Models
• Cue-word Driven Neural Response Generation with a Shrinking Vocabulary
• ALPaCA vs. GP-based Prior Learning: A Comparison between two Bayesian Meta-Learning Algorithms
• Auction learning as a two-player game
• A Multi-level Alignment Training Scheme for Video-and-Language Grounding
• An Improved Model for Voicing Silent Speech
• MUSE: Multi-Scale Temporal Features Evolution for Knowledge Tracing
• Cross-lingual Text Classification with Heterogeneous Graph Neural Network
• Alignment Attention by Matching Key and Query Distributions
• Application-driven Validation of Posteriors in Inverse Problems
• GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation
• Task-Adaptive Feature Transformer for Few-Shot Segmentation
• HySPA: Hybrid Span Generation for Scalable Text-to-Graph Extraction
• Structural Pre-training for Dialogue Comprehension
• Pre-training Language Model Incorporating Domain-specific Heterogeneous Knowledge into A Unified Representation
• Learning scale-variant features for robust iris authentication with deep learning based ensemble framework
• GroupBERT: Enhanced Transformer Architecture with Efficient Grouped Structures
• Fabricator: An Open Source Toolkit for Generating Labeled Training Data with Teacher LLMs
• ATHENA: Mathematical Reasoning with Thought Expansion
• Ensemble Fine-tuned mBERT for Translation Quality Estimation
• Content Selection Network for Document-grounded Retrieval-based Chatbots
• Vortex-Induced Drag Forecast for Cylinder in Non-uniform Inflow
• Ranking Neural Checkpoints
• NomMer: Nominate Synergistic Context in Vision Transformer for Visual Recognition
• Rewriting Meaningful Sentences via Conditional BERT Sampling and an application on fooling text classifiers
• Time-Delay Momentum: A Regularization Perspective on the Convergence and Generalization of Stochastic Momentum for Deep Learning
• RoMA: Robust Model Adaptation for Offline Model-based Optimization
• Which Discriminator for Cooperative Text Generation?
• Improved Training for End-to-End Streaming Automatic Speech Recognition Model with Punctuation
• On the Trend-corrected Variant of Adaptive Stochastic Optimization Methods
• FROG: A new people detection dataset for knee-high 2D range finders
• Investigating Strategies for Clause Recommendation
• A Histopathology Study Comparing Contrastive Semi-Supervised and Fully Supervised Learning
• Scaling Law for Recommendation Models: Towards General-purpose User Representations
• Novel View Synthesis of Humans using Differentiable Rendering
• A Transformer-based Math Language Model for Handwritten Math Expression Recognition
• Towards End-to-End Open Conversational Machine Reading
• TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localization
• Semi-weakly Supervised Contrastive Representation Learning for Retinal Fundus Images
• Exploring Pair-Wise NMT for Indian Languages
• Unsupervised Improvement of Factual Knowledge in Language Models
• Transformers in Unsupervised Structure-from-Motion
• The StatCan Dialogue Dataset: Retrieving Data Tables through Conversations with Genuine Intents
• Long-Short Temporal Contrastive Learning of Video Transformers
• Modality-Agnostic Style Transfer for Holistic Feature Imputation
• Generate & Rank: A Multi-task Framework for Math Word Problems
• Multi-layer Feature Aggregation for Deep Scene Parsing Models
• Deep Data Flow Analysis
• MRCBert: A Machine Reading ComprehensionApproach for Unsupervised Summarization
• Chinese Medical Question Answer Matching Based on Interactive Sentence Representation Learning
• A Fast Knowledge Distillation Framework for Visual Recognition
• Enhancing Rotated Object Detection via Anisotropic Gaussian Bounding Box and Bhattacharyya Distance
• PSG: Prompt-based Sequence Generation for Acronym Extraction
• Towards a Universal Continuous Knowledge Base
• Radial Prediction Domain Adaption Classifier for the MIDOG 2022 Challenge
• Reweighting Augmented Samples by Minimizing the Maximal Expected Loss
• A Stronger Baseline for Ego-Centric Action Detection
• Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations
• HEAR: Hearing Enhanced Audio Response for Video-grounded Dialogue
• Zero-Shot Dialogue State Tracking via Cross-Task Transfer
• Rectangular Flows for Manifold Learning
• Benchmarking Deep Learning Methods for Irradiance Estimation from Sky Images with Applications to Video Prediction-Based Irradiance Nowcasting
• Bridging Text and Crystal Structures: Literature-driven Contrastive Learning for Materials Science
• Hierarchical Representation Learning for Markov Decision Processes
• Initialization and Regularization of Factorized Neural Layers
• PyEuroVoc: A Tool for Multilingual Legal Document Classification with EuroVoc Descriptors
• ARCA23K: An audio dataset for investigating open-set label noise
• L2M: Practical posterior Laplace approximation with optimization-driven second moment estimation
• Arch-Net: Model Distillation for Architecture Agnostic Model Deployment
• Communication-Compressed Adaptive Gradient Method for Distributed Nonconvex Optimization
• Accelerated Almost-Sure Convergence Rates for Nonconvex Stochastic Gradient Descent using Stochastic Learning Rates
• NeuroBack: Improving CDCL SAT Solving using Graph Neural Networks
• AdaL: Adaptive Gradient Transformation Contributes to Convergences and Generalizations
• Using Self-Supervised Feature Extractors with Attention for Automatic COVID-19 Detection from Speech
• On the Robustness of Pretraining and Self-Supervision for a Deep Learning-based Analysis of Diabetic Retinopathy
• Making Document-Level Information Extraction Right for the Right Reasons
• Learning invariance preserving moment closure model for Boltzmann-BGK equation
• Data Augmentation for Cross-Domain Named Entity Recognition
• Sample Efficient Social Navigation Using Inverse Reinforcement Learning
• LiRA: Learning Visual Speech Representations from Audio through Self-supervision
• Sequential Reptile: Inter-Task Gradient Alignment for Multilingual Learning
• Vitruvion: A Generative Model of Parametric CAD Sketches
• Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERT
• Rethinking Noisy Label Models: Labeler-Dependent Noise with Adversarial Awareness
• RaftMLP: How Much Can Be Done Without Attention and with Less Spatial Locality?
• Dynamic Compositionality in Recursive Neural Networks with Structure-aware Tag Representations
• Construction Cost Index Forecasting: A Multi-feature Fusion Approach
• Cross-language Sentence Selection via Data Augmentation and Rationale Training
• Pose2RGBD. Generating Depth and RGB images from absolute positions
• ResIST: Layer-Wise Decomposition of ResNets for Distributed Training
• Cross-document Event Identity via Dense Annotation
• Fine-Grained Classroom Activity Detection from Audio with Neural Networks
• TD3Net: A temporal densely connected multi-dilated convolutional network for lipreading
• ConvFiT: Conversational Fine-Tuning of Pretrained Language Models
• Bi-Granularity Contrastive Learning for Post-Training in Few-Shot Scene
• BERTweetFR : Domain Adaptation of Pre-Trained Language Models for French Tweets
• Learning from Multiple Noisy Partial Labelers
• ViTAS: Vision Transformer Architecture Search
• G-SemTMO: Tone Mapping with a Trainable Semantic Graph
• Image interpretation by iterative bottom-up top-down processing
• Improving Cross-Lingual Reading Comprehension with Self-Training
• Compositional Modeling of Nonlinear Dynamical Systems with ODE-based Random Features
• SIPSA-Net: Shift-Invariant Pan Sharpening with Moving Object Alignment for Satellite Imagery
• Discrete Point Flow Networks for Efficient Point Cloud Generation
• Understanding the Disharmony between Weight Normalization Family and Weight Decay: $\epsilon -$shifted $L_2$ Regularizer
• Universal Online Convex Optimization Meets Second-order Bounds
• Polygonal Unadjusted Langevin Algorithms: Creating stable and efficient adaptive algorithms for neural networks
• Weakly-supervised Text Classification Based on Keyword Graph
• FoveaTer: Foveated Transformer for Image Classification
• Understanding of Emotion Perception from Art
• Stylized Story Generation with Style-Guided Planning
• Training With Data Dependent Dynamic Learning Rates
• A Matrix Autoencoder Framework to Align the Functional and Structural Connectivity Manifolds as Guided by Behavioral Phenotypes
• Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation
• R&R: Metric-guided Adversarial Sentence Generation
• On the ability of monolingual models to learn language-agnostic representations
• Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media
• MUSER: MUltimodal Stress Detection using Emotion Recognition as an Auxiliary Task
• Privacy Aware Person Detection in Surveillance Data
• BERT4SO: Neural Sentence Ordering by Fine-tuning BERT
• Distribution-aware Margin Calibration for Medical Image Segmentation
• Identifying the Correlation Between Language Distance and Cross-Lingual Transfer in a Multilingual Representation Space
• Physics-Informed Neural State Space Models via Learning and Evolution
• SimCLAD: A Simple Framework for Contrastive Learning of Acronym Disambiguation
• Response Generation in Longitudinal Dialogues: Which Knowledge Representation Helps?
• Knowing-how & Knowing-that: A New Task for Machine Comprehension of User Manuals
• C2C-GenDA: Cluster-to-Cluster Generation for Data Augmentation of Slot Filling
• Informative Sample-Aware Proxy for Deep Metric Learning
• UU-Tax at SemEval-2022 Task 3: Improving the generalizability of language models for taxonomy classification through data augmentation
• Discover the Mysteries of the Maya: Selected Contributions from the Machine Learning Challenge & The Discovery Challenge Workshop at ECML PKDD 2021
• AMPLIFY:Attention-based Mixup for Performance Improvement and Label Smoothing in Transformer
• Help! Need Advice on Identifying Advice
• BERTnesia: Investigating the capture and forgetting of knowledge in BERT
• HNC: Leveraging Hard Negative Captions towards Models with Fine-Grained Visual-Linguistic Comprehension Capabilities
• Learning Co-Speech Gesture for Multimodal Aphasia Type Detection
• Pre-training with Meta Learning for Chinese Word Segmentation
• Quickly Finding a Benign Region via Heavy Ball Momentum in Non-Convex Optimization
• Adversarial AutoMixup
• Varianceflow: High-Quality and Controllable Text-to-Speech using Variance Information via Normalizing Flow
• GIPA: A General Information Propagation Algorithm for Graph Learning
• Instance Segmentation XXL-CT Challenge of a Historic Airplane
• An Objective Measure of Quality for Time-Scale Modification of Audio
• Revisiting Explicit Regularization in Neural Networks for Well-Calibrated Predictive Uncertainty
• Uppsala NLP at SemEval-2021 Task 2: Multilingual Language Models for Fine-tuning and Feature Extraction in Word-in-Context Disambiguation
• NorDial: A Preliminary Corpus of Written Norwegian Dialect Use
• Designing Pre-training Datasets from Unlabeled Data for EEG Classification with Transformers
• SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoning
• TorontoCL at CMCL 2021 Shared Task: RoBERTa with Multi-Stage Fine-Tuning for Eye-Tracking Prediction
• printf: Preference Modeling Based on User Reviews with Item Images and Textual Information via Graph Learning
• Differential Privacy, Linguistic Fairness, and Training Data Influence: Impossibility and Possibility Theorems for Multilingual Language Models
• Improving BERT Pretraining with Syntactic Supervision
• Traversing the Subspace of Adversarial Patches
• Hierarchical Entity Typing via Multi-level Learning to Rank
• A Transformer-based Autoregressive Decoder Architecture for Hierarchical Text Classification
• LSM: Learning Subspace Minimization for Low-level Vision
• sDREAMER: Self-distilled Mixture-of-Modality-Experts Transformer for Automatic Sleep Staging
• Interleaved Multitask Learning with Energy Modulated Learning Progress
• NTIRE 2020 Challenge on Spectral Reconstruction from an RGB Image
• Word Sense Linking: Disambiguating Outside the Sandbox
• Neural Subgraph Isomorphism Counting
• Generative Adversarial Networks for photo to Hayao Miyazaki style cartoons
• CLC: Complex Linear Coding for the DNS 2020 Challenge
• One to Transfer All: A Universal Transfer Framework for Vision Foundation Model with Few Data
• Image-Based Parking Space Occupancy Classification: Dataset and Baseline
• Deep Multi-Modal Sets
• Deep-learning in the bioimaging wild: Handling ambiguous data with deepflash2
• Momentum Centering and Asynchronous Update for Adaptive Gradient Methods
• Self-Distilled Self-Supervised Representation Learning
• Jointly Learning to Align and Translate with Transformer Models
• Multimodal Transformer with Variable-length Memory for Vision-and-Language Navigation
• VL-LTR: Learning Class-wise Visual-Linguistic Representation for Long-Tailed Visual Recognition
• Variational Learning for Unsupervised Knowledge Grounded Dialogs
• Three Pillars improving Vision Foundation Model Distillation for Lidar
• SciXGen: A Scientific Paper Dataset for Context-Aware Text Generation
• Analysis of the Penn Korean Universal Dependency Treebank (PKT-UD): Manual Revision to Build Robust Parsing Model in Korean
• Optimal Sampling Density for Nonparametric Regression
• Enhancing Audio Augmentation Methods with Consistency Learning
• CNN-based real-time 2D-3D deformable registration from a single X-ray projection
• Can images help recognize entities? A study of the role of images for Multimodal NER
• Learning from Multiple Noisy Augmented Data Sets for Better Cross-Lingual Spoken Language Understanding
• Understanding How Over-Parametrization Leads to Acceleration: A case of learning a single teacher neuron
• Knowledge-driven Active Learning
• A Modular Analysis of Provable Acceleration via Polyak's Momentum: Training a Wide ReLU Network and a Deep Linear Network
• AMU-EURANOVA at CASE 2021 Task 1: Assessing the stability of multilingual BERT
• CoRI: Collective Relation Integration with Data Augmentation for Open Information Extraction
• Improving Multi-Party Dialogue Discourse Parsing via Domain Integration
• Learning to Follow Language Instructions with Compositional Policies
• MTAdam: Automatic Balancing of Multiple Training Loss Terms
• TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Posts
• Modulating Regularization Frequency for Efficient Compression-Aware Model Training
• TATL at W-NUT 2020 Task 2: A Transformer-based Baseline System for Identification of Informative COVID-19 English Tweets
• Global Structure-Aware Drum Transcription Based on Self-Attention Mechanisms
• Understanding Modern Techniques in Optimization: Frank-Wolfe, Nesterov's Momentum, and Polyak's Momentum
• A Transformer Based Pitch Sequence Autoencoder with MIDI Augmentation
• UIUC_BioNLP at SemEval-2021 Task 11: A Cascade of Neural Models for Structuring Scholarly NLP Contributions
• Robust Generalization Strategies for Morpheme Glossing in an Endangered Language Documentation Context
• Simple and Effective Input Reformulations for Translation
• Single-dataset Experts for Multi-dataset Question Answering
• It's FLAN time! Summing feature-wise latent representations for interpretability
• P-Adapters: Robustly Extracting Factual Information from Language Models with Diverse Prompts
• ContourRend: A Segmentation Method for Improving Contours by Rendering
• Exploiting Attention-based Sequence-to-Sequence Architectures for Sound Event Localization
• Training Multimodal Systems for Classification with Multiple Objectives
• A New Adaptive Gradient Method with Gradient Decomposition
• Generation of tubular and membranous shape textures with curvature functionals
• Text2Brain: Synthesis of Brain Activation Maps from Free-form Text Query
• Tensor Normal Training for Deep Learning Models
• Controllable Neural Dialogue Summarization with Personal Named Entity Planning
• Learning from Multiple Sources for Data-to-Text and Text-to-Data
• Dynamic Knowledge Distillation for Pre-trained Language Models
• Weakly-Supervised Monocular Depth Estimationwith Resolution-Mismatched Data
• DessiLBI: Exploring Structural Sparsity of Deep Networks via Differential Inclusion Paths
• Gradient-based Hyperparameter Optimization Over Long Horizons
• Invexifying Regularization of Non-Linear Least-Squares Problems
• Awakening Latent Grounding from Pretrained Language Models for Semantic Parsing
• Multi-view 3D Reconstruction with Transformer
• Open-Set Representation Learning through Combinatorial Embedding
• Variance Reduction in Deep Learning: More Momentum is All You Need
• BERT Has Uncommon Sense: Similarity Ranking for Word Sense BERTology
• Adversarial Mixture Of Experts with Category Hierarchy Soft Constraint
• Incorporating Connections Beyond Knowledge Embeddings: A Plug-and-Play Module to Enhance Commonsense Reasoning in Machine Reading Comprehension
• MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models
• A Novel Information-Theoretic Objective to Disentangle Representations for Fair Classification
• Classification-based Quality Estimation: Small and Efficient Models for Real-world Applications
• Attention-Free Keyword Spotting
• Efficient Attribute Injection for Pretrained Language Models
• Improving Unsupervised Question Answering via Summarization-Informed Question Generation
• Camera Agnostic Two-Head Network for Ego-Lane Inference
• GIPFA: Generating IPA Pronunciation from Audio
• Towards Continual Entity Learning in Language Models for Conversational Agents
• MaxVA: Fast Adaptation of Step Sizes by Maximizing Observed Variance of Gradients
• Dialogue State Tracking with a Language Model using Schema-Driven Prompting
• Automatically Exposing Problems with Neural Dialog Models
• Few-Shot Transformation of Common Actions into Time and Space
• Emotion Stimulus Detection in German News Headlines
• Character Transformations for Non-Autoregressive GEC Tagging
• Efficient transfer learning for NLP with ELECTRA
• Efficient fine-tuning of 37-level GraphCast with the Canadian global deterministic analysis
• Reducing Exposure Bias in Training Recurrent Neural Network Transducers
• Disentangling Semantics and Syntax in Sentence Embeddings with Pre-trained Language Models
• The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understanding
• Super-resolving Dark Matter Halos using Generative Deep Learning
• Spectral Transform Forms Scalable Transformer
• SERE: Exploring Feature Self-relation for Self-supervised Transformer
• Are Compressed Language Models Less Subgroup Robust?
• Finetuning Pretrained Transformers into Variational Autoencoders
• Symbolic Music Loop Generation with VQ-VAE
• Unsupervised Extractive Summarization by Human Memory Simulation
• Neural network emulator to constrain the high-$z$ IGM thermal state from Lyman-$\alpha$ forest flux auto-correlation function
• CAST: Enhancing Code Summarization with Hierarchical Splitting and Reconstruction of Abstract Syntax Trees
• BioLeaF: A Bio-plausible Learning Framework for Training of Spiking Neural Networks
• On the Significance of Question Encoder Sequence Model in the Out-of-Distribution Performance in Visual Question Answering
• Extracting and filtering paraphrases by bridging natural language inference and paraphrasing
• Towards Explainable Fact Checking
• Modular Self-Supervision for Document-Level Relation Extraction
• Volumization as a Natural Generalization of Weight Decay
• Comparing Classes of Estimators: When does Gradient Descent Beat Ridge Regression in Linear Models?
• WASSA@IITK at WASSA 2021: Multi-task Learning and Transformer Finetuning for Emotion Classification and Empathy Prediction
• A Corpus of Controlled Opinionated and Knowledgeable Movie Discussions for Training Neural Conversation Models
• Noise Stability Regularization for Improving BERT Fine-tuning
• Deploying a BERT-based Query-Title Relevance Classifier in a Production System: a View from the Trenches
• Opinion Prediction with User Fingerprinting
• Measurement of Hybrid Rocket Solid Fuel Regression Rate for a Slab Burner using Deep Learning
• Netmarble AI Center's WMT21 Automatic Post-Editing Shared Task Submission
• Spatially Constrained Transformer with Efficient Global Relation Modelling for Spatio-Temporal Prediction
• Ripple Attention for Visual Perception with Sub-quadratic Complexity
• Direct reconstruction of the Reionization history from 21cm 2D Power Spectra
• Multi-illuminant Color Constancy via Multi-scale Illuminant Estimation and Fusion
• Trident Pyramid Networks: The importance of processing at the feature pyramid level for better object detection
• MOLUCINATE: A Generative Model for Molecules in 3D Space
• Evaluating Transferability of BERT Models on Uralic Languages
• MapReader: A Computer Vision Pipeline for the Semantic Exploration of Maps at Scale
• Beyond the Tip of the Iceberg: Assessing Coherence of Text Classifiers
• Towards Comprehensive Monocular Depth Estimation: Multiple Heads Are Better Than One
• Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understanding
• Want to Identify, Extract and Normalize Adverse Drug Reactions in Tweets? Use RoBERTa
• Exact Backpropagation in Binary Weighted Networks with Group Weight Transformations
• Contrastive Domain Adaptation for Question Answering using Limited Text Corpora
• Improving Multimodal fusion via Mutual Dependency Maximisation
• Table-based Fact Verification with Salience-aware Learning
• Data-to-text Generation by Splicing Together Nearest Neighbors
• Transforming Multi-Conditioned Generation from Meaning Representation
• Deep Learning Based Vehicle Tracking System Using License Plate Detection And Recognition
• Coarse-to-Fine Memory Matching for Joint Retrieval and Classification
• MIX : a Multi-task Learning Approach to Solve Open-Domain Question Answering
• Speech Imagery Classification using Length-Wise Training based on Deep Learning
• 3rd Place Solution for NeurIPS 2021 Shifts Challenge: Vehicle Motion Prediction
• Understanding Emotion Valence is a Joint Deep Learning Task
• X-SRL: A Parallel Cross-Lingual Semantic Role Labeling Dataset
• UniRE: A Unified Label Space for Entity Relation Extraction
• Generation and Simulation of Yeast Microscopy Imagery with Deep Learning
• Vision Pair Learning: An Efficient Training Framework for Image Classification
• Aspect-Based Argument Mining
• The Second Place Solution for ICCV2021 VIPriors Instance Segmentation Challenge
• Dialogue Inspectional Summarization with Factual Inconsistency Awareness
• MeLT: Message-Level Transformer with Masked Document Representations as Pre-Training for Stance Detection
• Generative Optimization Networks for Memory Efficient Data Generation
• Context Normalization Layer with Applications
• Connect-the-Dots: Bridging Semantics between Words and Definitions via Aligning Word Sense Inventories
• REPT: Bridging Language Models and Machine Reading Comprehension via Retrieval-Based Pre-training
• ComQA:Compositional Question Answering via Hierarchical Graph Neural Networks
• Automatic travel pattern extraction from visa page stamps using CNN models
• Towards Incremental Transformers: An Empirical Analysis of Transformer Models for Incremental NLU
• Object Tracking by Detection with Visual and Motion Cues
• SQALER: Scaling Question Answering by Decoupling Multi-Hop and Logical Reasoning
• DIVE: Towards Descriptive and Diverse Visual Commonsense Generation
• SFTrack++: A Fast Learnable Spectral Segmentation Approach for Space-Time Consistent Tracking
• Sinusoidal Flow: A Fast Invertible Autoregressive Flow
• An Explicit-Joint and Supervised-Contrastive Learning Framework for Few-Shot Intent Classification and Slot Filling
• Semi-Relaxed Quantization with DropBits: Training Low-Bit Neural Networks via Bit-wise Regularization
• MaskBEV: Joint Object Detection and Footprint Completion for Bird's-eye View 3D Point Clouds
• LMVE at SemEval-2020 Task 4: Commonsense Validation and Explanation using Pretraining Language Model
• Event-Driven Learning of Systematic Behaviours in Stock Markets
• Efficient Kilometer-Scale Precipitation Downscaling with Conditional Wavelet Diffusion
• MarioNette: Self-Supervised Sprite Learning
• How semantic and geometric information mutually reinforce each other in ToF object localization
• MapRE: An Effective Semantic Mapping Approach for Low-resource Relation Extraction
• To Share or not to Share: Predicting Sets of Sources for Model Transfer Learning
• EEG-Driven Image Reconstruction with Saliency-Guided Diffusion Models
• Adaptive Gradient Method with Resilience and Momentum
• Neural Ray-Tracing: Learning Surfaces and Reflectance for Relighting and View Synthesis
• Softer Pruning, Incremental Regularization
• Retrieval Enhanced Model for Commonsense Generation
• Segmentation-Based Bounding Box Generation for Omnidirectional Pedestrian Detection
• ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market Domain
• Exploring Task Difficulty for Few-Shot Relation Extraction
• MIPT-NSU-UTMN at SemEval-2021 Task 5: Ensembling Learning with Pre-trained Language Models for Toxic Spans Detection