Distributed Representations of Sentences and Documents
arXiv:1405.4053
Abstract
Many machine learning algorithms require the input to be represented as a fixed-length feature vector. When it comes to texts, one of the most common fixed-length features is bag-of-words. Despite their popularity, bag-of-words features have two major weaknesses: they lose the ordering of the words and they also ignore semantics of the words. For example, "powerful," "strong" and "Paris" are equally distant. In this paper, we propose Paragraph Vector, an unsupervised algorithm that learns fixed-length feature representations from variable-length pieces of texts, such as sentences, paragraphs, and documents. Our algorithm represents each document by a dense vector which is trained to predict words in the document. Its construction gives our algorithm the potential to overcome the weaknesses of bag-of-words models. Empirical results show that Paragraph Vectors outperform bag-of-words models as well as other techniques for text representations. Finally, we achieve new state-of-the-art results on several text classification and sentiment analysis tasks.
References in corpus (2)
Cited by in corpus (286)
- Learning Transferable Visual Models From Natural Language Supervision
- LINE: Large-scale Information Network Embedding
- Skip-Thought Vectors
- Learning with Pseudo-Ensembles
- Neural Rating Regression with Abstractive Tips Generation for Recommendation
- Self-Taught Convolutional Neural Networks for Short Text Clustering
- MDFEND: Multi-domain Fake News Detection
- Representation learning for very short texts using weighted word embedding aggregation
- Arabic natural language processing: An overview
- Meta-Prod2Vec - Product Embeddings Using Side-Information for Recommendation
- A Review-aware Graph Contrastive Learning Framework for Recommendation
- Twin Contrastive Learning for Online Clustering
- Parameter-Efficient Transfer Learning for NLP
- Tweet2Vec: Learning Tweet Embeddings Using Character-level CNN-LSTM Encoder-Decoder
- Self-supervised Learning on Graphs: Deep Insights and New Direction
- MVD: Memory-Related Vulnerability Detection Based on Flow-Sensitive Graph Neural Networks
- Domain Adaptive Fake News Detection via Reinforcement Learning
- Modelling, Visualising and Summarising Documents with a Single Convolutional Neural Network
- It's All in the Embedding! Fake News Detection Using Document Embeddings
- Learning Latent Vector Spaces for Product Search
- Representation Learning for Natural Language Processing
- Jointly Learning Word Embeddings and Latent Topics
- Hierarchical Neural Language Models for Joint Representation of Streaming Documents and their Content
- A Scalable Hybrid Research Paper Recommender System for Microsoft Academic
- Revisiting LSTM Networks for Semi-Supervised Text Classification via Mixed Objective Function
- Latent Heterogeneous Graph Network for Incomplete Multi-View Learning
- Automating the search for a patent's prior art with a full text similarity search
- Deep Memory Networks for Attitude Identification
- Stance Detection with BERT Embeddings for Credibility Analysis of Information on Social Media
- Dialogue Act Classification with Context-Aware Self-Attention
- A Survey of Active Learning for Text Classification using Deep Neural Networks
- Deep Learning Sentiment Analysis of Amazon.com Reviews and Ratings
- Code Search based on Context-aware Code Translation
- Triaging Content Severity in Online Mental Health Forums
- Improving Item Cold-start Recommendation via Model-agnostic Conditional Variational Autoencoder
- Self-Adaptive Hierarchical Sentence Model
- Aspect-Based Sentiment Analysis Using a Two-Step Neural Network Architecture
- End-to-End Resume Parsing and Finding Candidates for a Job Description using BERT
- A Multiplicative Model for Learning Distributed Text-Based Attribute Representations
- Research Status of Deep Learning Methods for Rumor Detection
- On Event-Driven Knowledge Graph Completion in Digital Factories
- Inductive Representation Learning on Temporal Graphs
- Corpus-Based Paraphrase Detection Experiments and Review
- Comparative Analysis of Word Embeddings for Capturing Word Similarities
- Network representation learning systematic review: ancestors and current development state
- A Neural Topic-Attention Model for Medical Term Abbreviation Disambiguation
- Off the Beaten Path: Let's Replace Term-Based Retrieval with k-NN Search
- "A Passage to India": Pre-trained Word Embeddings for Indian Languages
- A Semantics-Based Hybrid Approach on Binary Code Similarity Comparison
- Pre-Training Graph Neural Networks for Generic Structural Feature Extraction
- Identifying long-term periodic cycles and memories of collective emotion in online social media
- SentiGOLD: A Large Bangla Gold Standard Multi-Domain Sentiment Analysis Dataset and its Evaluation
- Local Translation Prediction with Global Sentence Representation
- Fake Reviews Detection through Ensemble Learning
- HeteGCN: Heterogeneous Graph Convolutional Networks for Text Classification
- Mind the Nuisance: Gaussian Process Classification using Privileged Noise
- Fairness in Clustering with Multiple Sensitive Attributes
- I Am Not What I Write: Privacy Preserving Text Representation Learning
- A Knowledge-Enhanced Pretraining Model for Commonsense Story Generation
- An empirical comparison of deep-neural-network architectures for next activity prediction using context-enriched process event logs
- Exploring Author Context for Detecting Intended vs Perceived Sarcasm
- Network-based Fake News Detection: A Pattern-driven Approach
- Deep Learning in Protein Structural Modeling and Design
- Learning Blended, Precise Semantic Program Embeddings
- An Unsupervised Domain-Independent Framework for Automated Detection of Persuasion Tactics in Text
- Enhancing Rumor Detection in Social Media Using Dynamic Propagation Structures
- Aspect-Based Relational Sentiment Analysis Using a Stacked Neural Network Architecture
- Deep Multi-Instance Transfer Learning
- Investigating the Effectiveness of Representations Based on Pretrained Transformer-based Language Models in Active Learning for Labelling Text Datasets
- Methods for Computing Legal Document Similarity: A Comparative Study
- Deep Representation Learning for Social Network Analysis
- Automatic Labelling of Topics with Neural Embeddings
- Entity Linking Meets Deep Learning: Techniques and Solutions
- Sherlock: A Deep Learning Approach to Semantic Data Type Detection
- Learning To Rank Resources with GNN
- Improving a tf-idf weighted document vector embedding
- PYInfer: Deep Learning Semantic Type Inference for Python Variables
- Fine-grained Event Categorization with Heterogeneous Graph Convolutional Networks
- Identifying emergency stages in Facebook posts of police departments with convolutional and recurrent neural networks and support vector machines
- Vector representations of text data in deep learning
- OCC: A Smart Reply System for Efficient In-App Communications
- Efficient Feature Selection techniques for Sentiment Analysis
- Deep learning for time series classification
- InferCode: Self-Supervised Learning of Code Representations by Predicting Subtrees
- Emerging App Issue Identification via Online Joint Sentiment-Topic Tracing
- OSS effort estimation using software features similarity and developer activity-based metrics
- Learning Ideological Embeddings from Information Cascades
- Semantic Labeling Using a Deep Contextualized Language Model
- Document Embedding for Scientific Articles: Efficacy of Word Embeddings vs TFIDF
- ToxCCIn: Toxic Content Classification with Interpretability
- Integration of Static and Dynamic Analysis for Malware Family Classification with Composite Neural Network
- A multi-label classification method using a hierarchical and transparent representation for paper-reviewer recommendation
- ParVecMF: A Paragraph Vector-based Matrix Factorization Recommender System
- Investigating the Effectiveness of Representations Based on Word-Embeddings in Active Learning for Labelling Text Datasets
- Improving Document Classification with Multi-Sense Embeddings
- Graph Classification via Deep Learning with Virtual Nodes
- Results of a Single Blind Literary Taste Test with Short Anonymized Novel Fragments
- Word and Document Embeddings based on Neural Network Approaches
- Will this Course Increase or Decrease Your GPA? Towards Grade-aware Course Recommendation
- Context Aware Machine Learning
- Correlation Coefficients and Semantic Textual Similarity
- Provably Secure Generative Linguistic Steganography
- Doc2Vec on the PubMed corpus: study of a new approach to generate related articles
- Automatic Quality Assessment of Wikipedia Articles -- A Systematic Literature Review
- LibertyMFD: A Lexicon to Assess the Moral Foundation of Liberty
- Making sense of violence risk predictions using clinical notes
- Semantic Classification of Tabular Datasets via Character-Level Convolutional Neural Networks
- Evaluating Representation Learning of Code Changes for Predicting Patch Correctness in Program Repair
- BERT2Code: Can Pretrained Language Models be Leveraged for Code Search?
- Quantifying the Dissimilarity of Texts
- Towards a Flexible Embedding Learning Framework
- Sentiment Analysis of Code-Mixed Social Media Text (Hinglish)
- Company2Vec -- German Company Embeddings based on Corporate Websites
- Ordering-sensitive and Semantic-aware Topic Modeling
- Audio-Linguistic Embeddings for Spoken Sentences
- Real-Time Steganalysis for Stream Media Based on Multi-channel Convolutional Sliding Windows
- Two-path Deep Semi-supervised Learning for Timely Fake News Detection
- SoulMate: Short-text author linking through Multi-aspect temporal-textual embedding
- Learning from Fact-checkers: Analysis and Generation of Fact-checking Language
- R-VGAE: Relational-variational Graph Autoencoder for Unsupervised Prerequisite Chain Learning
- DeepHunter: A Graph Neural Network Based Approach for Robust Cyber Threat Hunting
- Automatic coding of students' writing via Contrastive Representation Learning in the Wasserstein space
- Zero-Shot Learning with Knowledge Enhanced Visual Semantic Embeddings
- CTAL: Pre-training Cross-modal Transformer for Audio-and-Language Representations
- A News-based Machine Learning Model for Adaptive Asset Pricing
- Understanding the Effectiveness of Reviews in E-commerce Top-N Recommendation
- Log-based Anomaly Detection Without Log Parsing
- Exploiting Behavioral Consistence for Universal User Representation
- Discovering Supply Chain Links with Augmented Intelligence
- Saec: Similarity-Aware Embedding Compression in Recommendation Systems
- Citation Recommendations Considering Content and Structural Context Embedding
- Tree Structure-Aware Graph Representation Learning via Integrated Hierarchical Aggregation and Relational Metric Learning
- Semantic Entity Enrichment by Leveraging Multilingual Descriptions for Link Prediction
- Modeling Product Search Relevance in e-Commerce
- Transformer based Multilingual document Embedding model
- Phishing Detection through Email Embeddings
- Compressed Deep Networks: Goodbye SVD, Hello Robust Low-Rank Approximation
- Wasserstein-Fisher-Rao Document Distance
- Privacy Policy Question Answering Assistant: A Query-Guided Extractive Summarization Approach
- Global and Local Feature Learning for Ego-Network Analysis
- DeepSoft: A vision for a deep model of software
- Dual-Attention Graph Convolutional Network
- One Size Fits Many: Column Bundle for Multi-X Learning
- Terminology-based Text Embedding for Computing Document Similarities on Technical Content
- Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? A Comprehensive Assessment for Catalan
- Pretrained Embeddings for E-commerce Machine Learning: When it Fails and Why?
- Unsupervised Document Embedding via Contrastive Augmentation
- Positive emotions help rank negative reviews in e-commerce
- A Scalable Chatbot Platform Leveraging Online Community Posts: A Proof-of-Concept Study
- Automating concept-drift detection by self-evaluating predictive model degradation
- Vector of Locally-Aggregated Word Embeddings (VLAWE): A Novel Document-level Representation
- Structural-Aware Sentence Similarity with Recursive Optimal Transport
- Research Progress of News Recommendation Methods
- Urban2Vec: Incorporating Street View Imagery and POIs for Multi-Modal Urban Neighborhood Embedding
- Semantic Product Search for Matching Structured Product Catalogs in E-Commerce
- Creative Procedural-Knowledge Extraction From Web Design Tutorials
- DEBACER: a method for slicing moderated debates
- Zero-Shot Clinical Acronym Expansion via Latent Meaning Cells
- SchenQL -- A Domain-Specific Query Language on Bibliographic Metadata
- Learning to Distill: The Essence Vector Modeling Framework
- Sentence Embeddings by Ensemble Distillation
- Learning Word Embeddings from Intrinsic and Extrinsic Views
- Global Textual Relation Embedding for Relational Understanding
- A Topological Method for Comparing Document Semantics
- MRNN: A Multi-Resolution Neural Network with Duplex Attention for Document Retrieval in the Context of Question Answering
- Automated Cause Analysis of Latency Outliers Using System-Level Dependency Graphs
- Analysis of Moral Judgement on Reddit
- Drug Package Recommendation via Interaction-aware Graph Induction
- AMAD: Adversarial Multiscale Anomaly Detection on High-Dimensional and Time-Evolving Categorical Data
- Evaluating Semantic Interaction on Word Embeddings via Simulation
- RIPML: A Restricted Isometry Property based Approach to Multilabel Learning
- Rumour Detection via News Propagation Dynamics and User Representation Learning
- Automated Empathy Detection for Oncology Encounters
- A Comprehensive Review on Summarizing Financial News Using Deep Learning
- Hierarchical Document Encoder for Parallel Corpus Mining
- Adversarial Training Based Multi-Source Unsupervised Domain Adaptation for Sentiment Analysis
- Automatic learner summary assessment for reading comprehension
- Prioritization of COVID-19-related literature via unsupervised keyphrase extraction and document representation learning
- Fake News Detection through Graph Comment Advanced Learning
- Towards Understanding the Information Ecosystem Through the Lens of Multiple Web Communities
- Can AI Generate Love Advice?: Toward Neural Answer Generation for Non-Factoid Questions
- The Longer the Better? The Interplay Between Review Length and Line of Argumentation in Online Consumer Reviews
- SEEC: Semantic Vector Federation across Edge Computing Environments
- An Intelligent CNN-VAE Text Representation Technology Based on Text Semantics for Comprehensive Big Data
- Sensitive Information Detection: Recursive Neural Networks for Encoding Context
- Review Regularized Neural Collaborative Filtering
- Text Classification based on Multi-granularity Attention Hybrid Neural Network
- Future Vector Enhanced LSTM Language Model for LVCSR
- Bot-Match: Social Bot Detection with Recursive Nearest Neighbors Search
- "When and Where?": Behavior Dominant Location Forecasting with Micro-blog Streams
- Unsupervised Graph Representation by Periphery and Hierarchical Information Maximization
- P-SIF: Document Embeddings Using Partition Averaging
- Sentence transition matrix: An efficient approach that preserves sentence semantics
- Towards Reliable Online Clickbait Video Detection: A Content-Agnostic Approach
- Formal models of Structure Building in Music, Language and Animal Songs
- Persistence Homology of TEDtalk: Do Sentence Embeddings Have a Topological Shape?
- Graph-Based Tri-Attention Network for Answer Ranking in CQA
- ANDRUSPEX : Leveraging Graph Representation Learning to Predict Harmful App Installations on Mobile Devices
- 2-D Embedding of Large and High-dimensional Data with Minimal Memory and Computational Time Requirements
- A Universal Model for Cross Modality Mapping by Relational Reasoning
- Interest-Related Item Similarity Model Based on Multimodal Data for Top-N Recommendation
- Effect of Word Embedding Variable Parameters on Arabic Sentiment Analysis Performance
- On Detecting Data Pollution Attacks On Recommender Systems Using Sequential GANs
- An end-to-end Neural Network Framework for Text Clustering
- A Cross-lingual Natural Language Processing Framework for Infodemic Management
- Benchmarking Approximate Inference Methods for Neural Structured Prediction
- PAUSE: Positive and Annealed Unlabeled Sentence Embedding
- Joint Management and Analysis of Textual Documents and Tabular Data within the AUDAL Data Lake
- A Unified Framework for Cross-Domain and Cross-System Recommendations
- RelEmb: A relevance-based application embedding for Mobile App retrieval and categorization
- ProductNet: a Collection of High-Quality Datasets for Product Representation Learning
- Recurrent Neural Network from Adder's Perspective: Carry-lookahead RNN
- Estimating Fund-Raising Performance for Start-up Projects from a Market Graph Perspective
- Multimodal Ensemble Approach to Incorporate Various Types of Clinical Notes for Predicting Readmission
- Representation Learning for Words and Entities
- NeuType: A Simple and Effective Neural Network Approach for Predicting Missing Entity Type Information in Knowledge Bases
- Sequence-to-Set Semantic Tagging: End-to-End Multi-label Prediction using Neural Attention for Complex Query Reformulation and Automated Text Categorization
- Beyond Social Fragmentation: Coexistence of Cultural Diversity and Structural Connectivity Is Possible with Social Constituent Diversity
- Multi-label Categorization of Accounts of Sexism using a Neural Framework
- A Gaze into the Internal Logic of Graph Neural Networks, with Logic
- A Robotic Dating Coaching System Leveraging Online Communities Posts
- Recommendation Chart of Domains for Cross-Domain Sentiment Analysis:Findings of A 20 Domain Study
- How Does That Sound? Multi-Language SpokenName2Vec Algorithm Using Speech Generation and Deep Learning
- A New Approach for Topic Detection using Adaptive Neural Networks
- It's Only Words And Words Are All I Have
- Estimating Early Fundraising Performance of Innovations via Graph-based Market Environment Model
- PaRe: A Paper-Reviewer Matching Approach Using a Common Topic Space
- Wikibook-Bot - Automatic Generation of a Wikipedia Book
- Utilizing FastText for Venue Recommendation
- Perceived and Intended Sarcasm Detection with Graph Attention Networks
- Inferring Substitutable and Complementary Products with Knowledge-Aware Path Reasoning based on Dynamic Policy Network
- Towards Informative Tagging of Code Fragments to Support the Investigation of Code Clones
- SentPWNet: A Unified Sentence Pair Weighting Network for Task-specific Sentence Embedding
- Document Similarity for Texts of Varying Lengths via Hidden Topics
- When Product Search Meets Collaborative Filtering: A Hierarchical Heterogeneous Graph Neural Network Approach
- Hybrid Improved Document-level Embedding (HIDE)
- Learning Directly from Grammar Compressed Text
- Unsupervised Keyphrase Extraction by Jointly Modeling Local and Global Context
- Clustering Vietnamese Conversations From Facebook Page To Build Training Dataset For Chatbot
- Text Classification Components for Detecting Descriptions and Names of CAD models
- Learning Outside the Box: Discourse-level Features Improve Metaphor Identification
- A neural document language modeling framework for spoken document retrieval
- Lifelong Neural Topic Learning in Contextualized Autoregressive Topic Models of Language via Informative Transfers
- DrugDBEmbed : Semantic Queries on Relational Database using Supervised Column Encodings
- Latin writing styles analysis with Machine Learning: New approach to old questions
- Security Apps under the Looking Glass: An Empirical Analysis of Android Security Apps
- Similarity Driven Approximation for Text Analytics
- Graph Convolutional Network with Generalized Factorized Bilinear Aggregation
- Seed Words Based Data Selection for Language Model Adaptation
- Modeling Coherency in Generated Emails by Leveraging Deep Neural Learners
- STRASS: A Light and Effective Method for Extractive Summarization Based on Sentence Embeddings
- Semantic Relatedness for Keyword Disambiguation: Exploiting Different Embeddings
- Online Handbook of Argumentation for AI: Volume 2
- Automatic Story Construction from News Articles in an Online Fashion
- Document Network Embedding: Coping for Missing Content and Missing Links
- Contextual Document Similarity for Content-based Literature Recommender Systems
- An End-to-End Framework for Cold Question Routing in Community Question Answering Services
- Parameter-Efficient Neural Question Answering Models via Graph-Enriched Document Representations
- Comparison of Turkish Word Representations Trained on Different Morphological Forms
- Towards Successful Social Media Advertising: Predicting the Influence of Commercial Tweets
- Classifying Math KCs via Task-Adaptive Pre-Trained BERT
- Correlations between Word Vector Sets
- DiffQue: Estimating Relative Difficulty of Questions in Community Question Answering Services
- Beyond Next Item Recommendation: Recommending and Evaluating List of Sequences
- Encouraging Paragraph Embeddings to Remember Sentence Identity Improves Classification
- Hierarchical Semantic Correspondence Learning for Post-Discharge Patient Mortality Prediction
- Can questions summarize a corpus? Using question generation for characterizing COVID-19 research
- SECTOR: A Neural Model for Coherent Topic Segmentation and Classification
- Wider Vision: Enriching Convolutional Neural Networks via Alignment to External Knowledge Bases
- Metaknowledge Extraction Based on Multi-Modal Documents
- Graph Classification Based on Skeleton and Component Features
- Open-domain Topic Identification of Out-of-domain Utterances using Wikipedia
- The Analysis from Nonlinear Distance Metric to Kernel-based Drug Prescription Prediction System
- Educational Content Linking for Enhancing Learning Need Remediation in MOOCs
- XtraLibD: Detecting Irrelevant Third-Party libraries in Java and Python Applications
- Neural-Network Guided Expression Transformation
- Multi-Channel Sequential Behavior Networks for User Modeling in Online Advertising
- A Topological Approach to Compare Document Semantics Based on a New Variant of Syntactic N-grams
- Mining Program Properties From Neural Networks Trained on Source Code Embeddings
- Analyzing the Hidden Activations of Deep Policy Networks: Why Representation Matters
- Modeling Dyadic Conversations for Personality Inference
- What Makes a Star Teacher? A Hierarchical BERT Model for Evaluating Teacher's Performance in Online Education
- Graph Convolutional Network for Swahili News Classification
- Fake News Data Collection and Classification: Iterative Query Selection for Opaque Search Engines with Pseudo Relevance Feedback
- Streaming Social Event Detection and Evolution Discovery in Heterogeneous Information Networks
- Improving Clinical Outcome Predictions Using Convolution over Medical Entities with Multimodal Learning