Knowledge Infused Learning (K-IL): Towards Deep Incorporation of Knowledge in Deep Learning

Abstract

Learning the underlying patterns in data goes beyond instance-based generalization to external knowledge represented in structured graphs or networks. Deep learning that primarily constitutes neural computing stream in AI has shown significant advances in probabilistically learning latent patterns using a multi-layered network of computational nodes (i.e., neurons/hidden units). Structured knowledge that underlies symbolic computing approaches and often supports reasoning, has also seen significant growth in recent years, in the form of broad-based (e.g., DBPedia, Yago) and domain, industry or application specific knowledge graphs. A common substrate with careful integration of the two will raise opportunities to develop neuro-symbolic learning approaches for AI, where conceptual and probabilistic representations are combined. As the incorporation of external knowledge will aid in supervising the learning of features for the model, deep infusion of representational knowledge from knowledge graphs within hidden layers will further enhance the learning process. Although much work remains, we believe that knowledge graphs will play an increasing role in developing hybrid neuro-symbolic intelligent systems (bottom-up deep learning with top-down symbolic computing) as well as in building explainable AI systems for which knowledge graphs will provide scaffolding for punctuating neural computing. In this position paper, we describe our motivation for such a neuro-symbolic approach and framework that combines knowledge graph and neural networks.

References in corpus (8)

• Distilling the Knowledge in a Neural Network
• ERNIE: Enhanced Representation through Knowledge Integration
• Modeling Islamist Extremist Communications on Social Media using Contextual Dimensions: Religion, Ideology, and Hate
• Learning Domain-Specific Word Embeddings from Sparse Cybersecurity Texts
• Random deep neural networks are biased towards simple functions
• Explaining Trained Neural Networks with Semantic Web Technologies: First Steps
• Implicit Entity Linking in Tweets
• Infusing domain knowledge in AI-based "black box" models for better explainability with application in bankruptcy prediction

Cited by in corpus (6)

• Explainable Artificial Intelligence Approaches: A Survey
• Principles to Practices for Responsible AI: Closing the Gap
• Characterization of Time-variant and Time-invariant Assessment of Suicidality on Reddit using C-SSRS
• Incorporating Symbolic Domain Knowledge into Graph Neural Networks
• "Is depression related to cannabis?": A knowledge-infused model for Entity and Relation Extraction with Limited Supervision
• Depressive, Drug Abusive, or Informative: Knowledge-aware Study of News Exposure during COVID-19 Outbreak