70 citations · 357 across the 62 of their papers we have counts for
17 papers · 1 filter
Spoken Language Understanding for Conversational AI: Recent Advances and Future Direction
Soyeon Caren Han, Siqu Long, Henry Weld +1
When a human communicates with a machine using natural language on the web and online, how can it understand the human's intention and semantic context of their talk? This is an im…
SceneGATE: Scene-Graph based co-Attention networks for TExt visual question answering
Feiqi Cao, Siwen Luo, Felipe Nunez +3
Most TextVQA approaches focus on the integration of objects, scene texts and question words by a simple transformer encoder. But this fails to capture the semantic relations betwee…
PiggyBack: Pretrained Visual Question Answering Environment for Backing up Non-deep Learning Professionals
Zhihao Zhang, Siwen Luo, Junyi Chen +4
We propose a PiggyBack, a Visual Question Answering platform that allows users to apply the state-of-the-art visual-language pretrained models easily. The PiggyBack supports the fu…
SG-Shuffle: Multi-aspect Shuffle Transformer for Scene Graph Generation
Anh Duc Bui, Soyeon Caren Han, Josiah Poon
Scene Graph Generation (SGG) serves a comprehensive representation of the images for human understanding as well as visual understanding tasks. Due to the long tail bias problem of…
In-game Toxic Language Detection: Shared Task and Attention Residuals
Yuanzhe Jia, Weixuan Wu, Feiqi Cao +1
In-game toxic language becomes the hot potato in the gaming industry and community. There have been several online game toxicity analysis frameworks and models proposed. However, i…
SUPER-Rec: SUrrounding Position-Enhanced Representation for Recommendation
Taejun Lim, Siqu Long, Josiah Poon +1
Collaborative filtering problems are commonly solved based on matrix completion techniques which recover the missing values of user-item interaction matrices. In a matrix, the rati…
K-MHaS: A Multi-label Hate Speech Detection Dataset in Korean Online News Comment
Jean Lee, Taejun Lim, Heejun Lee +4
Online hate speech detection has become an important issue due to the growth of online content, but resources in languages other than English are extremely limited. We introduce K-…
Understanding Attention for Vision-and-Language Tasks
Feiqi Cao, Soyeon Caren Han, Siqu Long +2
Attention mechanism has been used as an important component across Vision-and-Language(VL) tasks in order to bridge the semantic gap between visual and textual features. While atte…
Doc-GCN: Heterogeneous Graph Convolutional Networks for Document Layout Analysis
Siwen Luo, Yihao Ding, Siqu Long +2
Recognizing the layout of unstructured digital documents is crucial when parsing the documents into the structured, machine-readable format for downstream applications. Recent stud…
A Quantitative and Qualitative Analysis of Suicide Ideation Detection using Deep Learning
Siqu Long, Rina Cabral, Josiah Poon +1
For preventing youth suicide, social media platforms have received much attention from researchers. A few researches apply machine learning, or deep learning-based text classificat…
InducT-GCN: Inductive Graph Convolutional Networks for Text Classification
Kunze Wang, Soyeon Caren Han, Josiah Poon
Text classification aims to assign labels to textual units by making use of global information. Recent studies have applied graph neural network (GNN) to capture the global word co…
V-Doc : Visual questions answers with Documents
Yihao Ding, Zhe Huang, Runlin Wang +5
We propose V-Doc, a question-answering tool using document images and PDF, mainly for researchers and general non-deep learning experts looking to generate, process, and understand…
RoViST:Learning Robust Metrics for Visual Storytelling
Eileen Wang, Caren Han, Josiah Poon
Visual storytelling (VST) is the task of generating a story paragraph that describes a given image sequence. Most existing storytelling approaches have evaluated their models using…
Vision-and-Language Pretrained Models: A Survey
Siqu Long, Feiqi Cao, Soyeon Caren Han +1
Pretrained models have produced great success in both Computer Vision (CV) and Natural Language Processing (NLP). This progress leads to learning joint representations of vision an…
ME-GCN: Multi-dimensional Edge-Embedded Graph Convolutional Networks for Semi-supervised Text Classification
Kunze Wang, Soyeon Caren Han, Siqu Long +1
Compared to sequential learning models, graph-based neural networks exhibit excellent ability in capturing global information and have been used for semi-supervised learning tasks.…
Understanding Graph Convolutional Networks for Text Classification
Soyeon Caren Han, Zihan Yuan, Kunze Wang +2
Graph Convolutional Networks (GCN) have been effective at tasks that have rich relational structure and can preserve global structure information of a dataset in graph embeddings.…
Bi-directional Joint Neural Networks for Intent Classification and Slot Filling
Soyeon Caren Han, Siqu Long, Huichun Li +2
Intent classification and slot filling are two critical tasks for natural language understanding. Traditionally the two tasks proceeded independently. However, more recently joint…