27 citations · 36 across the 13 of their papers we have counts for
14 papers
Train a Unified Multimodal Data Quality Classifier with Synthetic Data
Weizhi Wang, Rongmei Lin, Shiyang Li +7
The Multimodal Large Language Models (MLLMs) are continually pre-trained on a mixture of image-text caption data and interleaved document data, while the high-quality data filterin…
Multimodal Policy Internalization for Conversational Agents
Zhenhailong Wang, Jiateng Liu, Amin Fazel +6
Modern conversational agents like ChatGPT and Alexa+ rely on predefined policies specifying metadata, response styles, and tool-usage rules. As these LLM-based systems expand to su…
DocTalk: Scalable Graph-based Dialogue Synthesis for Enhancing LLM Conversational Capabilities
Jing Yang Lee, Hamed Bonab, Nasser Zalmout +6
Large Language Models (LLMs) are increasingly employed in multi-turn conversational tasks, yet their pre-training data predominantly consists of continuous prose, creating a potent…
Shopping MMLU: A Massive Multi-Task Online Shopping Benchmark for Large Language Models
Yilun Jin, Zheng Li, Chenwei Zhang +19
Online shopping is a complex multi-task, few-shot learning problem with a wide and evolving range of entities, relations, and tasks. However, existing models and benchmarks are com…
Noise-Aware Training of Layout-Aware Language Models
Ritesh Sarkhel, Xiaoqi Ren, Lauro Beltrao Costa +5
A visually rich document (VRD) utilizes visual features along with linguistic cues to disseminate information. Training a custom extractor that identifies named entities from a doc…
Cross-Modal Entity Matching for Visually Rich Documents
Ritesh Sarkhel, Arnab Nandi
Visually rich documents (e.g. leaflets, banners, magazine articles) are physical or digital documents that utilize visual cues to augment their semantics. Information contained in…
Label-Efficient Self-Training for Attribute Extraction from Semi-Structured Web Documents
Ritesh Sarkhel, Binxuan Huang, Colin Lockard +1
Extracting structured information from HTML documents is a long-studied problem with a broad range of applications, including knowledge base construction, faceted search, and perso…
A Skip-connected Multi-column Network for Isolated Handwritten Bangla Character and Digit recognition
Animesh Singh, Ritesh Sarkhel, Nibaran Das +2
Finding local invariant patterns in handwrit-ten characters and/or digits for optical character recognition is a difficult task. Variations in writing styles from one person to ano…
Interpretable Multi-Headed Attention for Abstractive Summarization at Controllable Lengths
Ritesh Sarkhel, Moniba Keymanesh, Arnab Nandi +1
Abstractive summarization at controllable lengths is a challenging task in natural language processing. It is even more challenging for domains where limited training data is avail…
A Genetic Algorithm based Kernel-size Selection Approach for a Multi-column Convolutional Neural Network
Animesh Singh, Sandip Saha, Ritesh Sarkhel +3
Deep neural network-based architectures give promising results in various domains including pattern recognition. Finding the optimal combination of the hyper-parameters of such a l…
Using dynamic routing to extract intermediate features for developing scalable capsule networks
Bodhisatwa Mandal, Swarnendu Ghosh, Ritesh Sarkhel +2
Capsule networks have gained a lot of popularity in short time due to its unique approach to model equivariant class specific properties as capsules from images. However the dynami…
Handwritten Indic Character Recognition using Capsule Networks
Bodhisatwa Mandal, Suvam Dubey, Swarnendu Ghosh +2
Convolutional neural networks(CNNs) has become one of the primary algorithms for various computer vision tasks. Handwritten character recognition is a typical example of such task…
Combining Multi-level Contexts of Superpixel using Convolutional Neural Networks to perform Natural Scene Labeling
Aritra Das, Swarnendu Ghosh, Ritesh Sarkhel +3
Modern deep learning algorithms have triggered various image segmentation approaches. However most of them deal with pixel based segmentation. However, superpixels provide a certai…
An Enhanced Harmony Search Method for Bangla Handwritten Character Recognition Using Region Sampling
Ritesh Sarkhel, Amit K Saha, Nibaran Das
Identification of minimum number of local regions of a handwritten character image, containing well-defined discriminating features which are sufficient for a minimal but complete…