326 citations · 439 across the 15 of their papers we have counts for
16 papers
When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards
Norah Alzahrani, Hisham Abdullah Alyahya, Yazeed Alnumay +9
Large Language Model (LLM) leaderboards based on benchmark rankings are regularly used to guide practitioners in model selection. Often, the published leaderboard rankings are take…
AI for IT Operations (AIOps) on Cloud Platforms: Reviews, Opportunities and Challenges
Qian Cheng, Doyen Sahoo, Amrita Saha +6
Artificial Intelligence for IT operations (AIOps) aims to combine the power of AI with the big data generated by IT Operations processes, particularly in cloud infrastructures, to…
LogAI: A Library for Log Analytics and Intelligence
Qian Cheng, Amrita Saha, Wenzhuo Yang +3
Software and System logs record runtime information about processes executing within a system. These logs have become the most critical and ubiquitous forms of observability data t…
Learning Label Modular Prompts for Text Classification in the Wild
Hailin Chen, Amrita Saha, Shafiq Joty +1
Machine learning models usually assume i.i.d data during training and testing, but data and tasks in real world often change over time. To emulate the transient nature of real worl…
Vector-Quantized Input-Contextualized Soft Prompts for Natural Language Understanding
Rishabh Bhardwaj, Amrita Saha, Steven C. H. Hoi +1
Prompt Tuning has been largely successful as a parameter-efficient method of conditioning large-scale pre-trained language models to perform downstream tasks. Thus far, soft prompt…
Mining Root Cause Knowledge from Cloud Service Incident Investigations for AIOps
Amrita Saha, Steven C. H. Hoi
Root Cause Analysis (RCA) of any service-disrupting incident is one of the most critical as well as complex tasks in IT processes, especially for cloud industry leaders like Salesf…
Merlion: A Machine Learning Library for Time Series
Aadyot Bhatnagar, Paul Kassianik, Chenghao Liu +20
We introduce Merlion, an open-source machine learning library for time series. It features a unified interface for many commonly used models and datasets for anomaly detection and…
Weakly Supervised Neuro-Symbolic Module Networks for Numerical Reasoning
Amrita Saha, Shafiq Joty, Steven C. H. Hoi
Neural Module Networks (NMNs) have been quite successful in incorporating explicit reasoning as learnable modules in various question answering tasks, including the most generic fo…
Scene Graph based Image Retrieval -- A case study on the CLEVR Dataset
Sahana Ramnath, Amrita Saha, Soumen Chakrabarti +1
With the prolification of multimodal interaction in various domains, recently there has been much interest in text based image retrieval in the computer vision community. However m…
DuoRC: Towards Complex Language Understanding with Paraphrased Reading Comprehension
Amrita Saha, Rahul Aralikatte, Mitesh M. Khapra +1
We propose DuoRC, a novel dataset for Reading Comprehension (RC) that motivates several new challenges for neural approaches in language understanding beyond those offered by exist…
Complex Sequential Question Answering: Towards Learning to Converse Over Linked Question Answer Pairs with a Knowledge Graph
Amrita Saha, Vardaan Pahuja, Mitesh M. Khapra +2
While conversing with chatbots, humans typically tend to ask many questions, a significant portion of which can be answered by referring to large-scale knowledge graphs (KG). While…
Towards Building Large Scale Multimodal Domain-Aware Conversation Systems
Amrita Saha, Mitesh Khapra, Karthik Sankaranarayanan
While multimodal conversation agents are gaining importance in several domains such as retail, travel etc., deep learning research in this area has been limited primarily due to th…
A Correlational Encoder Decoder Architecture for Pivot Based Sequence Generation
Amrita Saha, Mitesh M. Khapra, Sarath Chandar +2
Interlingua based Machine Translation (MT) aims to encode multiple languages into a common linguistic representation and then decode sentences in multiple target languages from thi…
Taxonomy grounded aggregation of classifiers with different label sets
Amrita Saha, Sathish Indurthi, Shantanu Godbole +2
We describe the problem of aggregating the label predictions of diverse classifiers using a class taxonomy. Such a taxonomy may not have been available or referenced when the indiv…
An Autoencoder Approach to Learning Bilingual Word Representations
Sarath Chandar A P, Stanislas Lauly, Hugo Larochelle +4
Cross-language learning allows us to use training data from one language to build models for a different language. Many approaches to bilingual learning require that we have word-l…
Multisource Adaptive Data Distribution and Routing in Wireless Sensor Networks
Subhabrata Mukherjee, Amrita Saha, Mrinal K. Naskar +1
The wireless sensor network is a collection of energy-constrained nodes. Their objective is to sense, collect and process information for some ad-hoc purpose. Typically the nodes a…