activity
20202024
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 1.3k across the 38 of their papers we have counts for

collaborators

39 papers

cs.LG2024★ 1 cited

Transformer Explainer: Learning LLM Transformers with Interactive Visual Explanation and Experimentation

Aeree Cho, Grace C. Kim, Alexander Karpekov +6

The Transformer architecture underpins modern large language models powering state-of-the-art text generation and AI applications. However, its complexity makes it difficult for no…

cs.IR2024★ 9 cited

MeMemo: On-device Retrieval Augmentation for Private and Personalized Text Generation

Zijie J. Wang, Duen Horng Chau

Retrieval-augmented text generation (RAG) addresses the common limitations of large language models (LLMs), such as hallucination, by retrieving information from an updatable exter…

cs.HC2024

Interactive Visual Learning for Stable Diffusion

Seongmin Lee, Benjamin Hoover, Hendrik Strobelt +7

Diffusion-based generative models' impressive ability to create convincing images has garnered global attention. However, their complex internal structures and operations often pos…

cs.CL2024★ 1 cited

LLM Attributor: Interactive Visual Attribution for LLM Generation

Seongmin Lee, Zijie J. Wang, Aishwarya Chakravarthy +5

While large language models (LLMs) have shown remarkable capability to generate convincing text across diverse domains, concerns around its potential risks have highlighted the imp…

cs.HC2024★ 56 cited

Farsight: Fostering Responsible AI Awareness During AI Application Prototyping

Zijie J. Wang, Chinmay Kulkarni, Lauren Wilcox +2

Prompt-based interfaces for Large Language Models (LLMs) have made prototyping and building AI-powered applications easier than ever before. However, identifying potential harms th…

cs.HC2024★ 4 cited

Wordflow: Social Prompt Engineering for Large Language Models

Zijie J. Wang, Aishwarya Chakravarthy, David Munechika +1

Large language models (LLMs) require well-crafted prompts for effective use. Prompt engineering, the process of designing prompts, is challenging, particularly for non-experts who…

cs.HC2023

VisGrader: Automatic Grading of D3 Visualizations

Matthew Hull, Vivian Pednekar, Hannah Murray +9

Manually grading D3 data visualizations is a challenging endeavor, and is especially difficult for large classes with hundreds of students. Grading an interactive visualization req…

cs.LG2023

REVAMP: Automated Simulations of Adversarial Attacks on Arbitrary Objects in Realistic Scenes

Matthew Hull, Zijie J. Wang, Duen Horng Chau

Deep Learning models, such as those used in an autonomous vehicle are vulnerable to adversarial attacks where an attacker could place an adversarial object in the environment, lead…

cs.LG2023★ 2 cited

WizMap: Scalable Interactive Visualization for Exploring Large Machine Learning Embeddings

Zijie J. Wang, Fred Hohman, Duen Horng Chau

Machine learning models often learn latent embedding representations that capture the domain semantics of their training data. These embedding representations are valuable for inte…

cs.CL2023★ 5 cited

Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusion

Seongmin Lee, Benjamin Hoover, Hendrik Strobelt +7

Diffusion-based generative models' impressive ability to create convincing images has garnered global attention. However, their complex structures and operations often pose challen…

cs.HC2023★ 12 cited

SuperNOVA: Design Strategies and Opportunities for Interactive Visualization in Computational Notebooks

Zijie J. Wang, David Munechika, Seongmin Lee +1

Computational notebooks, such as Jupyter Notebook, have become data scientists' de facto programming environments. Many visualization researchers and practitioners have developed i…

cs.HC2023★ 20 cited

Angler: Helping Machine Translation Practitioners Prioritize Model Improvements

Samantha Robertson, Zijie J. Wang, Dominik Moritz +2

Machine learning (ML) models can fail in unexpected ways in the real world, but not all model failures are equal. With finite time and resources, ML practitioners are forced to pri…

cs.LG2023★ 4 cited

WebSHAP: Towards Explaining Any Machine Learning Models Anywhere

Zijie J. Wang, Duen Horng Chau

As machine learning (ML) is increasingly integrated into our everyday Web experience, there is a call for transparent and explainable web-based ML. However, existing explainability…

cs.CY2023★ 65 cited

Queer In AI: A Case Study in Community-Led Participatory AI

Organizers Of QueerInAI, :, Anaelia Ovalle +48

We present Queer in AI as a case study for community-led participatory design in AI. We examine how participatory design and intersectional tenets started and shaped this community…

cs.LG2023★ 18 cited

GAM Coach: Towards Interactive and User-centered Algorithmic Recourse

Zijie J. Wang, Jennifer Wortman Vaughan, Rich Caruana +1

Machine learning (ML) recourse techniques are increasingly used in high-stakes domains, providing end users with actions to alter ML predictions, but they assume ML developers unde…

cs.CV2022★ 13 cited

DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models

Zijie J. Wang, Evan Montoya, David Munechika +3

With recent advancements in diffusion models, users can generate high-quality images by writing text prompts in natural language. However, generating images with desired details re…

cs.SI2022

Explaining Website Reliability by Visualizing Hyperlink Connectivity

Seongmin Lee, Sadia Afroz, Haekyu Park +5

As the information on the Internet continues growing exponentially, understanding and assessing the reliability of a website is becoming increasingly important. Misinformation has…

cs.HC2022★ 24 cited

TimberTrek: Exploring and Curating Sparse Decision Trees with Interactive Visualization

Zijie J. Wang, Chudi Zhong, Rui Xin +5

Given thousands of equally accurate machine learning (ML) models, how can users choose among them? A recent ML technique enables domain experts and data scientists to generate a co…

cs.LG2022★ 22 cited

Interpretability, Then What? Editing Machine Learning Models to Reflect Human Knowledge and Values

Zijie J. Wang, Alex Kale, Harsha Nori +6

Machine learning (ML) interpretability techniques can reveal undesirable patterns in data that models exploit to make predictions--potentially causing harms once deployed. However,…

cs.HC2022

Visual Auditor: Interactive Visualization for Detection and Summarization of Model Biases

David Munechika, Zijie J. Wang, Jack Reidy +4

As machine learning (ML) systems become increasingly widespread, it is necessary to audit these systems for biases prior to their deployment. Recent research has developed algorith…

cs.CL2022★ 565 cited

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448

Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…

cs.LG2022★ 1 cited

Overcoming Language Disparity in Online Content Classification with Multimodal Learning

Gaurav Verma, Rohit Mujumdar, Zijie J. Wang +2

Advances in Natural Language Processing (NLP) have revolutionized the way researchers and practitioners address crucial societal problems. Large language models are now the standar…

cs.HC2022★ 7 cited

NOVA: A Practical Method for Creating Notebook-Ready Visual Analytics

Zijie J. Wang, David Munechika, Seongmin Lee +1

How can we develop visual analytics (VA) tools that can be easily adopted? Visualization researchers have developed a large number of web-based VA tools to help data scientists in…

cs.CV2022

VisCUIT: Visual Auditor for Bias in CNN Image Classifier

Seongmin Lee, Zijie J. Wang, Judy Hoffman +1

CNN image classifiers are widely used, thanks to their efficiency and accuracy. However, they can suffer from biases that impede their practical applications. Most existing bias in…