activity
20192024
most citedFooling Neural Network Interpretations via Adversarial Model Manipulation

117 citations · 124 across the 8 of their papers we have counts for

collaborators

8 papers

cs.LG2024

On Evaluating LLMs' Capabilities as Functional Approximators: A Bayesian Perspective

Shoaib Ahmed Siddiqui, Yanzhi Chen, Juyeon Heo +2

Recent works have successfully applied Large Language Models (LLMs) to function modeling tasks. However, the reasons behind this success remain unclear. In this work, we propose a…

cs.LG2023

Estimation of Concept Explanations Should be Uncertainty Aware

Vihari Piratla, Juyeon Heo, Katherine M. Collins +2

Model explanations can be valuable for interpreting and debugging predictive models. We study a specific kind called Concept Explanations, where the goal is to interpret a model us…

cs.LG2023★ 2 cited

Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization

Weiyang Liu, Zeju Qiu, Yao Feng +11

Large foundation models are becoming ubiquitous, but training them from scratch is prohibitively expensive. Thus, efficiently adapting these powerful models to downstream tasks is…

stat.ML2023

Leveraging Task Structures for Improved Identifiability in Neural Network Representations

Wenlin Chen, Julien Horwood, Juyeon Heo +1

This work extends the theory of identifiability in supervised learning by considering the consequences of having access to a distribution of tasks. In such cases, we show that line…

cs.LG2023★ 2 cited

Use Perturbations when Learning from Explanations

Juyeon Heo, Vihari Piratla, Matthew Wicker +1

Machine learning from explanations (MLX) is an approach to learning that uses human-provided explanations of relevant or irrelevant features for each input to ensure that model pre…

cs.LG2022★ 3 cited

Robust Explanation Constraints for Neural Networks

Matthew Wicker, Juyeon Heo, Luca Costabello +1

Post-hoc explanation methods are used with the intent of providing insights about neural networks and are sometimes said to help engender trust in their outputs. However, popular e…

cs.CV2022

Towards More Robust Interpretation via Local Gradient Alignment

Sunghwan Joo, Seokhyeon Jeong, Juyeon Heo +2

Neural network interpretation methods, particularly feature attribution methods, are known to be fragile with respect to adversarial input perturbations. To address this, several m…

cs.LG2019★ 117 cited

Fooling Neural Network Interpretations via Adversarial Model Manipulation

Juyeon Heo, Sunghwan Joo, Taesup Moon

We ask whether the neural network interpretation methods can be fooled via adversarial model manipulation, which is defined as a model fine-tuning step that aims to radically alter…