21 citations · 35 across the 13 of their papers we have counts for
14 papers
Layered Quantum Architecture Search for 3D Point Cloud Classification
Natacha Kuete Meli, Jovita Lukasik, Vladislav Golyanik +1
We introduce layered Quantum Architecture Search (layered-QAS), a strategy inspired by classical network morphism that designs Parametrised Quantum Circuit (PQC) architectures by p…
ONNX-Net: Towards Universal Representations and Instant Performance Prediction for Neural Architectures
Shiwen Qin, Alexander Auras, Shay B. Cohen +4
Neural architecture search (NAS) automates the design process of high-performing architectures, but remains bottlenecked by expensive performance evaluation. Most existing studies…
Smooth Model Compression without Fine-Tuning
Christina Runkel, Natacha Kuete Meli, Jovita Lukasik +3
Compressing and pruning large machine learning models has become a critical step towards their deployment in real-world applications. Standard pruning and compression techniques ar…
Transferrable Surrogates in Expressive Neural Architecture Search Spaces
Shiwen Qin, Gabriela Kadlecová, Martin Pilát +5
Neural architecture search (NAS) faces a challenge in balancing the exploration of expressive, broad search spaces that enable architectural innovation with the need for efficient…
Surprisingly Strong Performance Prediction with Neural Graph Features
Gabriela Kadlecová, Jovita Lukasik, Martin Pilát +4
Performance prediction has been a key part of the neural architecture search (NAS) process, allowing to speed up NAS algorithms by avoiding resource-consuming network training. Alt…
Can We Talk Models Into Seeing the World Differently?
Paul Gavrikov, Jovita Lukasik, Steffen Jung +4
Unlike traditional vision-only models, vision language models (VLMs) offer an intuitive way to access visual content through language prompting by combining a large language model…
An Evaluation of Zero-Cost Proxies -- from Neural Architecture Performance to Model Robustness
Jovita Lukasik, Michael Moeller, Margret Keuper
Zero-cost proxies are nowadays frequently studied and used to search for neural architectures. They show an impressive ability to predict the performance of architectures by making…
Neural Architecture Design and Robustness: A Dataset
Steffen Jung, Jovita Lukasik, Margret Keuper
Deep learning models have proven to be successful in a wide range of machine learning tasks. Yet, they are often highly sensitive to perturbations on the input data which can lead…
Learning Where To Look -- Generative NAS is Surprisingly Efficient
Jovita Lukasik, Steffen Jung, Margret Keuper
The efficient, automated search for well-performing neural architectures (NAS) has drawn increasing attention in the recent past. Thereby, the predominant research objective is to…
Is Differentiable Architecture Search truly a One-Shot Method?
Jonas Geiping, Jovita Lukasik, Margret Keuper +1
Differentiable architecture search (DAS) is a widely researched tool for the discovery of novel architectures, due to its promising results for image classification. The main benef…
Neural Architecture Performance Prediction Using Graph Neural Networks
Jovita Lukasik, David Friede, Heiner Stuckenschmidt +1
In computer vision research, the process of automating architecture engineering, Neural Architecture Search (NAS), has gained substantial interest. Due to the high computational co…
Smooth Variational Graph Embeddings for Efficient Neural Architecture Search
Jovita Lukasik, David Friede, Arber Zela +2
Neural architecture search (NAS) has recently been addressed from various directions, including discrete, sampling-based methods and efficient differentiable approaches. While the…
Surrogate NAS Benchmarks: Going Beyond the Limited Search Spaces of Tabular NAS Benchmarks
Arber Zela, Julien Siems, Lucas Zimmer +3
The most significant barrier to the advancement of Neural Architecture Search (NAS) is its demand for large computational resources, which hinders scientifically sound empirical ev…
A Variational-Sequential Graph Autoencoder for Neural Architecture Performance Prediction
David Friede, Jovita Lukasik, Heiner Stuckenschmidt +1
In computer vision research, the process of automating architecture engineering, Neural Architecture Search (NAS), has gained substantial interest. In the past, NAS was hardly acce…