502 citations · 520 across the 12 of their papers we have counts for
12 papers
An information-Theoretic Approach to Semi-supervised Transfer Learning
Daniel Jakubovitz, David Uliel, Miguel Rodrigues +1
Transfer learning is a valuable tool in deep learning as it allows propagating information from one "source dataset" to another "target dataset", especially in the case of a small…
Navigating Noise: A Study of How Noise Influences Generalisation and Calibration of Neural Networks
Martin Ferianc, Ondrej Bohdal, Timothy Hospedales +1
Enhancing the generalisation abilities of neural networks (NNs) through integrating noise such as MixUp or Dropout during training has emerged as a powerful and adaptable technique…
How Does Pseudo-Labeling Affect the Generalization Error of the Semi-Supervised Gibbs Algorithm?
Haiyun He, Gholamali Aminian, Yuheng Bu +2
We provide an exact characterization of the expected generalization error (gen-error) for semi-supervised learning (SSL) with pseudo-labeling via the Gibbs algorithm. The gen-error…
Semi-supervised Batch Learning From Logged Data
Gholamali Aminian, Armin Behnamnia, Roberto Vega +5
Off-policy learning methods are intended to learn a policy from logged data, which includes context, action, and feedback (cost or reward) for each sample point. In this work, we b…
Simple Regularisation for Uncertainty-Aware Knowledge Distillation
Martin Ferianc, Miguel Rodrigues
Considering uncertainty estimation of modern neural networks (NNs) is one of the most important steps towards deploying machine learning systems to meaningful real-world applicatio…
Characterizing and Understanding the Generalization Error of Transfer Learning with Gibbs Algorithm
Yuheng Bu, Gholamali Aminian, Laura Toni +2
We provide an information-theoretic analysis of the generalization ability of Gibbs-based transfer learning algorithms by focusing on two popular transfer learning approaches, -…
Optimizing Bayesian Recurrent Neural Networks on an FPGA-based Accelerator
Martin Ferianc, Zhiqiang Que, Hongxiang Fan +2
Neural networks have demonstrated their outstanding performance in a wide range of tasks. Specifically recurrent architectures based on long-short term memory (LSTM) cells have man…
High-Performance FPGA-based Accelerator for Bayesian Neural Networks
Hongxiang Fan, Martin Ferianc, Miguel Rodrigues +3
Neural networks (NNs) have demonstrated their potential in a wide range of applications such as image recognition, decision making or recommendation systems. However, standard NNs…
ComBiNet: Compact Convolutional Bayesian Neural Network for Image Segmentation
Martin Ferianc, Divyansh Manocha, Hongxiang Fan +1
Fully convolutional U-shaped neural networks have largely been the dominant approach for pixel-wise image segmentation. In this work, we tackle two defects that hinder their deploy…
On the Effects of Quantisation on Model Uncertainty in Bayesian Neural Networks
Martin Ferianc, Partha Maji, Matthew Mattina +1
Bayesian neural networks (BNNs) are making significant progress in many research areas where decision-making needs to be accompanied by uncertainty estimation. Being able to quanti…
Wireless Image Transmission Using Deep Source Channel Coding With Attention Modules
Jialong Xu, Bo Ai, Wei Chen +3
Recent research on joint source channel coding (JSCC) for wireless communications has achieved great success owing to the employment of deep learning (DL). However, the existing wo…
VINNAS: Variational Inference-based Neural Network Architecture Search
Martin Ferianc, Hongxiang Fan, Miguel Rodrigues
In recent years, neural architecture search (NAS) has received intensive scientific and industrial interest due to its capability of finding a neural architecture with high accurac…