50 citations · 122 across the 17 of their papers we have counts for
20 papers
View Sub-sampling and Reconstruction for Efficient Light Field Compression
Yang Chen, Martin Alain, Aljosa Smolic
Compression is an important task for many practical applications of light fields. Although previous work has proposed numerous methods for efficient light field compression, the ef…
KinePose: A temporally optimized inverse kinematics technique for 6DOF human pose estimation with biomechanical constraints
Kevin Gildea, Clara Mercadal-Baudart, Richard Blythman +2
Computer vision/deep learning-based 3D human pose estimation methods aim to localize human joints from images and videos. Pose representation is normally limited to 3D joint positi…
TEAM-Net: Multi-modal Learning for Video Action Recognition with Partial Decoding
Zhengwei Wang, Qi She, Aljosa Smolic
Most of existing video action recognition models ingest raw RGB frames. However, the raw video stream requires enormous storage and contains significant temporal redundancy. Video…
Spectral analysis of re-parameterized light fields
Martin Alain, Aljosa Smolic
In this paper, we study the spectral properties of re-parameterized light field. Following previous studies of the light field spectrum, which notably provided sampling guidelines,…
Foreground color prediction through inverse compositing
Sebastian Lutz, Aljosa Smolic
In natural image matting, the goal is to estimate the opacity of the foreground object in the image. This opacity controls the way the foreground and background is blended in trans…
DuctTake: Spatiotemporal Video Compositing
Jan Rueegg, Oliver Wang, Aljoscha Smolic +1
DuctTake is a system designed to enable practical compositing of multiple takes of a scene into a single video. Current industry solutions are based around object segmentation, a h…
A Case Study on Video Color Transfer: Exploring User Motivations, Expectations, and Satisfaction
Mairéad Grogan, Emin Zerman, Gareth W. Young +1
Multimedia and creativity software products are being used to edit and control various elements of creative media practices. These days, the technical affordances of mobile multime…
CatNet: Class Incremental 3D ConvNets for Lifelong Egocentric Gesture Recognition
Zhengwei Wang, Qi She, Tejo Chalasani +1
Egocentric gestures are the most natural form of communication for humans to interact with wearable devices such as VR/AR helmets and glasses. A major issue in such scenarios for r…
Simultaneous Segmentation and Recognition: Towards more accurate Ego Gesture Recognition
Tejo Chalasani, Aljosa Smolic
Ego hand gestures can be used as an interface in AR and VR environments. While the context of an image is important for tasks like scene understanding, object recognition, image ca…
DublinCity: Annotated LiDAR Point Cloud and its Applications
S. M. Iman Zolanvari, Susana Ruano, Aakanksha Rana +4
Scene understanding of full-scale 3D models of an urban area remains a challenging task. While advanced computer vision techniques offer cost-effective approaches to analyse 3D urb…
ColorNet -- Estimating Colorfulness in Natural Images
Emin Zerman, Aakanksha Rana, Aljosa Smolic
Measuring the colorfulness of a natural or virtual scene is critical for many applications in image processing field ranging from capturing to display. In this paper, we propose th…
Towards Generating Ambisonics Using Audio-Visual Cue for Virtual Reality
Aakanksha Rana, Cagri Ozcinar, Aljoscha Smolic
Ambisonics i.e., a full-sphere surround sound, is quintessential with 360-degree visual content to provide a realistic virtual reality (VR) experience. While 360-degree visual cont…
Dynamic Environment Mapping for Augmented Reality Applications on Mobile Devices
Rafael Monroy, Matis Hudon, Aljosa Smolic
Augmented Reality is a topic of foremost interest nowadays. Its main goal is to seamlessly blend virtual content in real-world scenes. Due to the lack of computational power in mob…
A Pipeline for Lenslet Light Field Quality Enhancement
Pierre Matysiak, Mairéad Grogan, Mikaël Le Pendu +2
In recent years, light fields have become a major research topic and their applications span across the entire spectrum of classical image processing. Among the different methods u…
Egocentric Gesture Recognition for Head-Mounted AR devices
Tejo Chalasani, Jan Ondrej, Aljosa Smolic
Natural interaction with virtual objects in AR/VR environments makes for a smooth user experience. Gestures are a natural extension from real world to augmented space to achieve th…
AlphaGAN: Generative adversarial networks for natural image matting
Sebastian Lutz, Konstantinos Amplianitis, Aljosa Smolic
We present the first generative adversarial network (GAN) for natural image matting. Our novel generator network is trained to predict visually appealing alphas with the addition o…
Optimization of Occlusion-Inducing Depth Pixels in 3-D Video Coding
Pan Gao, Cagri Ozcinar, Aljosa Smolic
The optimization of occlusion-inducing depth pixels in depth map coding has received little attention in the literature, since their associated texture pixels are occluded in the s…
Estimation of optimal encoding ladders for tiled 360° VR video in adaptive streaming systems
Cagri Ozcinar, Ana De Abreu, Sebastian Knorr +1
Given the significant industrial growth of demand for virtual reality (VR), 360° video streaming is one of the most important VR applications that require cost-optimal solutions to…
Hydra: An Accelerator for Real-Time Edge-Aware Permeability Filtering in 65nm CMOS
Manuel Eggimann, Christelle Gloor, Florian Scheidegger +4
Many modern video processing pipelines rely on edge-aware (EA) filtering methods. However, recent high-quality methods are challenging to run in real-time on embedded hardware due…
SalNet360: Saliency Maps for omni-directional images with CNN
Rafael Monroy, Sebastian Lutz, Tejo Chalasani +1
The prediction of Visual Attention data from any kind of media is of valuable use to content creators and used to efficiently drive encoding algorithms. With the current trend in t…