56 citations · 236 across the 30 of their papers we have counts for
32 papers
Semantify: Simplifying the Control of 3D Morphable Models using CLIP
Omer Gralnik, Guy Gafni, Ariel Shamir
We present Semantify: a self-supervised method that utilizes the semantic power of CLIP language-vision foundation model to simplify the control of 3D morphable models. Given a par…
Domain-Agnostic Tuning-Encoder for Fast Personalization of Text-To-Image Models
Moab Arar, Rinon Gal, Yuval Atzmon +4
Text-to-image (T2I) personalization allows users to guide the creative image generation process by combining their own visual concepts in natural language prompts. Recently, encode…
HoughLaneNet: Lane Detection with Deep Hough Transform and Dynamic Convolution
Jia-Qi Zhang, Hao-Bin Duan, Jun-Long Chen +2
The task of lane detection has garnered considerable attention in the field of autonomous driving due to its complexity. Lanes can present difficulties for detection, as they can b…
Concept Decomposition for Visual Exploration and Inspiration
Yael Vinker, Andrey Voynov, Daniel Cohen-Or +1
A creative idea is often born from transforming, combining, and modifying ideas from existing visual examples capturing various concepts. However, one cannot simply copy the concep…
Stealth Shaper: Reflectivity Optimization as Surface Stylization
Kenji Tojo, Ariel Shamir, Bernd Bickel +1
We present a technique to optimize the reflectivity of a surface while preserving its overall shape. The naive optimization of the mesh vertices using the gradients of reflectivity…
Word-As-Image for Semantic Typography
Shir Iluz, Yael Vinker, Amir Hertz +3
A word-as-image is a semantic typography technique where a word illustration presents a visualization of the meaning of the word, while also preserving its readability. We present…
PersonalTailor: Personalizing 2D Pattern Design from 3D Garment Point Clouds
Sauradip Nag, Anran Qi, Xiatian Zhu +1
Garment pattern design aims to convert a 3D garment to the corresponding 2D panels and their sewing structure. Existing methods rely either on template fitting with heuristics and…
Prediction of Scene Plausibility
Or Nachmias, Ohad Fried, Ariel Shamir
Understanding the 3D world from 2D images involves more than detection and segmentation of the objects within the scene. It also includes the interpretation of the structure and ar…
ARO-Net: Learning Implicit Fields from Anchored Radial Observations
Yizhi Wang, Zeyu Huang, Ariel Shamir +3
We introduce anchored radial observations (ARO), a novel shape encoding for learning implicit field representation of 3D shapes that is category-agnostic and generalizable amid sig…
PromptonomyViT: Multi-Task Prompt Learning Improves Video Transformers using Synthetic Scene Data
Roei Herzig, Ofir Abramovich, Elad Ben-Avraham +5
Action recognition models have achieved impressive results by incorporating scene-level annotations, such as objects, their relations, 3D structure, and more. However, obtaining an…
Neural Font Rendering
Daniel Anderson, Ariel Shamir, Ohad Fried
Recent advances in deep learning techniques and applications have revolutionized artistic creation and manipulation in many domains (text, images, music); however, fonts have not y…
CLIPascene: Scene Sketching with Different Types and Levels of Abstraction
Yael Vinker, Yuval Alaluf, Daniel Cohen-Or +1
In this paper, we present a method for converting a given scene image into a sketch using different types and multiple levels of abstraction. We distinguish between two types of ab…
DeepPortraitDrawing: Generating Human Body Images from Freehand Sketches
Xian Wu, Chen Wang, Hongbo Fu +3
Researchers have explored various ways to generate realistic images from freehand sketches, e.g., for objects and human faces. However, how to generate realistic human body images…
Semantic Segmentation in Art Paintings
Nadav Cohen, Yael Newman, Ariel Shamir
Semantic segmentation is a difficult task even when trained in a supervised manner on photographs. In this paper, we tackle the problem of semantic segmentation of artistic paintin…
How Low Can We Go? Pixel Annotation for Semantic Segmentation
Daniel Kigli, Ariel Shamir, Shai Avidan
How many labeled pixels are needed to segment an image, without any prior knowledge? We conduct an experiment to answer this question. In our experiment, an Oracle is using Active…
CLIPasso: Semantically-Aware Object Sketching
Yael Vinker, Ehsan Pajouheshgar, Jessica Y. Bo +5
Abstraction is at the heart of sketching due to the simple and minimal nature of line drawings. Abstraction entails identifying the essential visual properties of an object or scen…
CAST: Character labeling in Animation using Self-supervision by Tracking
Oron Nir, Gal Rapoport, Ariel Shamir
Cartoons and animation domain videos have very different characteristics compared to real-life images and videos. In addition, this domain carries a large variability in styles. Cu…
Learned Queries for Efficient Local Attention
Moab Arar, Ariel Shamir, Amit H. Bermano
Vision Transformers (ViT) serve as powerful vision models. Unlike convolutional neural networks, which dominated vision research in previous years, vision transformers enjoy the ab…
Rhythm is a Dancer: Music-Driven Motion Synthesis with Global Structure
Andreas Aristidou, Anastasios Yiannakidis, Kfir Aberman +3
Synthesizing human motion with a global structure, such as a choreography, is a challenging task. Existing methods tend to concentrate on local smooth pose transitions and neglect…
Ordered Attention for Coherent Visual Storytelling
Tom Braude, Idan Schwartz, Alexander Schwing +1
We address the problem of visual storytelling, i.e., generating a story for a given sequence of images. While each sentence of the story should describe a corresponding image, a co…
InAugment: Improving Classifiers via Internal Augmentation
Moab Arar, Ariel Shamir, Amit Bermano
Image augmentation techniques apply transformation functions such as rotation, shearing, or color distortion on an input image. These augmentations were proven useful in improving…
Neural Alignment for Face De-pixelization
Maayan Shuvi, Noa Fish, Kfir Aberman +2
We present a simple method to reconstruct a high-resolution video from a face-video, where the identity of a person is obscured by pixelization. This concealment method is popular…
NPRportrait 1.0: A Three-Level Benchmark for Non-Photorealistic Rendering of Portraits
Paul L. Rosin, Yu-Kun Lai, David Mould +10
Despite the recent upsurge of activity in image-based non-photorealistic rendering (NPR), and in particular portrait image stylisation, due to the advent of neural style transfer,…
Focus-and-Expand: Training Guidance Through Gradual Manipulation of Input Features
Moab Arar, Noa Fish, Dani Daniel +3
We present a simple and intuitive Focus-and-eXpand (\fax) method to guide the training process of a neural network towards a specific solution. Optimizing a neural network is a hig…