9 papers
DIP-GS: Deep Image Prior For Gaussian Splatting Sparse View Recovery
Rajaei Khatib, Raja Giryes
3D Gaussian Splatting (3DGS) is a leading 3D scene reconstruction method, obtaining high-quality reconstruction with real-time rendering runtime performance. The main idea behind 3…
Revisiting Glorot Initialization for Long-Range Linear Recurrences
Noga Bar, Mariia Seleznova, Yotam Alexander +2
Proper initialization is critical for Recurrent Neural Networks (RNNs), particularly in long-range reasoning tasks, where repeated application of the same weight matrix can cause v…
ZOQO: Zero-Order Quantized Optimization
Noga Bar, Raja Giryes
The increasing computational and memory demands in deep learning present significant challenges, especially in resource-constrained environments. We introduce a zero-order quantize…
Diverse Subset Selection via Norm-Based Sampling and Orthogonality
Noga Bar, Raja Giryes
Large annotated datasets are crucial for the success of deep neural networks, but labeling data can be prohibitively expensive in domains such as medical imaging. This work tackles…
A Flow is a Stream of Packets: A Stream-Structured Data Approach for DDoS Detection
Raja Giryes, Lior Shafir, Avishai Wool
Distributed Denial of Service (DDoS) attacks are getting increasingly harmful to the Internet, showing no signs of slowing down. Developing an accurate detection mechanism to thwar…
DINOv2 based Self Supervised Learning For Few Shot Medical Image Segmentation
Lev Ayzenberg, Raja Giryes, Hayit Greenspan
Deep learning models have emerged as the cornerstone of medical image segmentation, but their efficacy hinges on the availability of extensive manually labeled datasets and their a…
How do Transformers perform In-Context Autoregressive Learning?
Michael E. Sander, Raja Giryes, Taiji Suzuki +2
Transformers have achieved state-of-the-art performance in language modeling tasks. However, the reasons behind their tremendous success are still unclear. In this paper, towards a…
TriNeRFLet: A Wavelet Based Triplane NeRF Representation
Rajaei Khatib, Raja Giryes
In recent years, the neural radiance field (NeRF) model has gained popularity due to its ability to recover complex 3D scenes. Following its success, many approaches proposed diffe…
Introduction to deep learning
Lihi Shiloh-Perl, Raja Giryes
Deep Learning (DL) has made a major impact on data science in the last decade. This chapter introduces the basic concepts of this field. It includes both the basic structures used…