18 citations · 69 across the 60 of their papers we have counts for
55 papers · 1 filter
CrossMean: Model Merging by Pairing Merged and Expert Activations
Moshe Eliasof
Model merging combines fine-tuned experts into one network without retraining, and closed-form methods compute each merged layer from statistics of its input activations. However,…
Get a GRIP, this will be a long TRIP: A Quantifiable Long-Range Framework for Verifying Over-squashing
Ferran Hernandez Caralt, Simon Heilig, Adrián Bazaga +3
Empirical claims about the connection between over-squashing and long-range interactions in GNNs, can only be trusted if the benchmarks used to validate them genuinely require long…
Attention Graphons: A Graph Limit Perspective on Graph Transformers
Caio F. Deberaldini Netto, Moshe Eliasof, Luana Ruiz
Graph Transformers produce, for each attention head, a dense matrix of learned pairwise interactions. We ask a fundamental question: do these attention-induced graphs c…
GeoCFM: Positive-Only Conditional Flow Matching for Mineral Occurrence Sampling
Moshe Eliasof, Eldad Haber
Critical mineral discovery is a positive-only problem: deposits are observed as sparse locations, while unlabeled regions are not reliable negatives, and similar geophysical signat…
A Critical Audit of Spatiotemporal Forecasting Benchmark Datasets and Models
Kenneth Martin, Simon Heilig, Asja Fischer +3
Graph neural networks (GNNs) are routinely employed for spatiotemporal forecasting, yet their performance across widely used benchmark datasets is inconsistent. Here, we perform an…
Graph Transductive Sharpening: Leveraging Unlabeled Predictions in Node Classification
Brown Zaz, Mar Gonzàlez I Català, Ferran Hernandez Caralt +2
In the transductive setting, where the full graph is observed but node labels are only partially available, progress in semi-supervised node classification has largely focused on a…
Conservative Flows: A New Paradigm of Generative Models
Eshed Gal, Md Shahriar Rahim Siddiqui, Moshe Eliasof +1
Modern generative modeling is dominated by transport from a noise prior to data. We propose an alternative paradigm in which generation is performed by a discrete stochastic dynami…
Bridging Input Feature Spaces Towards Graph Foundation Models
Moshe Eliasof, Krishna Sri Ipsit Mantri, Beatrice Bevilacqua +2
Unlike vision and language domains, graph learning lacks a shared input space, as input features differ across graph datasets not only in semantics, but also in value ranges and di…
PDE-SSM: A Spectral State Space Approach to Spatial Mixing in Diffusion Transformers
Eshed Gal, Moshe Eliasof, Siddharth Rout +1
The success of vision transformers-especially for generative modeling-is limited by the quadratic cost and weak spatial inductive bias of self-attention. We propose PDE-SSM, a spat…
Towards Improved Sentence Representations using Token Graphs
Krishna Sri Ipsit Mantri, Carola-Bibiane Schönlieb, Zorah Lähner +1
Obtaining a single-vector representation from a Large Language Model's (LLM) token-level outputs is a critical step for nearly all sentence-level tasks. However, standard pooling m…
Preconditioned Flow Matching
Shadab Ahamed, Eshed Gal, Md Shahriar Rahim Siddiqui +3
Flow matching (FM) learns vector fields by regressing stochastic velocity targets along intermediate distributions . We identify a geometric optimization bottleneck in this re…
Learning from Historical Activations in Graph Neural Networks
Yaniv Galron, Hadar Sinai, Haggai Maron +1
Graph Neural Networks (GNNs) have demonstrated remarkable success in various domains such as social networks, molecular chemistry, and more. A crucial component of GNNs is the pool…
On The Expressive Power of GNN Derivatives
Yam Eitan, Moshe Eliasof, Yoav Gelberg +3
Despite significant advances in Graph Neural Networks (GNNs), their limited expressivity remains a fundamental challenge. Research on GNN expressivity has produced many expressive…
Revisiting Node Affinity Prediction in Temporal Graphs
Or Feldman, Krishna Sri Ipsit Mantri, Moshe Eliasof +1
Node affinity prediction is a common task that is widely used in temporal graph learning with applications in social and financial networks, recommender systems, and more. Recent w…
TANGO: Graph Neural Dynamics via Learned Energy and Tangential Flows
Moshe Eliasof, Eldad Haber, Carola-Bibiane Schönlieb
We introduce TANGO -- a dynamical systems inspired framework for graph representation learning that governs node feature evolution through a learned energy landscape and its associ…
Understanding and Improving Laplacian Positional Encodings For Temporal GNNs
Yaniv Galron, Fabrizio Frasca, Haggai Maron +2
Temporal graph learning has applications in recommendation systems, traffic forecasting, and social network analysis. Although multiple architectures have been introduced, progress…
Return of ChebNet: Understanding and Improving an Overlooked GNN on Long Range Tasks
Ali Hariri, Álvaro Arroyo, Alessio Gravina +6
ChebNet, one of the earliest spectral GNNs, has largely been overshadowed by Message Passing Neural Networks (MPNNs), which gained popularity for their simplicity and effectiveness…
Improving the Effective Receptive Field of Message-Passing Neural Networks
Shahaf E. Finder, Ron Shapira Weber, Moshe Eliasof +2
Message-Passing Neural Networks (MPNNs) have become a cornerstone for processing and analyzing graph-structured data. However, their effectiveness is often hindered by phenomena su…
Graph Flow Matching: Enhancing Image Generation with Neighbor-Aware Flow Fields
Md Shahriar Rahim Siddiqui, Moshe Eliasof, Eldad Haber
Flow matching casts sample generation as learning a continuous-time velocity field that transports noise to data. Existing flow matching networks typically predict each point's vel…
Message-Passing State-Space Models: Improving Graph Learning with Modern Sequence Modeling
Andrea Ceni, Alessio Gravina, Claudio Gallicchio +3
The recent success of State-Space Models (SSMs) in sequence modeling has motivated their adaptation to graph learning, giving rise to Graph State-Space Models (GSSMs). However, exi…
One-Step Offline Distillation of Diffusion-based Models via Koopman Modeling
Nimrod Berman, Ilan Naiman, Moshe Eliasof +2
Diffusion-based generative models have demonstrated exceptional performance, yet their iterative sampling procedures remain computationally expensive. A prominent strategy to mitig…
FLASH: Flexible Learning of Adaptive Sampling from History in Temporal Graph Neural Networks
Or Feldman, Krishna Sri Ipsit Mantri, Carola-Bibiane Schönlieb +2
Aggregating temporal signals from historic interactions is a key step in future link prediction on dynamic graphs. However, incorporating long histories is resource-intensive. Henc…
Towards Efficient Training of Graph Neural Networks: A Multiscale Approach
Eshed Gal, Moshe Eliasof, Carola-Bibiane Schönlieb +3
Graph Neural Networks (GNNs) have become powerful tools for learning from graph-structured data, finding applications across diverse domains. However, as graph sizes and connectivi…
Towards Invariance to Node Identifiers in Graph Neural Networks
Maya Bechler-Speicher, Moshe Eliasof, Carola-Bibiane Schonlieb +2
Message-Passing Graph Neural Networks (GNNs) are known to have limited expressive power, due to their message passing structure. One mechanism for circumventing this limitation is…