5 papers
Neuron-based Multifractal Analysis of Neuron Interaction Dynamics in Large Models
Xiongye Xiao, Heng Ping, Chenyu Zhou +6
In recent years, there has been increasing attention on the capabilities of large models, particularly in handling complex tasks that small-scale models are unable to perform. Nota…
PerfRL: A Small Language Model Framework for Efficient Code Optimization
Shukai Duan, Nikos Kanakaris, Xiongye Xiao +8
Code optimization is a challenging task requiring a substantial level of expertise from developers. Nonetheless, this level of human capacity is not sufficient considering the rapi…
Network-informed Prompt Engineering against Organized Astroturf Campaigns under Extreme Class Imbalance
Nikos Kanakaris, Heng Ping, Xiongye Xiao +4
Detecting organized political campaigns is of paramount importance in fighting against disinformation on social media. Existing approaches for the identification of such organized…
A Structure-Aware Framework for Learning Device Placements on Computation Graphs
Shukai Duan, Heng Ping, Nikos Kanakaris +9
Computation graphs are Directed Acyclic Graphs (DAGs) where the nodes correspond to mathematical operations and are used widely as abstractions in optimizations of neural networks.…
Multi-scale Generative Modeling for Fast Sampling
Xiongye Xiao, Shixuan Li, Luzhe Huang +6
While working within the spatial domain can pose problems associated with ill-conditioned scores caused by power-law decay, recent advances in diffusion-based generative models hav…