2 citations · 3 across the 6 of their papers we have counts for
7 papers
The Geometry of Language Model Logits: Generic Structure and Learned Departures
Swathi Shree Narashiman, Aravind Ramana Venkatramanan, Nambi Seshadri
Autoregressive language models produce, at every prediction step, a vocabulary-sized logit vector whose structure determines the conditional next-token distribution. We empirically…
Induction Heads Interpolate N-Grams
Francesco D'Angelo, Oguz Kaan Yuksel, Swathi Shree Narashiman +1
Induction heads are attention circuits believed to underlie in-context learning in transformers, yet a precise characterization of the estimators they implement remains elusive. We…
Semantic Smoothing for Language Models via Distribution Estimation and Embeddings
Haricharan Balasundaram, Swathi Shree Narashiman, Pranay Mathur +1
We propose semantic smoothing, a smoothing method for language models that uses embeddings to share statistical observations across semantically similar contexts. The starting poin…
Genre Controlled Music Generation via Activation Steering
Swathi Narashiman, Pranay Mathur, Dipanshu Panda +5
Computational Music Generation is evolving towards non-conventional styles, demanding methods that enable precise and controllable blending of diverse music elements. In this work,…
3D Object Reconstruction with mmWave Radars
Samah Hussein, Junfeng Guan, Swathi Narashiman +2
This paper presents RFconstruct, a framework that enables 3D shape reconstruction using commercial off-the-shelf (COTS) mmWave radars for self-driving scenarios. RFconstruct overco…
AlphaZip: Neural Network-Enhanced Lossless Text Compression
Swathi Shree Narashiman, Nitin Chandrachoodan
Data compression continues to evolve, with traditional information theory methods being widely used for compressing text, images, and videos. Recently, there has been growing inter…
Chiplets on Wheels: Review Paper on Holistic Chiplet Solutions for Autonomous Vehicles
Swathi Narashiman, Venkat A, Divyaratna Joshi +7
On the advent of the slow death of Moore's law, the silicon industry is moving towards a new era of chiplets. The automotive industry is experiencing a profound transformation towa…