Showing 2025Show all
2 papers · 1 filter
cs.LG2025
Towards Understanding the Shape of Representations in Protein Language Models
Kosio Beshkov, Anders Malthe-Sørenssen
While protein language models (PLMs) are one of the most promising avenues of research for future de novo protein design, the way in which they transform sequences to hidden repres…
cs.LG2025
A Quotient Homology Theory of Representation in Neural Networks
Kosio Beshkov
Previous research has proven that the set of maps implemented by neural networks with a ReLU activation function is identical to the set of piecewise linear continuous maps. Furthe…