5 citations · 9 across the 7 of their papers we have counts for
3 papers · 1 filter
Competition and Attraction Improve Model Fusion
João Abrantes, Robert Tjarko Lange, Yujin Tang
Model merging is a powerful technique for integrating the specialized knowledge of multiple machine learning models into a single model. However, existing methods require manually…
Evolution Transformer: In-Context Evolutionary Optimization
Robert Tjarko Lange, Yingtao Tian, Yujin Tang
Evolutionary optimization algorithms are often derived from loose biological analogies and struggle to leverage information obtained during the sequential course of optimization. A…
Large Language Models As Evolution Strategies
Robert Tjarko Lange, Yingtao Tian, Yujin Tang
Large Transformer models are capable of implementing a plethora of so-called in-context learning algorithms. These include gradient descent, classification, sequence completion, tr…