🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
-
Updated
Nov 27, 2024 - Python
8000
🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.
Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)
[NeurIPS'22] Does Self-supervised Learning Really Improve Reinforcement Learning from Pixels?
Add a description, image, and links to the evolutionary-search topic page so that developers can more easily learn about it.
To associate your repository with the evolutionary-search topic, visit your repo's landing page and select "manage topics."