Lists (3)
Stars
DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling
[ACL 2024] Knowledge Fusion by Evolving Weights of Language Models
Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"
Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
[NeurIPS 2024] For paper Parameter Competition Balancing for Model Merging
A collection of papers related to knowledge fusion
Tools for merging pretrained large language models.
DeepSeek Coder: Let the Code Write Itself
DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
利用HuggingFace的官方下载工具从镜像网站进行高速下载。
Daily updated LLM papers. 每日更新 LLM 相关的论文，欢迎订阅 👏 喜欢的话动动你的小手 🌟 一个
🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
Codebase for Merging Language Models (ICML 2024)
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
Merge safetensor files using the technique described in "Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch"
Official repository of Evolutionary Optimization of Model Merging Recipes
[ICLR 2024] Efficient Streaming Language Models with Attention Sinks