Awesome Knowledge Distillation

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。

Pytorch implementation of various Knowledge Distillation (KD) methods.

SimpleAICV:pytorch training and testing examples.

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

模型压缩的小白入门教程

Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022

Engine for communication with remote kernel debugger (KD, WinDbg) from drivers and applications

Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.

Matching Guided Distillation (ECCV 2020)

Awesome-3D/Multimodal-Anomaly-Detection-and-Localization/Segmentation/3D-KD/3D-knowledge-distillation

[ECCV2022] Factorizing Knowledge in Neural Networks

Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.

Rotated Localization Distillation (CVPR 2022, TPAMI 2023)

A unified cGAN-based knowledge distillation method

Cross-platform Python scripts to interface with the Microsoft Kernel Debugger

This is a Kotlin implementation of the KD language. It is feature complete and passes all tests.

provides a convenient and streamlined approach to analyze Windows processes by converting windbg requests to pandas DataFrames

第一个仓储

Pluto notebook for curve fitting