SkillPedia Skills Encyclopedia
中文 EN
Today's updates 2026-11-20 UTC

No new commits yet today

Open the update feed

Awesome-Knowledge-Distillation-of-LLMsTebmer/Awesome-Knowledge-Distillation-of-LLMs

Organizes papers on knowledge distillation (KD) for large language models into a searchable curated directory by timelin…

No ratings yet Rate this skill
Stars1.3k
Forks76
Watchers1.3k
Open Issues4

InstallOne-line install

Unconfirmed

Whether this repository follows the Agent Skills spec (that is, whether it contains a SKILL.md) has not been verified yet. Until that is settled, clone it and use what you need:

git clone https://github.com/Tebmer/Awesome-Knowledge-Distillation-of-LLMs.git

OverviewOverview

Key Features

Organizes papers on knowledge distillation (KD) for large language models into a searchable curated directory by timeline, helping researchers and engineers quickly locate distillation methods, compression strategies, and alignment techniques. Key capabilities include: 1. Curated paper directory: archives KD-related paper entries by date, covering compression, alignment, data augmentation, data synthesis, feedback, instruction following, multimodal, self-distillation, self-training, and supervised fine-tuning, forming a literature list that can be browsed entry by entry; 2. Survey paper index: includes and labels KD survey papers, providing an entry point for systematically understanding the field; 3. Continuous incremental updates: appends new papers in date-based batches (e.g., 14 new papers in a single batch), keeping the directory in sync with the latest research.

Use Cases

surveying frontier LLM distillation methods, selecting and comparing options for model compression and alignment projects, retrieving literature when writing surveys or research proposals, and tracking progress in multimodal and self-distillation directions.

Target Roles

AI / Algorithm Engineer, Data Analyst / Data Engineer, Product Manager (PM).

TopicsTopics

RatingUser ratings

Nobody has rated this skill yet. Yours would be the first on the site — your vote becomes the initial average.

Rate this skill

Fill it in to be included in the per-role averages below.

One vote per IP,and it cannot be changed after submitting, so choose carefully the first time. No account is collected and no sign-in is required.

RepositoryRepository

Skill ID1770
Data sourceGitHub
RepositoryTebmer/Awesome-Knowledge-Distillation-of-LLMs
CategoryAI & Agent Skills / Skill Collections & Curated Directories
Primary languageOther
LicenseNot specified
Default branchmain
GitHub repository ID754706306
Node IDR_kgDOLPvngg
Rank#599 (position within the source ranking)
Site-wide popularity rank#753 (computed live from Stars, across all 5875 entries)

GrowthStar / Fork growth

One snapshot per day, tracking how Stars and Forks changed

05001k1.5k2026-09-262026-10-112026-09-26 · 1,3132026-10-11 · 1,316
  • Now1,316
  • Previous point · 09-26 1,313
  • vs previous point +3
  • 2 data points 15 days
0204060802026-09-262026-10-112026-09-26 · 752026-10-11 · 76
  • Now76
  • Previous point · 09-26 75
  • vs previous point +1
  • 2 data points 15 days

TimelineTimeline

Repository created2024-02-08 16:04:452024-02-08
Data last updated2026-10-26 12:00:4825 days ago
Last commit2025-03-09 15:06:412025-03-09

CommitLatest commit

Committed by Tebmer. Update Category: Documentation Updates. Commit details: Update README.md. This update refines the documentation for easier onboarding.

c96c71a Tebmer 2025-03-09

Next stepsNext steps