Awesome-Knowledge-Distillation-of-LLMsTebmer/Awesome-Knowledge-Distillation-of-LLMs
Organizes papers on knowledge distillation (KD) for large language models into a searchable curated directory by timelin…
No ratings yet
Rate this skill
Stars1.3k
Forks76
Watchers1.3k
Open Issues4
InstallOne-line install
UnconfirmedWhether this repository follows the Agent Skills spec (that is, whether it contains a SKILL.md) has not been verified yet. Until that is settled, clone it and use what you need:
git clone https://github.com/Tebmer/Awesome-Knowledge-Distillation-of-LLMs.git
OverviewOverview
Key Features
Organizes papers on knowledge distillation (KD) for large language models into a searchable curated directory by timeline, helping researchers and engineers quickly locate distillation methods, compression strategies, and alignment techniques. Key capabilities include: 1. Curated paper directory: archives KD-related paper entries by date, covering compression, alignment, data augmentation, data synthesis, feedback, instruction following, multimodal, self-distillation, self-training, and supervised fine-tuning, forming a literature list that can be browsed entry by entry; 2. Survey paper index: includes and labels KD survey papers, providing an entry point for systematically understanding the field; 3. Continuous incremental updates: appends new papers in date-based batches (e.g., 14 new papers in a single batch), keeping the directory in sync with the latest research.
Use Cases
surveying frontier LLM distillation methods, selecting and comparing options for model compression and alignment projects, retrieving literature when writing surveys or research proposals, and tracking progress in multimodal and self-distillation directions.
Target Roles
AI / Algorithm Engineer, Data Analyst / Data Engineer, Product Manager (PM).
TopicsTopics
RatingUser ratings
Nobody has rated this skill yet. Yours would be the first on the site — your vote becomes the initial average.
RepositoryRepository
| Skill ID | 1770 |
|---|---|
| Data source | GitHub |
| Repository | Tebmer/Awesome-Knowledge-Distillation-of-LLMs |
| Category | AI & Agent Skills / Skill Collections & Curated Directories |
| Primary language | Other |
| License | Not specified |
| Default branch | main |
| GitHub repository ID | 754706306 |
| Node ID | R_kgDOLPvngg |
| Rank | #599 (position within the source ranking) |
| Site-wide popularity rank | #753 (computed live from Stars, across all 5875 entries) |
GrowthStar / Fork growth
One snapshot per day, tracking how Stars and Forks changed
- Now1,316
- Previous point · 09-26 1,313
- vs previous point +3
- 2 data points 15 days
- Now76
- Previous point · 09-26 75
- vs previous point +1
- 2 data points 15 days
TimelineTimeline
Repository created2024-02-08 16:04:452024-02-08
Data last updated2026-10-26 12:00:4825 days ago
Last commit2025-03-09 15:06:412025-03-09
CommitLatest commit
Committed by Tebmer. Update Category: Documentation Updates. Commit details: Update README.md. This update refines the documentation for easier onboarding.