SkillPedia Skills Encyclopedia
中文 EN
Today's updates 2026-11-17 UTC

No new commits yet today

Open the update feed

LLaVA-Plus-CodebaseLLaVA-VL/LLaVA-Plus-Codebase

Provides a reusable training and inference codebase for multimodal LLMs (LLaVA family),…

No ratings yet Rate this skill
Stars771
Forks60
Watchers771
Open Issues22

InstallOne-line install

Unconfirmed

Whether this repository follows the Agent Skills spec (that is, whether it contains a SKILL.md) has not been verified yet. Until that is settled, clone it and use what you need:

git clone https://github.com/LLaVA-VL/LLaVA-Plus-Codebase.git

OverviewOverview

Key Features

Provides a reusable training and inference codebase for multimodal LLMs (LLaVA family), addressing three engineering concerns: vision-language connector selection, image preprocessing strategy, and launching tool-using agents. Key capabilities include: 1. Vision-language connector configuration: the --mm_projector_type flag selects connectors such as mlp2x_gelu (a two-layer MLP) to map vision-encoder outputs into the language model's hidden space, making image-text alignment trainable and swappable; 2. Image aspect-ratio preprocessing: the --image_aspect_ratio pad option pads and resizes non-square images instead of stretching them, preventing distortion and keeping input sizes consistent across batches; 3. Tool worker launch: a Launch tool workers script entry starts multiple tool service processes in bulk so the agent can call external tools in parallel during inference; 4. Multimodal agent training and inference scripts: integrates model, data, and tool-calling flows to reproduce and fine-tune multimodal agents on custom data.

Use Cases

Multimodal LLM fine-tuning experiments, comparing and selecting vision-language connectors, building image preprocessing pipelines, local deployment and debugging of tool-using agents.

Target Roles

AI / Algorithm Engineer, Backend Developer, Full-stack / Indie Developer.

TopicsTopics

RatingUser ratings

Nobody has rated this skill yet. Yours would be the first on the site — your vote becomes the initial average.

Rate this skill

Fill it in to be included in the per-role averages below.

One vote per IP,and it cannot be changed after submitting, so choose carefully the first time. No account is collected and no sign-in is required.

RepositoryRepository

Skill ID1816
Data sourceGitHub
RepositoryLLaVA-VL/LLaVA-Plus-Codebase
CategoryAI & Multimodal / Multimodal Agents & Tool Use
Primary languagePython
LicenseApache License 2.0
Default branchmain
GitHub repository ID715592775
Node IDR_kgDOKqcURw
Rank#928 (position within the source ranking)
Site-wide popularity rank#1045 (computed live from Stars, across all 5833 entries)

GrowthStar / Fork growth

One snapshot per day, tracking how Stars and Forks changed

02004006008002026-09-272026-10-112026-09-27 · 7712026-10-11 · 771
  • Now771
  • Previous point · 09-27 771
  • vs previous point ±0
  • 2 data points 14 days
0204060802026-09-272026-10-112026-09-27 · 612026-10-11 · 60
  • Now60
  • Previous point · 09-27 61
  • vs previous point -1
  • 2 data points 14 days

TimelineTimeline

Repository created2023-11-07 13:06:022023-11-07
Data last updated2026-10-26 12:06:1721 days ago
Last commit2024-02-01 12:51:102024-02-01

CommitLatest commit

Version [latest] committed by HaoZhang534. Update Category: Feature Addition & Enhancement. Commit details: Add opensedd and controlnet worker (#18). This update introduces new capabilities and module extensions.

a9f9d6f vlatest HaoZhang534 2023-12-04