CradleBAAI-Agents/Cradle
Enables large language and multimodal models to directly take over graphical interfaces and complete software tasks by l…
No ratings yet
Rate this skill
Stars2.6k
Forks268
Watchers2.6k
Open Issues23
InstallOne-line install
UnconfirmedWhether this repository follows the Agent Skills spec (that is, whether it contains a SKILL.md) has not been verified yet. Until that is settled, clone it and use what you need:
git clone https://github.com/BAAI-Agents/Cradle.git
OverviewOverview
Key Features
Enables large language and multimodal models to directly take over graphical interfaces and complete software tasks by looking at the screen, clicking, and typing like a human. Key capabilities include: 1. Screen perception and element grounding: reads screenshots and locates buttons, input fields, and icons, converting visual information into executable coordinates and action targets; 2. Keyboard and mouse action execution: translates model decisions into real mouse clicks, drags, and keyboard input to act inside the target software; 3. Multimodal decision loop: feeds screenshots, interface structure, and task instructions into the model, outputs the next action, and loops to form an autonomous observe-decide-act task cycle; 4. Skill and interface encapsulation: wraps environment interaction, model invocation, and action space behind unified interfaces so different models or new software environments can be swapped in. 2. Use Cases: Scenarios requiring agents to operate GUI software directly, such as desktop software automation, in-game automated operation, cross-application workflow execution, and GUI agent research and evaluation. 3. Target Roles: AI / Algorithm Engineer, Full-stack / Indie Developer, Test / QA Engineer, Product Manager (PM).
TopicsTopics
RatingUser ratings
Nobody has rated this skill yet. Yours would be the first on the site — your vote becomes the initial average.
RepositoryRepository
| Skill ID | 371 |
|---|---|
| Data source | GitHub |
| Repository | BAAI-Agents/Cradle |
| Category | AI & Agent Skills / Agent Frameworks & Runtimes |
| Primary language | Python |
| License | MIT License |
| Default branch | main |
| GitHub repository ID | 766445602 |
| Node ID | R_kgDOLa8IIg |
| Rank | #370 (position within the source ranking) |
| Site-wide popularity rank | #438 (computed live from Stars, across all 5833 entries) |
GrowthStar / Fork growth
One snapshot per day, tracking how Stars and Forks changed
- Now2,596
- Previous point · 09-29 2,594
- vs previous point +2
- 2 data points 12 days
- Now268
- Previous point · 09-29 267
- vs previous point +1
- 2 data points 12 days
TimelineTimeline
Repository created2024-03-03 09:39:052024-03-03
Data last updated2026-10-26 11:57:0623 days ago
Last commit2024-11-07 04:58:202024-11-07
CommitLatest commit
Committed by DVampire. Update Category: Bug Fixes & Stability Improvements. Commit details: Fix incorrect duration check on Windows (#91). This update resolves known runtime errors and enhances system reliability.