midscene-skillsweb-infra-dev/midscene-skills
Lets AI operate Web, mobile, and desktop interfaces directly through visual understanding,…
No ratings yet
Rate this skill
Stars317
Forks23
Watchers317
Open Issues3
InstallOne-line install
UnconfirmedWhether this repository follows the Agent Skills spec (that is, whether it contains a SKILL.md) has not been verified yet. Until that is settled, clone it and use what you need:
git clone https://github.com/web-infra-dev/midscene-skills.git
OverviewOverview
Key Features
Lets AI operate Web, mobile, and desktop interfaces directly through visual understanding, turning natural-language instructions like "click here, fill this in" into executable UI automation actions. Key capabilities include: 1. Vision-driven operation: locates and interacts with UI elements (click, type, swipe) based on screenshot understanding of position and semantics, without relying on DOM selectors or control IDs; 2. Natural-language authoring: generates automation steps from plain-language descriptions of the goal, lowering the barrier to writing UI scripts; 3. Multi-platform coverage: the same skill works on Web pages, mobile apps, and desktop application interfaces, reducing the cost of maintaining separate scripts per platform; 4. Operation recording and replay: records interface operation sequences and replays them for regression verification and flow reproduction.
Use Cases
Web page automation testing, mobile app UI automation, desktop UI operation recording and replay, natural-language-driven UI action script generation, cross-platform UI regression verification.
Target Roles
Test / QA Engineer, AI / Algorithm Engineer, Full-stack / Indie Developer, Product Manager (PM).
RatingUser ratings
Nobody has rated this skill yet. Yours would be the first on the site — your vote becomes the initial average.
RepositoryRepository
| Skill ID | 2321 |
|---|---|
| Data source | GitHub |
| Repository | web-infra-dev/midscene-skills |
| Category | AI & Agent Skills / Skill Package Management & Tooling Frameworks |
| Primary language | JavaScript |
| License | MIT License |
| Default branch | main |
| GitHub repository ID | 1122191501 |
| Node ID | R_kgDOQuNIjQ |
| Rank | #1803 (position within the source ranking) |
| Site-wide popularity rank | #2027 (computed live from Stars, across all 5833 entries) |
GrowthStar / Fork growth
One snapshot per day, tracking how Stars and Forks changed
- Now317
- Previous point · 09-25 312
- vs previous point +5
- 2 data points 18 days
- Now23
- Previous point · 09-25 23
- vs previous point ±0
- 2 data points 18 days
TimelineTimeline
Repository created2025-12-24 08:56:4110 months ago
Data last updated2026-10-26 12:28:0622 days ago
Last commit2026-09-08 06:12:502 months ago
CommitLatest commit
Version [latest] committed by quanru. Update Category: Documentation & Guidelines Update. Commit details: Merge pull request #45 from web-infra-dev/agent/use-harmony-launch-command. This update improves usage instructions, deployment guides, and developer docs.