SkillPedia Skills Encyclopedia
中文 EN
Today's updates 2026-11-17 UTC

No new commits yet today

Open the update feed

midscene-skillsweb-infra-dev/midscene-skills

Lets AI operate Web, mobile, and desktop interfaces directly through visual understanding,…

No ratings yet Rate this skill
Stars317
Forks23
Watchers317
Open Issues3

InstallOne-line install

Unconfirmed

Whether this repository follows the Agent Skills spec (that is, whether it contains a SKILL.md) has not been verified yet. Until that is settled, clone it and use what you need:

git clone https://github.com/web-infra-dev/midscene-skills.git

OverviewOverview

Key Features

Lets AI operate Web, mobile, and desktop interfaces directly through visual understanding, turning natural-language instructions like "click here, fill this in" into executable UI automation actions. Key capabilities include: 1. Vision-driven operation: locates and interacts with UI elements (click, type, swipe) based on screenshot understanding of position and semantics, without relying on DOM selectors or control IDs; 2. Natural-language authoring: generates automation steps from plain-language descriptions of the goal, lowering the barrier to writing UI scripts; 3. Multi-platform coverage: the same skill works on Web pages, mobile apps, and desktop application interfaces, reducing the cost of maintaining separate scripts per platform; 4. Operation recording and replay: records interface operation sequences and replays them for regression verification and flow reproduction.

Use Cases

Web page automation testing, mobile app UI automation, desktop UI operation recording and replay, natural-language-driven UI action script generation, cross-platform UI regression verification.

Target Roles

Test / QA Engineer, AI / Algorithm Engineer, Full-stack / Indie Developer, Product Manager (PM).

RatingUser ratings

Nobody has rated this skill yet. Yours would be the first on the site — your vote becomes the initial average.

Rate this skill

Fill it in to be included in the per-role averages below.

One vote per IP,and it cannot be changed after submitting, so choose carefully the first time. No account is collected and no sign-in is required.

RepositoryRepository

Skill ID2321
Data sourceGitHub
Repositoryweb-infra-dev/midscene-skills
CategoryAI & Agent Skills / Skill Package Management & Tooling Frameworks
Primary languageJavaScript
LicenseMIT License
Default branchmain
GitHub repository ID1122191501
Node IDR_kgDOQuNIjQ
Rank#1803 (position within the source ranking)
Site-wide popularity rank#2027 (computed live from Stars, across all 5833 entries)

GrowthStar / Fork growth

One snapshot per day, tracking how Stars and Forks changed

01002003004002026-09-252026-10-132026-09-25 · 3122026-10-13 · 317
  • Now317
  • Previous point · 09-25 312
  • vs previous point +5
  • 2 data points 18 days
01020302026-09-252026-10-132026-09-25 · 232026-10-13 · 23
  • Now23
  • Previous point · 09-25 23
  • vs previous point ±0
  • 2 data points 18 days

TimelineTimeline

Repository created2025-12-24 08:56:4110 months ago
Data last updated2026-10-26 12:28:0622 days ago
Last commit2026-09-08 06:12:502 months ago

CommitLatest commit

Version [latest] committed by quanru. Update Category: Documentation & Guidelines Update. Commit details: Merge pull request #45 from web-infra-dev/agent/use-harmony-launch-command. This update improves usage instructions, deployment guides, and developer docs.

dec1d1c vlatest quanru 2026-08-14

Next stepsNext steps