SkillPedia Skills Encyclopedia
中文 EN
Today's updates 2026-11-17 UTC

No new commits yet today

Open the update feed

autoharnesstigerless-labs/autoharness

An automated model evaluation harness and execution testing suite designed for multi-step coding agents.…

No ratings yet Rate this skill
Stars10.6k
Forks645
Watchers10.7k
Open Issues55

InstallOne-line install

Unconfirmed

Whether this repository follows the Agent Skills spec (that is, whether it contains a SKILL.md) has not been verified yet. Until that is settled, clone it and use what you need:

git clone https://github.com/tigerless-labs/autoharness.git

OverviewOverview

Key Features

An automated model evaluation harness and execution testing suite designed for multi-step coding agents. Key capabilities include: 1. sandboxed batch regression testing (executes dynamic test cases inside isolated containers to assert stdout, stderr, and exit codes); 2. hallucination and drift quantification (measures argument validation failure rates, tool hallucination counts, and loop cycles); 3. multi-model comparative benchmarking (synthesizes accuracy, latency, and token efficiency scorecards across LLM models).

Use Cases

Specification Validation & Regression, Agent Workflow Orchestration, Test-Driven Development.

Target Roles

QA Engineer, AI / Algorithm Engineer.

TopicsTopics

RatingUser ratings

Nobody has rated this skill yet. Yours would be the first on the site — your vote becomes the initial average.

Rate this skill

Fill it in to be included in the per-role averages below.

One vote per IP,and it cannot be changed after submitting, so choose carefully the first time. No account is collected and no sign-in is required.

RepositoryRepository

Skill ID239
Data sourceGitHub
Repositorytigerless-labs/autoharness
CategoryQA & Automated Testing / Specification Validation & Regression
Primary languagePython
LicenseMIT License
Default branchmain
GitHub repository ID1264396304
Node IDR_kgDOS10oEA
Rank#292 (position within the source ranking)
Site-wide popularity rank#138 (computed live from Stars, across all 5833 entries)

GrowthStar / Fork growth

One snapshot per day, tracking how Stars and Forks changed

05k10k15k2026-09-262026-11-022026-09-26 · 4,0512026-10-21 · 10,5002026-10-23 · 10,5982026-10-24 · 10,6812026-11-02 · 10,611
  • Now10,611
  • Previous point · 10-24 10,681
  • vs previous point -70
  • 5 data points 37 days
02004006008002026-09-262026-11-022026-09-26 · 3012026-10-21 · 6162026-10-23 · 6172026-10-24 · 6192026-11-02 · 645
  • Now645
  • Previous point · 10-24 619
  • vs previous point +26
  • 5 data points 37 days

TimelineTimeline

Repository created2026-06-09 21:05:425 months ago
Data last updated2026-11-02 14:37:5615 days ago
Last commit2026-10-23 16:35:4524 days ago

CommitLatest commit

committed by liruihan000. Category: Documentation Updates. Commit message: Merge pull request #294 from tigerless-labs/copy/readme-building.

f2de058 liruihan000 2026-10-30

Next stepsNext steps