autoharnesstigerless-labs/autoharness
An automated model evaluation harness and execution testing suite designed for multi-step coding agents.…
No ratings yet
Rate this skill
Stars10.6k
Forks645
Watchers10.7k
Open Issues55
InstallOne-line install
UnconfirmedWhether this repository follows the Agent Skills spec (that is, whether it contains a SKILL.md) has not been verified yet. Until that is settled, clone it and use what you need:
git clone https://github.com/tigerless-labs/autoharness.git
OverviewOverview
Key Features
An automated model evaluation harness and execution testing suite designed for multi-step coding agents. Key capabilities include: 1. sandboxed batch regression testing (executes dynamic test cases inside isolated containers to assert stdout, stderr, and exit codes); 2. hallucination and drift quantification (measures argument validation failure rates, tool hallucination counts, and loop cycles); 3. multi-model comparative benchmarking (synthesizes accuracy, latency, and token efficiency scorecards across LLM models).
Use Cases
Specification Validation & Regression, Agent Workflow Orchestration, Test-Driven Development.
Target Roles
QA Engineer, AI / Algorithm Engineer.
TopicsTopics
RatingUser ratings
Nobody has rated this skill yet. Yours would be the first on the site — your vote becomes the initial average.
RepositoryRepository
| Skill ID | 239 |
|---|---|
| Data source | GitHub |
| Repository | tigerless-labs/autoharness |
| Category | QA & Automated Testing / Specification Validation & Regression |
| Primary language | Python |
| License | MIT License |
| Default branch | main |
| GitHub repository ID | 1264396304 |
| Node ID | R_kgDOS10oEA |
| Rank | #292 (position within the source ranking) |
| Site-wide popularity rank | #138 (computed live from Stars, across all 5833 entries) |
GrowthStar / Fork growth
One snapshot per day, tracking how Stars and Forks changed
- Now10,611
- Previous point · 10-24 10,681
- vs previous point -70
- 5 data points 37 days
- Now645
- Previous point · 10-24 619
- vs previous point +26
- 5 data points 37 days
TimelineTimeline
Repository created2026-06-09 21:05:425 months ago
Data last updated2026-11-02 14:37:5615 days ago
Last commit2026-10-23 16:35:4524 days ago
CommitLatest commit
committed by liruihan000. Category: Documentation Updates. Commit message: Merge pull request #294 from tigerless-labs/copy/readme-building.