SkillPedia Skills Encyclopedia
中文 EN

Skills 2026-09-11 07:11 UTC

OpenJudge

Committed by chr6192. Update Category: New Features & Capability Expansion. Commit details: feat(skills): reorganize skills/ into domain suites (#189). This update introduces new capabilities and expands supported use cases.

chr6192 d1e0642 agentscope-ai/OpenJudge

CommitRaw commit message

feat(skills): reorganize skills/ into domain suites (#189)

* feat(skills): reorganize skills/ into domain suites (Option D)

Regroup the 9 flat non-eval_pipeline skills into three folder-based domain
suites, matching the paradigm eval_pipeline already established (three-layer
structure, directory-as-grouping, every <NN-name>/SKILL.md independently
installable, no code-level registry):

- academic-eval/  <- paper-review, bib-verify, + a copy of
  ref-hallucination-arena, plus a new 00-academic-router
- arena-eval/     <- auto-arena, + a second independent copy of
  ref-hallucination-arena, plus a new 00-arena-router
- openjudge-core/ <- openjudge, rl-reward (no router: sub-skills are
  mutually exclusive by description, see openjudge-core/README.md)

ref-hallucination-arena is intentionally duplicated (not shared/symlinked)
per the Agent Skill protocol's independent-installability constraint; the
two copies are free to diverge. claude-authenticity/mmx-cli/find-skills-combo
stay as standalone skills (no other skill references them).

Also adds actor+judge functional-test coverage for the two new suites,
reusing eval_pipeline's runner (parametrized via --skill-root/--cases/
--report-prefix, not duplicated) rather than forking it per suite. Initial
audit: 21/21 test cases pass, including 3x-repeat checks on the trickiest
routing-ambiguity cases (see each suite's tests/*_skill_audit.md).

See docs/superpowers/specs/2026-07-09-skills-domain-suite-proposal.md for
the full design rationale and migration plan (Option D, section 7).

Co-authored-by: Cursor <cursoragent@cursor.com>

* fix: satisfy black/isort/pylint for eval_pipeline scripts

These 6 files under skills/eval_pipeline/ fail pre-commit's --all-files run
in CI on plain upstream/main (pre-existing, unrelated to this PR's reorg
work) — this branch was cut from main, not from cl_agentic_grader, so it
doesn't carry that branch's earlier pre-commit fix for the same files.
Reformats with black/isort and adds the same pylint-disable/f-string fixes
already applied on cl_agentic_grader (PR #188) so this PR's CI passes too.

Verified locally: pre-commit run --files <these 6 files> now passes
black/isort/flake8/pylint/pyroma.

Co-authored-by: Cursor <cursoragent@cursor.com>

* fix(skills): repair domain suite discovery and routing

Discover nested skill suites while preserving package boundaries and handling symlink cycles. Align the nine domain skill names with their install directories, and let the arena router preserve combined evaluation goals.

Add offline discovery and packaging regressions plus a router-only combined-request fixture. Validation: 24 related tests passed; Black, isort and Flake8 passed. Live actor/judge tests were not run because API credentials are unavailable.

---------

Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: huangsen <huangsen.huang@alibaba-inc.com>