Skip to content

fix(release): pin the repaired dataset and in-container scorer - #1

Merged
tianyi-UniPat merged 2 commits into
mainfrom
fix/release-reproducibility
Nov 5, 2026
Merged

tianyi-UniPat merged 2 commits into
mainfrom
fix/release-reproducibility

Conversation

@tianyi-UniPat

@tianyi-UniPat tianyi-UniPat commented Nov 4, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

  • Publish and pin the repaired dataset revision e4ee3847…: per-field tolerances, Harbor no-network mode, artifacts = ["/logs/agent"], workdir = "/tests", and staged_name for sv-med-050's mask.
  • Publish and pin the full in-container scorer server-20261104-h20 (sha256:19e2058…), built from harness/scripts/harbor/templates/Dockerfile; the CLI bundle remains a host-side reference only.
  • Update docs/dataset.md so the builder's result is recorded as 250/250 gold, not 200/250.
  • Point the README badge and citation section to arXiv:2611.04087; remove paper/sciencevision.pdf and record the published arXiv version in resources/paper.json and paper/README.md.

Verification

  • 250/250 gold self-test at 1.0 against the generated task trees.
  • 250/250 task.toml files parse with Harbor 0.20.0 TaskConfig.
  • 3-task in-container scorer smoke: string, numeric scalar plus numeric list, numeric vector; 3/3 reward 1.0.
  • scripts/validate_repository.py passes, including the paper record with no local PDF.

Notes

  • The dataset pin is a new HF revision; a63a513d remains unchanged for existing pins.
  • The new scorer image's config digest is sha256:c4abdb0f…; the CLI image server-20261022-h20 is explicitly documented as not usable for the separate verifier.
  • The paper is now arXiv-only; the repository no longer carries a compiled PDF.

🤖 Generated with Claude Code

tianyi-UniPat and others added 2 commits November 4, 2026 02:34
The dataset revision now emits per-field tolerances, uses Harbor's
no-network mode, declares /logs/agent artifacts and workdir=/tests, and
stages the medical mask under the oracle's name. The published scorer is
rebuilt from the harness Dockerfile so the dataset's score.py can import
harbor_adapters; the CLI bundle stays as a host-side reference only.

Verified: 250/250 gold self-test, 250 task.toml parse with Harbor 0.20.0,
and a 3-task in-container smoke at 1.0.

Co-Authored-By: Claude Code <noreply@anthropic.com>
The README badge and citation section now link to arXiv:2611.04087.
paper/sciencevision.pdf is removed; paper/README.md and resources/paper.json
record the published arXiv version. The validator only hashes a local PDF
when the record carries a path.

Co-Authored-By: Claude Code <noreply@anthropic.com>
@tianyi-UniPat
tianyi-UniPat merged commit 0085412 into main Nov 5, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant