OpenSVBench Scenario-driven SV leaderboard
Rolling Dataset Contribution

Propose a rolling dataset or trial set.

Use this page to submit a compact contribution package for maintainer review. Rolling proposals do not affect the current core leaderboard unless they are later accepted into a benchmark release.

Does not change current core ranking Maintainer-reviewed contribution package Public, reproducible data preferred
What To Upload

A small recipe package: README, source/license notes, download or placement script, preparation code, trial construction, and expected statistics.

What Not To Upload

Do not upload large raw audio dumps here. Provide reproducible download or placement instructions instead.

Reference Material

Read the guide or start from the example

These links explain the expected package structure and review checklist before you submit.

Contribution Upload

Upload a dataset contribution package

This creates a review artifact for maintainers. It is not automatically added to the public leaderboard.

Review Criteria

What maintainers look for

1. Keep core stable

Rolling trial sets use collection="rolling" and do not change the current scenario-macro ranking.

2. Reproducible protocol

The package should make data preparation and trial construction clear enough for maintainers to rerun.

3. Start from the example

The minimal example shows standard manifests, trial format, and catalog snippet.