Trial Set
CN-Celeb Short
Uses generated short utterances as a duration-robustness supplement.
Notice: This is not the original official SV trial list.
- Source dataset
- CN-Celeb
- Trials
- 546964
- Protocol source
- Self-constructed supplement
- Source split
- CN-Celeb prepared evaluation pool
Source Dataset
About CN-Celeb
CN-Celeb was built to study Chinese speaker recognition in unconstrained media conditions. The original collection contains more than 130,000 utterances from 1,000 celebrities across 11 real-world genres; the later CN-Celeb2 release expands the multi-genre collection to 3,000 speakers. The main OpenSVBench entry uses the upstream evaluation protocol, while the genre and short-duration entries are separate supplements.
- Language
- Chinese
- Original CN-Celeb
- 1,000 speakers; 130,000+ utterances
- Genres
- 11 real-world media genres
- Recording
- In-the-wild media speech
Direct Ranking
Systems on this trial set
23 reviewed systems currently have valid results.
| Rank | System | Submitted by | Trial-Set EER ↓ | Trial-Set minDCF ↓ |
|---|---|---|---|---|
| #1 |
W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
|
pengjy | 17.5046 | 0.797239 |
| #2 |
wespeaker/res34-cnceleb
wespeaker_r34
|
Public checkpoint | 17.6675 | 0.600899 |
| #3 |
iic/eres2netv2-zh
eresv2_zh
|
Public checkpoint | 17.6675 | 0.559834 |
| #4 |
iic/campplus
campplus
|
Public checkpoint | 19.1292 | 0.622269 |
| #5 |
Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
|
shangguanqituan | 20.2719 | 0.627675 |
| #6 |
Agora Voiceprint (ResNet293)
agora_vp
|
agora_vp | 20.8157 | 0.607910 |
| #7 |
AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
|
Public checkpoint | 21.5288 | 0.637650 |
| #8 |
palabraai/redimnet2-b6
redimnet2
|
Public checkpoint | 24.2213 | 0.769876 |
| #9 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
Public checkpoint | 24.9437 | 0.851112 |
| #10 |
palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
|
Public checkpoint | 25.1046 | 0.644055 |
| #11 |
wespeaker/samresnet100
vb2-sam100
|
Public checkpoint | 25.4042 | 0.714774 |
| #12 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
Public checkpoint | 25.4223 | 0.914387 |
| #13 |
wespeaker/w2vbert2
vb2-w2vbert
|
Public checkpoint | 25.9130 | 0.658933 |
| #14 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
Public checkpoint | 26.0196 | 0.911865 |
| #15 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
Public checkpoint | 26.8023 | 0.858622 |
| #16 |
iic/eres2net-en
eres_en
|
Public checkpoint | 27.2323 | 0.818788 |
| #17 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
Public checkpoint | 27.4153 | 0.854569 |
| #18 |
speechbrain/ecapa
ecapa
|
Public checkpoint | 28.7238 | 0.867746 |
| #19 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
Public checkpoint | 29.6374 | 0.854863 |
| #20 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
Public checkpoint | 30.3869 | 0.901376 |
| #21 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
Public checkpoint | 33.2598 | 0.989844 |
| #22 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
Public checkpoint | 34.0117 | 0.998459 |
| #23 |
speechbrain/xvector
xvector
|
Public checkpoint | 37.8590 | 0.985247 |