Trial Set
CN-Celeb Genre
Uses CN-Celeb metadata to build a genre-shift supplement outside the official trial file.
Notice: This is not the original official SV trial list.
- Source dataset
- CN-Celeb
- Trials
- 440000
- Protocol source
- Self-constructed supplement
- Source split
- CN-Celeb prepared evaluation pool
Source Dataset
About CN-Celeb
CN-Celeb was built to study Chinese speaker recognition in unconstrained media conditions. The original collection contains more than 130,000 utterances from 1,000 celebrities across 11 real-world genres; the later CN-Celeb2 release expands the multi-genre collection to 3,000 speakers. The main OpenSVBench entry uses the upstream evaluation protocol, while the genre and short-duration entries are separate supplements.
- Language
- Chinese
- Original CN-Celeb
- 1,000 speakers; 130,000+ utterances
- Genres
- 11 real-world media genres
- Recording
- In-the-wild media speech
Direct Ranking
Systems on this trial set
23 reviewed systems currently have valid results.
| Rank | System | Submitted by | Trial-Set EER ↓ | Trial-Set minDCF ↓ |
|---|---|---|---|---|
| #1 |
iic/eres2netv2-zh
eresv2_zh
|
Public checkpoint | 14.2725 | 0.527525 |
| #2 |
wespeaker/res34-cnceleb
wespeaker_r34
|
Public checkpoint | 15.6955 | 0.591628 |
| #3 |
iic/campplus
campplus
|
Public checkpoint | 16.8815 | 0.610655 |
| #4 |
W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
|
pengjy | 19.0005 | 0.737320 |
| #5 |
Agora Voiceprint (ResNet293)
agora_vp
|
agora_vp | 21.9825 | 0.674857 |
| #6 |
Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
|
shangguanqituan | 22.2000 | 0.654345 |
| #7 |
AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
|
Public checkpoint | 23.4125 | 0.648552 |
| #8 |
palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
|
Public checkpoint | 23.5245 | 0.640800 |
| #9 |
wespeaker/samresnet100
vb2-sam100
|
Public checkpoint | 25.1200 | 0.674765 |
| #10 |
palabraai/redimnet2-b6
redimnet2
|
Public checkpoint | 25.4550 | 0.740052 |
| #11 |
wespeaker/w2vbert2
vb2-w2vbert
|
Public checkpoint | 25.9200 | 0.656577 |
| #12 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
Public checkpoint | 26.2472 | 0.806172 |
| #13 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
Public checkpoint | 26.5125 | 0.822805 |
| #14 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
Public checkpoint | 26.8575 | 0.811767 |
| #15 |
iic/eres2net-en
eres_en
|
Public checkpoint | 27.7395 | 0.802170 |
| #16 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
Public checkpoint | 28.4850 | 0.888960 |
| #17 |
speechbrain/ecapa
ecapa
|
Public checkpoint | 29.5690 | 0.883898 |
| #18 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
Public checkpoint | 29.6497 | 0.829445 |
| #19 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
Public checkpoint | 30.8550 | 0.849922 |
| #20 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
Public checkpoint | 31.1025 | 0.910323 |
| #21 |
speechbrain/xvector
xvector
|
Public checkpoint | 36.7857 | 0.987563 |
| #22 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
Public checkpoint | 37.0343 | 0.985940 |
| #23 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
Public checkpoint | 38.3800 | 0.975515 |