Trial Set
VoxCeleb Short
Uses generated short utterances as a duration-robustness supplement.
Notice: This is not the original official SV trial list.
- Source dataset
- VoxCeleb1
- Trials
- 394724
- Protocol source
- Self-constructed supplement
- Source split
- VoxCeleb1 evaluation audio
Source Dataset
About VoxCeleb1
VoxCeleb is a large-scale speaker corpus collected from online interviews and other media. Its recordings retain real-world variation in microphones, channels, background sound, and speaking conditions. VoxCeleb1-O, E, and H use established VoxCeleb verification protocols; the short-duration entry on OpenSVBench is an additional benchmark protocol.
- Language
- Predominantly English
- VoxCeleb1
- 1,251 speakers and over 100,000 recordings
- Source
- Speech segments mined from online videos
- Conditions
- In-the-wild channel and background variation
Direct Ranking
Systems on this trial set
23 reviewed systems currently have valid results.
| Rank | System | Submitted by | Trial-Set EER ↓ | Trial-Set minDCF ↓ |
|---|---|---|---|---|
| #1 |
AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
|
Public checkpoint | 9.1539 | 0.399880 |
| #2 |
W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
|
pengjy | 9.1879 | 0.571269 |
| #3 |
palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
|
Public checkpoint | 9.5363 | 0.355169 |
| #4 |
Agora Voiceprint (ResNet293)
agora_vp
|
agora_vp | 10.3751 | 0.361392 |
| #5 |
palabraai/redimnet2-b6
redimnet2
|
Public checkpoint | 10.6649 | 0.439079 |
| #6 |
wespeaker/w2vbert2
vb2-w2vbert
|
Public checkpoint | 11.0796 | 0.370165 |
| #7 |
wespeaker/samresnet100
vb2-sam100
|
Public checkpoint | 11.2390 | 0.391553 |
| #8 |
Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
|
shangguanqituan | 11.7768 | 0.407599 |
| #9 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
Public checkpoint | 12.3481 | 0.445848 |
| #10 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
Public checkpoint | 12.4707 | 0.453929 |
| #11 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
Public checkpoint | 13.5682 | 0.541793 |
| #12 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
Public checkpoint | 13.9382 | 0.496071 |
| #13 |
speechbrain/ecapa
ecapa
|
Public checkpoint | 14.8367 | 0.471104 |
| #14 |
iic/eres2net-en
eres_en
|
Public checkpoint | 15.0446 | 0.495483 |
| #15 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
Public checkpoint | 15.1680 | 0.514784 |
| #16 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
Public checkpoint | 16.5570 | 0.520405 |
| #17 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
Public checkpoint | 22.3595 | 0.801817 |
| #18 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
Public checkpoint | 22.7399 | 0.756493 |
| #19 |
wespeaker/res34-cnceleb
wespeaker_r34
|
Public checkpoint | 23.3725 | 0.793947 |
| #20 |
iic/eres2netv2-zh
eresv2_zh
|
Public checkpoint | 25.4264 | 0.772160 |
| #21 |
iic/campplus
campplus
|
Public checkpoint | 27.2155 | 0.829325 |
| #22 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
Public checkpoint | 27.2344 | 0.922910 |
| #23 |
speechbrain/xvector
xvector
|
Public checkpoint | 32.8837 | 0.867590 |