Benchmark Scenario

Genre-Shift Robustness

Source-genre variation. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.

23 ranked systems 1 trial set 14.2725 leading EER
CN-Celeb Genre
Scenario Ranking

Systems on Genre-Shift Robustness

Evidence cells list trial-set rank and EER in this order: CN-Celeb Genre.

Rank System Submitted by Scenario EER ↓ Scenario minDCF ↓ Trial-Set Evidence Rank / EER
#1 iic/eres2netv2-zh
eresv2_zh
Public checkpoint 14.2725 0.527525
#2 wespeaker/res34-cnceleb
wespeaker_r34
Public checkpoint 15.6955 0.591628
#3 iic/campplus
campplus
Public checkpoint 16.8815 0.610655
#4 W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
pengjy 19.0005 0.737320
#5 Agora Voiceprint (ResNet293)
agora_vp
agora_vp 21.9825 0.674857
#6 Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
shangguanqituan 22.2000 0.654345
#7 AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
Public checkpoint 23.4125 0.648552
#8 palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
Public checkpoint 23.5245 0.640800
#9 wespeaker/samresnet100
vb2-sam100
Public checkpoint 25.1200 0.674765
#10 palabraai/redimnet2-b6
redimnet2
Public checkpoint 25.4550 0.740052
#11 wespeaker/w2vbert2
vb2-w2vbert
Public checkpoint 25.9200 0.656577
#12 wespeaker/res152-voxceleb
wespeaker_resnet152
Public checkpoint 26.2472 0.806172
#13 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
Public checkpoint 26.5125 0.822805
#14 wespeaker/res293-voxceleb
wespeaker_resnet293
Public checkpoint 26.8575 0.811767
#15 iic/eres2net-en
eres_en
Public checkpoint 27.7395 0.802170
#16 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
Public checkpoint 28.4850 0.888960
#17 speechbrain/ecapa
ecapa
Public checkpoint 29.5690 0.883898
#18 wespeaker/campplus-voxceleb
campplus_wespeaker
Public checkpoint 29.6497 0.829445
#19 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
Public checkpoint 30.8550 0.849922
#20 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
Public checkpoint 31.1025 0.910323
#21 speechbrain/xvector
xvector
Public checkpoint 36.7857 0.987563
#22 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
Public checkpoint 37.0343 0.985940
#23 microsoft/wavlm-base-plus-sv
wavlm_base
Public checkpoint 38.3800 0.975515