Benchmark Scenario

Accent / Dialect Robustness

Accent and dialect variation. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.

23 ranked systems 2 trial sets 16.8217 leading EER
GLOBE 3D-Speaker Dialect
Scenario Ranking

Systems on Accent / Dialect Robustness

Evidence cells list trial-set rank and EER in this order: GLOBE · 3D-Speaker Dialect.

Rank System Submitted by Scenario EER ↓ Scenario minDCF ↓ Trial-Set Evidence Rank / EER
#1 Agora Voiceprint (ResNet293)
agora_vp
agora_vp 16.8217 0.520196
#2 W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
pengjy 19.1844 0.677736
#3 AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
Public checkpoint 19.9909 0.569899
#4 wespeaker/w2vbert2
vb2-w2vbert
Public checkpoint 20.4352 0.641166
#5 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
Public checkpoint 20.4447 0.733333
#6 Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
shangguanqituan 20.7584 0.640224
#7 palabraai/redimnet2-b6
redimnet2
Public checkpoint 21.1330 0.660821
#8 palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
Public checkpoint 21.1791 0.581639
#9 wespeaker/res152-voxceleb
wespeaker_resnet152
Public checkpoint 21.5254 0.675759
#10 wespeaker/res293-voxceleb
wespeaker_resnet293
Public checkpoint 21.7119 0.663725
#11 iic/eres2net-en
eres_en
Public checkpoint 21.9151 0.690782
#12 wespeaker/samresnet100
vb2-sam100
Public checkpoint 22.1939 0.666463
#13 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
Public checkpoint 22.4273 0.700394
#14 speechbrain/ecapa
ecapa
Public checkpoint 23.5109 0.730128
#15 iic/eres2netv2-zh
eresv2_zh
Public checkpoint 23.8183 0.764092
#16 wespeaker/campplus-voxceleb
campplus_wespeaker
Public checkpoint 23.9283 0.721471
#17 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
Public checkpoint 24.3163 0.734606
#18 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
Public checkpoint 25.3328 0.762541
#19 wespeaker/res34-cnceleb
wespeaker_r34
Public checkpoint 25.8303 0.825746
#20 iic/campplus
campplus
Public checkpoint 28.9315 0.816441
#21 microsoft/wavlm-base-plus-sv
wavlm_base
Public checkpoint 31.3569 0.895666
#22 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
Public checkpoint 32.6058 0.912056
#23 speechbrain/xvector
xvector
Public checkpoint 34.3436 0.829337