Benchmark Scenario

Speaking-Style Robustness

Speaking style shift. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.

23 ranked systems 3 trial sets 1.9166 leading EER
ESD Whisper40 Whisper Lombard Grid Lombard
Scenario Ranking

Systems on Speaking-Style Robustness

Evidence cells list trial-set rank and EER in this order: ESD · Whisper40 Whisper · Lombard Grid Lombard.

Rank System Submitted by Scenario EER ↓ Scenario minDCF ↓ Trial-Set Evidence Rank / EER
#1 W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
pengjy 1.9166 0.153402
#2 Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
shangguanqituan 2.3500 0.152707
#3 palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
Public checkpoint 2.3792 0.145230
#4 wespeaker/w2vbert2
vb2-w2vbert
Public checkpoint 2.7895 0.157223
#5 AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
Public checkpoint 2.9458 0.150257
#6 Agora Voiceprint (ResNet293)
agora_vp
agora_vp 3.9828 0.223228
#7 wespeaker/res152-voxceleb
wespeaker_resnet152
Public checkpoint 4.1329 0.268357
#8 wespeaker/samresnet100
vb2-sam100
Public checkpoint 4.3042 0.238095
#9 wespeaker/res293-voxceleb
wespeaker_resnet293
Public checkpoint 4.3256 0.263660
#10 palabraai/redimnet2-b6
redimnet2
Public checkpoint 4.4502 0.291976
#11 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
Public checkpoint 5.0359 0.303656
#12 iic/eres2net-en
eres_en
Public checkpoint 5.4878 0.330691
#13 iic/eres2netv2-zh
eresv2_zh
Public checkpoint 5.9688 0.361679
#14 wespeaker/campplus-voxceleb
campplus_wespeaker
Public checkpoint 6.3574 0.358438
#15 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
Public checkpoint 6.5691 0.361235
#16 wespeaker/res34-cnceleb
wespeaker_r34
Public checkpoint 7.0743 0.410279
#17 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
Public checkpoint 7.1128 0.367138
#18 speechbrain/ecapa
ecapa
Public checkpoint 7.2261 0.422165
#19 iic/campplus
campplus
Public checkpoint 7.5693 0.424138
#20 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
Public checkpoint 8.6857 0.465867
#21 speechbrain/xvector
xvector
Public checkpoint 15.6681 0.597160
#22 microsoft/wavlm-base-plus-sv
wavlm_base
Public checkpoint 18.0734 0.805194
#23 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
Public checkpoint 18.1898 0.805772