OpenSVBench Scenario-driven SV leaderboard
Benchmark Scenario

Noise / Reverb Robustness

How reliably the model preserves identity when room acoustics, distractor noise, and microphone placement deviate from an easier in-corpus reference condition.

Noise/reverb Noise and reverberation 1 trial set
Current Leader

wespeaker/w2vbert2

18 ranked
2.5800
scenario EER
0.074040 scenario minDCF
Scenario Coverage

1 trial set

VOiCES Noise/Reverb
Scenario Leaders

Top systems on this scenario

The current reviewed submissions for this scenario.

#1

wespeaker/w2vbert2

vb2-w2vbert
2.5800
scenario EER
0.074040 scenario minDCF
#2

wespeaker/samresnet100

vb2-sam100
2.9800
scenario EER
0.098660 scenario minDCF
#3

palabraai/redimnet2-b6

redimnet2
3.1200
scenario EER
0.114220 scenario minDCF
Scenario Ranking

Full ranking for Noise / Reverb Robustness

A scenario row first averages linked trial sets within each source dataset, then averages the source means and ranks systems by the resulting EER.

Rank System Rank Signal Scenario EER Scenario minDCF
Evidence Rank / EER by trial-set order: VOiCES Noise/Reverb
#1 wespeaker/w2vbert2
vb2-w2vbert
Leader
2.5800
0.074040
#2 wespeaker/samresnet100
vb2-sam100
Top 3
2.9800
0.098660
#3 palabraai/redimnet2-b6
redimnet2
Top 3
3.1200
0.114220
#4 iic/eres2net-en
eres_en
Competitive
4.7200
0.148640
#5 wespeaker/res152-voxceleb
wespeaker_resnet152
Competitive
5.2600
0.154640
#6 wespeaker/res293-voxceleb
wespeaker_resnet293
Competitive
5.3600
0.148780
#7 speechbrain/ecapa
ecapa
Competitive
5.5800
0.213320
#8 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
Competitive
5.9280
0.181180
#9 wespeaker/campplus-voxceleb
campplus_wespeaker
Competitive
6.4600
0.220820
#10 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
Needs work
6.6060
0.214720
#11 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
Needs work
7.6160
0.264660
#12 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
Needs work
8.7040
0.382320
#13 iic/eres2netv2-zh
eresv2_zh
Needs work
11.6800
0.402500
#14 wespeaker/res34-cnceleb
wespeaker_r34
Needs work
16.6400
0.531160
#15 speechbrain/xvector
xvector
Needs work
19.0800
0.568120
#16 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
Needs work
20.9800
0.741000
#17 microsoft/wavlm-base-plus-sv
wavlm_base
Needs work
21.0600
0.742060
#18 iic/campplus
campplus
Needs work
23.4800
0.737920