Benchmark Scenario
Noise / Reverb Robustness
How reliably the model preserves identity when room acoustics, distractor noise, and microphone placement deviate from an easier in-corpus reference condition.
Current Leader
18 ranked
wespeaker/w2vbert2
2.5800
scenario EER
0.074040 scenario minDCF
Scenario Coverage
1 trial set
VOiCES Noise/Reverb
Scenario Leaders
Top systems on this scenario
The current reviewed submissions for this scenario.
Scenario Ranking
Full ranking for Noise / Reverb Robustness
A scenario row first averages linked trial sets within each source dataset, then averages the source means and ranks systems by the resulting EER.
| Rank | System | Rank Signal | Scenario EER | Scenario minDCF |
Evidence
Rank / EER by trial-set order: VOiCES Noise/Reverb
|
|---|---|---|---|---|---|
| #1 |
wespeaker/w2vbert2
vb2-w2vbert
|
Leader
|
2.5800
|
0.074040 | |
| #2 |
wespeaker/samresnet100
vb2-sam100
|
Top 3
|
2.9800
|
0.098660 | |
| #3 |
palabraai/redimnet2-b6
redimnet2
|
Top 3
|
3.1200
|
0.114220 | |
| #4 |
iic/eres2net-en
eres_en
|
Competitive
|
4.7200
|
0.148640 | |
| #5 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
Competitive
|
5.2600
|
0.154640 | |
| #6 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
Competitive
|
5.3600
|
0.148780 | |
| #7 |
speechbrain/ecapa
ecapa
|
Competitive
|
5.5800
|
0.213320 | |
| #8 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
Competitive
|
5.9280
|
0.181180 | |
| #9 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
Competitive
|
6.4600
|
0.220820 | |
| #10 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
Needs work
|
6.6060
|
0.214720 | |
| #11 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
Needs work
|
7.6160
|
0.264660 | |
| #12 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
Needs work
|
8.7040
|
0.382320 | |
| #13 |
iic/eres2netv2-zh
eresv2_zh
|
Needs work
|
11.6800
|
0.402500 | |
| #14 |
wespeaker/res34-cnceleb
wespeaker_r34
|
Needs work
|
16.6400
|
0.531160 | |
| #15 |
speechbrain/xvector
xvector
|
Needs work
|
19.0800
|
0.568120 | |
| #16 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
Needs work
|
20.9800
|
0.741000 | |
| #17 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
Needs work
|
21.0600
|
0.742060 | |
| #18 |
iic/campplus
campplus
|
Needs work
|
23.4800
|
0.737920 |