Benchmark Scenario
Speaking-Style Robustness
Current Leader
18 ranked
wespeaker/w2vbert2
2.7895
scenario EER
0.157223 scenario minDCF
Scenario Coverage
3 trial sets
ESD
Whisper40 Whisper
Lombard Grid Lombard
Scenario Leaders
Top systems on this scenario
Scenario Ranking
Full ranking for Speaking-Style Robustness
| Rank | System | Rank Signal | Scenario EER | Scenario minDCF |
Evidence
Rank / EER by trial-set order: ESD · Whisper40 Whisper · Lombard Grid Lombard
|
|---|---|---|---|---|---|
| #1 |
wespeaker/w2vbert2
vb2-w2vbert
|
Leader
|
2.7895
|
0.157223 | |
| #2 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
Top 3
|
4.1329
|
0.268357 | |
| #3 |
wespeaker/samresnet100
vb2-sam100
|
Top 3
|
4.3042
|
0.238095 | |
| #4 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
Competitive
|
4.3256
|
0.263660 | |
| #5 |
palabraai/redimnet2-b6
redimnet2
|
Competitive
|
4.4502
|
0.291976 | |
| #6 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
Competitive
|
5.0359
|
0.303656 | |
| #7 |
iic/eres2net-en
eres_en
|
Competitive
|
5.4878
|
0.330691 | |
| #8 |
iic/eres2netv2-zh
eresv2_zh
|
Competitive
|
5.9688
|
0.361679 | |
| #9 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
Competitive
|
6.3574
|
0.358438 | |
| #10 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
Needs work
|
6.5691
|
0.361235 | |
| #11 |
wespeaker/res34-cnceleb
wespeaker_r34
|
Needs work
|
7.0743
|
0.410279 | |
| #12 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
Needs work
|
7.1128
|
0.367138 | |
| #13 |
speechbrain/ecapa
ecapa
|
Needs work
|
7.2261
|
0.422165 | |
| #14 |
iic/campplus
campplus
|
Needs work
|
7.5693
|
0.424138 | |
| #15 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
Needs work
|
8.6857
|
0.465867 | |
| #16 |
speechbrain/xvector
xvector
|
Needs work
|
15.6681
|
0.597160 | |
| #17 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
Needs work
|
18.0734
|
0.805194 | |
| #18 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
Needs work
|
18.1898
|
0.805772 |