Benchmark Scenario
Cross-Lingual Robustness
How well speaker identity survives enrollment-test language mismatch.
Current Leader
18 ranked
wespeaker/w2vbert2
4.4676
scenario EER
0.330255 scenario minDCF
Scenario Coverage
1 trial set
TidyVoiceX2-ASV
Scenario Leaders
Top systems on this scenario
The current reviewed submissions for this scenario.
Scenario Ranking
Full ranking for Cross-Lingual Robustness
A scenario row first averages linked trial sets within each source dataset, then averages the source means and ranks systems by the resulting EER.
| Rank | System | Rank Signal | Scenario EER | Scenario minDCF |
Evidence
Rank / EER by trial-set order: TidyVoiceX2-ASV
|
|---|---|---|---|---|---|
| #1 |
wespeaker/w2vbert2
vb2-w2vbert
|
Leader
|
4.4676
|
0.330255 | |
| #2 |
wespeaker/samresnet100
vb2-sam100
|
Top 3
|
4.7178
|
0.362506 | |
| #3 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
Top 3
|
4.7483
|
0.298819 | |
| #4 |
palabraai/redimnet2-b6
redimnet2
|
Competitive
|
4.7707
|
0.339730 | |
| #5 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
Competitive
|
4.8269
|
0.305505 | |
| #6 |
iic/eres2netv2-zh
eresv2_zh
|
Competitive
|
5.3320
|
0.299692 | |
| #7 |
iic/eres2net-en
eres_en
|
Competitive
|
5.5284
|
0.374254 | |
| #8 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
Competitive
|
5.5532
|
0.361444 | |
| #9 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
Competitive
|
6.1851
|
0.403050 | |
| #10 |
iic/campplus
campplus
|
Needs work
|
6.4713
|
0.346271 | |
| #11 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
Needs work
|
6.5083
|
0.405096 | |
| #12 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
Needs work
|
6.9847
|
0.436029 | |
| #13 |
wespeaker/res34-cnceleb
wespeaker_r34
|
Needs work
|
7.5770
|
0.460771 | |
| #14 |
speechbrain/ecapa
ecapa
|
Needs work
|
7.6275
|
0.509746 | |
| #15 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
Needs work
|
8.5536
|
0.499376 | |
| #16 |
speechbrain/xvector
xvector
|
Needs work
|
14.0989
|
0.582957 | |
| #17 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
Needs work
|
21.7152
|
0.966351 | |
| #18 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
Needs work
|
23.2288
|
0.970581 |