Benchmark Scenario

Cross-Lingual Robustness

Cross-lingual Language mismatch 1 trial set

Back To Scenario Index Open Global Leaderboard

Current Leader

wespeaker/w2vbert2

18 ranked

4.4676

scenario EER

0.330255 scenario minDCF

Scenario Coverage

1 trial set

TidyVoiceX2-ASV

Scenario Leaders

Top systems on this scenario

wespeaker/w2vbert2

vb2-w2vbert

4.4676

scenario EER

0.330255 scenario minDCF

wespeaker/samresnet100

vb2-sam100

4.7178

scenario EER

0.362506 scenario minDCF

wespeaker/res293-voxceleb

wespeaker_resnet293

4.7483

scenario EER

0.298819 scenario minDCF

Scenario Ranking

Full ranking for Cross-Lingual Robustness

This Scenario All Scenarios Global Board

Rank	System	Rank Signal	Scenario EER	Scenario minDCF	Evidence Rank / EER by trial-set order: TidyVoiceX2-ASV
#1	wespeaker/w2vbert2 vb2-w2vbert	Leader	4.4676	0.330255	#1 4.4676
#2	wespeaker/samresnet100 vb2-sam100	Top 3	4.7178	0.362506	#2 4.7178
#3	wespeaker/res293-voxceleb wespeaker_resnet293	Top 3	4.7483	0.298819	#3 4.7483
#4	palabraai/redimnet2-b6 redimnet2	Competitive	4.7707	0.339730	#4 4.7707
#5	wespeaker/res152-voxceleb wespeaker_resnet152	Competitive	4.8269	0.305505	#5 4.8269
#6	iic/eres2netv2-zh eresv2_zh	Competitive	5.3320	0.299692	#6 5.3320
#7	iic/eres2net-en eres_en	Competitive	5.5284	0.374254	#7 5.5284
#8	wespeaker/res34-voxceleb wespeaker_resnet34_voxceleb	Competitive	5.5532	0.361444	#8 5.5532
#9	wespeaker/campplus-voxceleb campplus_wespeaker	Competitive	6.1851	0.403050	#9 6.1851
#10	iic/campplus campplus	Needs work	6.4713	0.346271	#10 6.4713
#11	wespeaker/ecapa512-voxceleb wespeaker_ecapa512	Needs work	6.5083	0.405096	#11 6.5083
#12	wespeaker/ecapa1024-voxceleb wespeaker_ecapa1024	Needs work	6.9847	0.436029	#12 6.9847
#13	wespeaker/res34-cnceleb wespeaker_r34	Needs work	7.5770	0.460771	#13 7.5770
#14	speechbrain/ecapa ecapa	Needs work	7.6275	0.509746	#14 7.6275
#15	iic/eres2net-large-3dspeaker eres2net_large_3dspeaker	Needs work	8.5536	0.499376	#15 8.5536
#16	speechbrain/xvector xvector	Needs work	14.0989	0.582957	#16 14.0989
#17	microsoft/wavlm-base-plus-sv wavlm_base	Needs work	21.7152	0.966351	#17 21.7152
#18	microsoft/unispeech-sat-base-plus-sv unispeech_sat_base_plus	Needs work	23.2288	0.970581	#18 23.2288