Benchmark Scenario

Accent / Dialect Robustness

Accent/dialect Accent and dialect variation 2 trial sets

Back To Scenario Index Open Global Leaderboard

Current Leader

wespeaker/w2vbert2

18 ranked

20.4352

scenario EER

0.641166 scenario minDCF

Scenario Coverage

2 trial sets

GLOBE 3D-Speaker Dialect

Scenario Leaders

Top systems on this scenario

wespeaker/w2vbert2

vb2-w2vbert

20.4352

scenario EER

0.641166 scenario minDCF

iic/eres2net-large-3dspeaker

eres2net_large_3dspeaker

20.4447

scenario EER

0.733333 scenario minDCF

palabraai/redimnet2-b6

redimnet2

21.1330

scenario EER

0.660821 scenario minDCF

Scenario Ranking

Full ranking for Accent / Dialect Robustness

This Scenario All Scenarios Global Board

Rank	System	Rank Signal	Scenario EER	Scenario minDCF	Evidence Rank / EER by trial-set order: GLOBE · 3D-Speaker Dialect
#1	wespeaker/w2vbert2 vb2-w2vbert	Leader	20.4352	0.641166	#1 24.5937 #2 16.2767
#2	iic/eres2net-large-3dspeaker eres2net_large_3dspeaker	Top 3	20.4447	0.733333	#18 28.8893 #1 12.0000
#3	palabraai/redimnet2-b6 redimnet2	Top 3	21.1330	0.660821	#3 25.0193 #3 17.2467
#4	wespeaker/res152-voxceleb wespeaker_resnet152	Competitive	21.5254	0.675759	#5 25.0967 #5 17.9540
#5	wespeaker/res293-voxceleb wespeaker_resnet293	Competitive	21.7119	0.663725	#9 25.4837 #4 17.9400
#6	iic/eres2net-en eres_en	Competitive	21.9151	0.690782	#6 25.1935 #6 18.6367
#7	wespeaker/samresnet100 vb2-sam100	Competitive	22.1939	0.666463	#2 24.8065 #7 19.5813
#8	wespeaker/res34-voxceleb wespeaker_resnet34_voxceleb	Competitive	22.4273	0.700394	#4 25.0600 #8 19.7947
#9	speechbrain/ecapa ecapa	Competitive	23.5109	0.730128	#8 25.4450 #10 21.5767
#10	iic/eres2netv2-zh eresv2_zh	Needs work	23.8183	0.764092	#13 26.7067 #9 20.9300
#11	wespeaker/campplus-voxceleb campplus_wespeaker	Needs work	23.9283	0.721471	#10 25.6966 #11 22.1600
#12	wespeaker/ecapa1024-voxceleb wespeaker_ecapa1024	Needs work	24.3163	0.734606	#11 25.7740 #12 22.8587
#13	wespeaker/ecapa512-voxceleb wespeaker_ecapa512	Needs work	25.3328	0.762541	#7 25.4257 #13 25.2400
#14	wespeaker/res34-cnceleb wespeaker_r34	Needs work	25.8303	0.825746	#12 26.3293 #14 25.3313
#15	iic/campplus campplus	Needs work	28.9315	0.816441	#17 27.7090 #15 30.1540
#16	microsoft/wavlm-base-plus-sv wavlm_base	Needs work	31.3569	0.895666	#15 27.0704 #16 35.6433
#17	microsoft/unispeech-sat-base-plus-sv unispeech_sat_base_plus	Needs work	32.6058	0.912056	#14 26.9350 #17 38.2767
#18	speechbrain/xvector xvector	Needs work	34.3436	0.829337	#16 27.2639 #18 41.4233