Benchmark Scenario

Accent / Dialect Robustness

How reliably the model tracks identity across accent and dialect mismatch.

Accent/dialect Accent and dialect variation 2 trial sets

Back To Scenario Index Open Global Leaderboard

Current Leader

wespeaker/w2vbert2

18 ranked

20.4352

scenario EER

0.641166 scenario minDCF

Scenario Coverage

2 trial sets

GLOBE 3D-Speaker Dialect

Scenario Leaders

Top systems on this scenario

The current reviewed submissions for this scenario.

wespeaker/w2vbert2

vb2-w2vbert

20.4352

scenario EER

0.641166 scenario minDCF

iic/eres2net-large-3dspeaker

eres2net_large_3dspeaker

20.4447

scenario EER

0.733333 scenario minDCF

palabraai/redimnet2-b6

redimnet2

21.1330

scenario EER

0.660821 scenario minDCF

Scenario Ranking

Full ranking for Accent / Dialect Robustness

A scenario row first averages linked trial sets within each source dataset, then averages the source means and ranks systems by the resulting EER.

This Scenario All Scenarios Global Board

Rank	System	Rank Signal	Scenario EER	Scenario minDCF	Evidence Rank / EER by trial-set order: GLOBE · 3D-Speaker Dialect
#1	wespeaker/w2vbert2 vb2-w2vbert	Leader	20.4352	0.641166	#1 24.5937 #2 16.2767
#2	iic/eres2net-large-3dspeaker eres2net_large_3dspeaker	Top 3	20.4447	0.733333	#18 28.8893 #1 12.0000
#3	palabraai/redimnet2-b6 redimnet2	Top 3	21.1330	0.660821	#3 25.0193 #3 17.2467
#4	wespeaker/res152-voxceleb wespeaker_resnet152	Competitive	21.5254	0.675759	#5 25.0967 #5 17.9540
#5	wespeaker/res293-voxceleb wespeaker_resnet293	Competitive	21.7119	0.663725	#9 25.4837 #4 17.9400
#6	iic/eres2net-en eres_en	Competitive	21.9151	0.690782	#6 25.1935 #6 18.6367
#7	wespeaker/samresnet100 vb2-sam100	Competitive	22.1939	0.666463	#2 24.8065 #7 19.5813
#8	wespeaker/res34-voxceleb wespeaker_resnet34_voxceleb	Competitive	22.4273	0.700394	#4 25.0600 #8 19.7947
#9	speechbrain/ecapa ecapa	Competitive	23.5109	0.730128	#8 25.4450 #10 21.5767
#10	iic/eres2netv2-zh eresv2_zh	Needs work	23.8183	0.764092	#13 26.7067 #9 20.9300
#11	wespeaker/campplus-voxceleb campplus_wespeaker	Needs work	23.9283	0.721471	#10 25.6966 #11 22.1600
#12	wespeaker/ecapa1024-voxceleb wespeaker_ecapa1024	Needs work	24.3163	0.734606	#11 25.7740 #12 22.8587
#13	wespeaker/ecapa512-voxceleb wespeaker_ecapa512	Needs work	25.3328	0.762541	#7 25.4257 #13 25.2400
#14	wespeaker/res34-cnceleb wespeaker_r34	Needs work	25.8303	0.825746	#12 26.3293 #14 25.3313
#15	iic/campplus campplus	Needs work	28.9315	0.816441	#17 27.7090 #15 30.1540
#16	microsoft/wavlm-base-plus-sv wavlm_base	Needs work	31.3569	0.895666	#15 27.0704 #16 35.6433
#17	microsoft/unispeech-sat-base-plus-sv unispeech_sat_base_plus	Needs work	32.6058	0.912056	#14 26.9350 #17 38.2767
#18	speechbrain/xvector xvector	Needs work	34.3436	0.829337	#16 27.2639 #18 41.4233