Benchmark Scenario

Distance Robustness

How much performance changes across meeting and domestic distance mismatch.

Distance Distance mismatch 4 trial sets

Back To Scenario Index Open Global Leaderboard

Current Leader

iic/eres2net-large-3dspeaker

18 ranked

9.2638

scenario EER

0.454491 scenario minDCF

Scenario Coverage

4 trial sets

3D-Speaker Distance AliMeeting Near/Far CHiME-6 Domestic Far-Field FFSVC 2022 Cross-Domain

Scenario Leaders

Top systems on this scenario

The current reviewed submissions for this scenario.

iic/eres2net-large-3dspeaker

eres2net_large_3dspeaker

9.2638

scenario EER

0.454491 scenario minDCF

wespeaker/w2vbert2

vb2-w2vbert

10.1885

scenario EER

0.403238 scenario minDCF

palabraai/redimnet2-b6

redimnet2

11.0799

scenario EER

0.472944 scenario minDCF

Scenario Ranking

Full ranking for Distance Robustness

A scenario row first averages linked trial sets within each source dataset, then averages the source means and ranks systems by the resulting EER.

This Scenario All Scenarios Global Board

Rank	System	Rank Signal	Scenario EER	Scenario minDCF	Evidence Rank / EER by trial-set order: 3D-Speaker Distance · AliMeeting Near/Far · CHiME-6 Domestic Far-Field · FFSVC 2022 Cross-Domain
#1	iic/eres2net-large-3dspeaker eres2net_large_3dspeaker	Leader	9.2638	0.454491	#1 10.3440 #1 3.6000 #12 17.2988 #1 5.8125
#2	wespeaker/w2vbert2 vb2-w2vbert	Top 3	10.1885	0.403238	#3 16.0613 #3 6.6900 #1 6.6928 #10 11.3097
#3	palabraai/redimnet2-b6 redimnet2	Top 3	11.0799	0.472944	#5 17.6447 #10 9.3150 #3 8.4715 #4 8.8886
#4	wespeaker/samresnet100 vb2-sam100	Competitive	11.1679	0.421520	#8 18.4835 #5 8.5605 #2 8.4112 #6 9.2164
#5	iic/eres2netv2-zh eresv2_zh	Competitive	11.2737	0.537866	#2 14.1380 #2 5.8680 #13 18.3901 #2 6.6987
#6	wespeaker/res293-voxceleb wespeaker_resnet293	Competitive	11.7700	0.508920	#7 18.0185 #6 8.7900 #4 11.1336 #5 9.1379
#7	wespeaker/res152-voxceleb wespeaker_resnet152	Competitive	11.9552	0.523450	#4 17.5655 #4 8.5600 #5 12.0320 #7 9.6636
#8	iic/eres2net-en eres_en	Competitive	12.5832	0.554135	#6 17.8119 #8 8.8700 #6 12.0892 #11 11.5618
#9	wespeaker/res34-voxceleb wespeaker_resnet34_voxceleb	Competitive	12.9967	0.561170	#9 18.6760 #9 8.8800 #10 13.6871 #8 10.7439
#10	speechbrain/ecapa ecapa	Needs work	14.3300	0.630306	#10 21.5753 #12 10.8485 #7 12.4299 #14 12.4662
#11	wespeaker/campplus-voxceleb campplus_wespeaker	Needs work	14.6792	0.634129	#11 22.2628 #13 10.9720 #8 13.0540 #13 12.4278
#12	wespeaker/ecapa1024-voxceleb wespeaker_ecapa1024	Needs work	15.4440	0.640785	#13 23.6657 #14 11.2950 #9 13.6569 #15 13.1585
#13	wespeaker/ecapa512-voxceleb wespeaker_ecapa512	Needs work	16.0447	0.664732	#15 25.4467 #15 11.4500 #11 15.1040 #12 12.1783
#14	iic/campplus campplus	Needs work	16.4489	0.675161	#12 23.4511 #11 9.3825 #16 24.2086 #3 8.7533
#15	wespeaker/res34-cnceleb wespeaker_r34	Needs work	16.9924	0.739294	#14 25.1560 #7 8.8500 #14 22.9123 #9 11.0514
#16	speechbrain/xvector xvector	Needs work	24.6461	0.923625	#18 39.6313 #16 15.6150 #15 23.8288 #16 19.5093
#17	microsoft/unispeech-sat-base-plus-sv unispeech_sat_base_plus	Needs work	28.8455	0.982128	#17 37.8673 #17 23.7800 #17 26.7802 #18 26.9545
#18	microsoft/wavlm-base-plus-sv wavlm_base	Needs work	29.1056	0.976812	#16 37.3027 #18 23.9055 #18 29.0021 #17 26.2121