Benchmark Scenario

In-The-Wild Robustness

Open-domain media speech. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.

23 ranked systems 4 trial sets 3.7217 leading EER

CN-Celeb VoxCeleb1-O VoxCeleb1-E VoxCeleb1-H

Scenario Ranking

Systems on In-The-Wild Robustness

Evidence cells list trial-set rank and EER in this order: CN-Celeb · VoxCeleb1-O · VoxCeleb1-E · VoxCeleb1-H.

Rank	System	Submitted by	Scenario EER ↓	Scenario minDCF ↓	Trial-Set Evidence Rank / EER
#1	AntSpeaker/MECT-B2 antspeaker-mect-b2-vb2-full-core	Public checkpoint	3.7217	0.130256	#4 7.0910 #3 0.2287 #1 0.2901 #1 0.5387
#2	W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2) Wav2Vec2-BERT	pengjy	3.7710	0.155142	#3 7.0671 #5 0.2658 #4 0.4005 #4 0.7583
#3	palabraai/redimnet2-b6-vb2+vox2 redimnet2-b6-vb2vox2-lm-full-core	Public checkpoint	4.1123	0.141370	#6 7.8288 #2 0.1701 #3 0.3387 #2 0.6788
#4	Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice) duallora-w2vbert2-tidyvoice-full-core	shangguanqituan	4.2581	0.150654	#7 7.8964 #7 0.3776 #8 0.5436 #6 0.9380
#5	Agora Voiceprint (ResNet293) agora_vp	agora_vp	4.8843	0.165519	#8 8.9045 #10 0.6170 #9 0.6878 #9 1.2872
#6	wespeaker/w2vbert2 vb2-w2vbert	Public checkpoint	5.1834	0.162046	#9 9.9690 #1 0.1489 #2 0.3146 #3 0.7298
#7	wespeaker/samresnet100 vb2-sam100	Public checkpoint	5.2487	0.170274	#10 9.9803 #4 0.2287 #6 0.4564 #5 0.8665
#8	iic/eres2netv2-zh eresv2_zh	Public checkpoint	5.5369	0.294964	#1 3.8243 #19 6.3852 #19 6.3659 #19 8.9975
#9	wespeaker/res152-voxceleb wespeaker_resnet152	Public checkpoint	6.1011	0.224787	#11 11.3672 #8 0.4998 #11 0.7174 #10 1.2879
#10	palabraai/redimnet2-b6 redimnet2	Public checkpoint	6.4216	0.208137	#14 12.2444 #6 0.2871 #7 0.5198 #8 0.9892
#11	wespeaker/res34-voxceleb wespeaker_resnet34_voxceleb	Public checkpoint	6.5576	0.240625	#12 11.9718 #13 0.8188 #13 0.9347 #12 1.6768
#12	wespeaker/res293-voxceleb wespeaker_resnet293	Public checkpoint	6.6344	0.231795	#15 12.4334 #9 0.5159 #10 0.7016 #11 1.2890
#13	iic/eres2net-en eres_en	Public checkpoint	6.6673	0.251235	#13 12.1487 #12 0.8028 #14 0.9682 #14 1.7866
#14	iic/campplus campplus	Public checkpoint	6.8211	0.361956	#2 4.7029 #21 7.7917 #21 7.9032 #21 11.1228
#15	wespeaker/res34-cnceleb wespeaker_r34	Public checkpoint	7.8434	0.404734	#5 7.4729 #20 7.0897 #20 7.1685 #20 10.3836
#16	speechbrain/ecapa ecapa	Public checkpoint	7.9977	0.317381	#17 15.2177 #15 0.9038 #5 0.4563 #7 0.9731
#17	wespeaker/campplus-voxceleb campplus_wespeaker	Public checkpoint	8.4036	0.311533	#18 15.7139 #11 0.7180 #12 0.8789 #13 1.6832
#18	wespeaker/ecapa1024-voxceleb wespeaker_ecapa1024	Public checkpoint	8.5204	0.308148	#19 15.8209 #14 0.8188 #15 0.9899 #15 1.8513
#19	wespeaker/ecapa512-voxceleb wespeaker_ecapa512	Public checkpoint	8.9203	0.324306	#20 16.3391 #16 1.0371 #16 1.2104 #16 2.2570
#20	iic/eres2net-large-3dspeaker eres2net_large_3dspeaker	Public checkpoint	14.2563	0.581636	#16 14.0524 #23 13.0837 #23 13.1915 #23 17.1053
#21	microsoft/wavlm-base-plus-sv wavlm_base	Public checkpoint	16.5057	0.632600	#22 27.9358 #17 5.5047 #17 3.2098 #17 6.5121
#22	speechbrain/xvector xvector	Public checkpoint	17.4683	0.675055	#21 24.2749 #22 8.9618 #22 9.1649 #22 13.8588
#23	microsoft/unispeech-sat-base-plus-sv unispeech_sat_base_plus	Public checkpoint	17.6846	0.670598	#23 29.8022 #18 5.6037 #18 3.6382 #18 7.4593