Benchmark Scenario

Channel / Device Robustness

Device and channel variation. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.

23 ranked systems 2 trial sets 4.0023 leading EER
3D-Speaker Device FFSVC 2022 Cross-Channel
Scenario Ranking

Systems on Channel / Device Robustness

Evidence cells list trial-set rank and EER in this order: 3D-Speaker Device · FFSVC 2022 Cross-Channel.

Rank System Submitted by Scenario EER ↓ Scenario minDCF ↓ Trial-Set Evidence Rank / EER
#1 Agora Voiceprint (ResNet293)
agora_vp
agora_vp 4.0023 0.253548
#2 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
Public checkpoint 6.3103 0.401249
#3 W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
pengjy 8.2077 0.509507
#4 AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
Public checkpoint 9.0921 0.435914
#5 palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
Public checkpoint 11.1008 0.464227
#6 Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
shangguanqituan 11.8279 0.598239
#7 iic/eres2netv2-zh
eresv2_zh
Public checkpoint 11.9758 0.644862
#8 palabraai/redimnet2-b6
redimnet2
Public checkpoint 12.9753 0.641859
#9 wespeaker/w2vbert2
vb2-w2vbert
Public checkpoint 13.2628 0.581970
#10 wespeaker/res293-voxceleb
wespeaker_resnet293
Public checkpoint 13.9682 0.677811
#11 wespeaker/samresnet100
vb2-sam100
Public checkpoint 14.0169 0.591790
#12 wespeaker/res152-voxceleb
wespeaker_resnet152
Public checkpoint 14.2456 0.688961
#13 iic/campplus
campplus
Public checkpoint 14.4608 0.722188
#14 iic/eres2net-en
eres_en
Public checkpoint 15.1872 0.730291
#15 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
Public checkpoint 15.2050 0.728816
#16 speechbrain/ecapa
ecapa
Public checkpoint 16.6850 0.817560
#17 wespeaker/campplus-voxceleb
campplus_wespeaker
Public checkpoint 17.8800 0.826833
#18 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
Public checkpoint 18.4567 0.824736
#19 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
Public checkpoint 18.7142 0.846298
#20 wespeaker/res34-cnceleb
wespeaker_r34
Public checkpoint 18.9178 0.837962
#21 speechbrain/xvector
xvector
Public checkpoint 31.0227 0.964547
#22 microsoft/wavlm-base-plus-sv
wavlm_base
Public checkpoint 31.2817 0.997779
#23 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
Public checkpoint 31.7857 0.999283