Benchmark Scenario

Overlap Robustness

Overlapping speakers. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.

23 ranked systems 2 trial sets 8.1093 leading EER
AliMeeting Overlap CHiME-6 Overlap
Scenario Ranking

Systems on Overlap Robustness

Evidence cells list trial-set rank and EER in this order: AliMeeting Overlap · CHiME-6 Overlap.

Rank System Submitted by Scenario EER ↓ Scenario minDCF ↓ Trial-Set Evidence Rank / EER
#1 W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
pengjy 8.1093 0.560809
#2 palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
Public checkpoint 8.9944 0.440323
#3 AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
Public checkpoint 9.0061 0.442528
#4 Agora Voiceprint (ResNet293)
agora_vp
agora_vp 9.3858 0.412967
#5 Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
shangguanqituan 9.8938 0.450429
#6 wespeaker/w2vbert2
vb2-w2vbert
Public checkpoint 10.1383 0.467346
#7 palabraai/redimnet2-b6
redimnet2
Public checkpoint 10.6981 0.524446
#8 wespeaker/samresnet100
vb2-sam100
Public checkpoint 11.0912 0.502019
#9 wespeaker/res293-voxceleb
wespeaker_resnet293
Public checkpoint 12.3294 0.554516
#10 wespeaker/res152-voxceleb
wespeaker_resnet152
Public checkpoint 12.9553 0.565796
#11 iic/eres2net-en
eres_en
Public checkpoint 13.7639 0.580907
#12 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
Public checkpoint 13.9414 0.591408
#13 wespeaker/campplus-voxceleb
campplus_wespeaker
Public checkpoint 14.0816 0.622128
#14 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
Public checkpoint 14.3667 0.552132
#15 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
Public checkpoint 14.6411 0.618143
#16 speechbrain/ecapa
ecapa
Public checkpoint 14.8522 0.616222
#17 iic/eres2netv2-zh
eresv2_zh
Public checkpoint 14.8800 0.543251
#18 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
Public checkpoint 14.9489 0.650355
#19 wespeaker/res34-cnceleb
wespeaker_r34
Public checkpoint 16.4122 0.671276
#20 iic/campplus
campplus
Public checkpoint 18.6371 0.617367
#21 speechbrain/xvector
xvector
Public checkpoint 23.2363 0.916343
#22 microsoft/wavlm-base-plus-sv
wavlm_base
Public checkpoint 26.0906 0.926016
#23 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
Public checkpoint 26.5022 0.944448