Trial Set

VoxCeleb1-O

Keeps the upstream VoxCeleb1-O verification protocol.

Source dataset
VoxCeleb1
Trials
37611
Protocol source
Official protocol
Source split
VoxCeleb1-O
voxceleb_o In-the-wild
Source Dataset

About VoxCeleb1

VoxCeleb is a large-scale speaker corpus collected from online interviews and other media. Its recordings retain real-world variation in microphones, channels, background sound, and speaking conditions. VoxCeleb1-O, E, and H use established VoxCeleb verification protocols; the short-duration entry on OpenSVBench is an additional benchmark protocol.

Language
Predominantly English
VoxCeleb1
1,251 speakers and over 100,000 recordings
Source
Speech segments mined from online videos
Conditions
In-the-wild channel and background variation
Direct Ranking

Systems on this trial set

23 reviewed systems currently have valid results.

Rank System Submitted by Trial-Set EER ↓ Trial-Set minDCF ↓
#1 wespeaker/w2vbert2
vb2-w2vbert
Public checkpoint 0.1489 0.010954
#2 palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
Public checkpoint 0.1701 0.011700
#3 AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
Public checkpoint 0.2287 0.011699
#4 wespeaker/samresnet100
vb2-sam100
Public checkpoint 0.2287 0.011966
#5 W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
pengjy 0.2658 0.025633
#6 palabraai/redimnet2-b6
redimnet2
Public checkpoint 0.2871 0.019358
#7 Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
shangguanqituan 0.3776 0.026057
#8 wespeaker/res152-voxceleb
wespeaker_resnet152
Public checkpoint 0.4998 0.035524
#9 wespeaker/res293-voxceleb
wespeaker_resnet293
Public checkpoint 0.5159 0.037014
#10 Agora Voiceprint (ResNet293)
agora_vp
agora_vp 0.6170 0.031324
#11 wespeaker/campplus-voxceleb
campplus_wespeaker
Public checkpoint 0.7180 0.061049
#12 iic/eres2net-en
eres_en
Public checkpoint 0.8028 0.053980
#13 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
Public checkpoint 0.8188 0.052968
#14 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
Public checkpoint 0.8188 0.065623
#15 speechbrain/ecapa
ecapa
Public checkpoint 0.9038 0.071152
#16 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
Public checkpoint 1.0371 0.085403
#17 microsoft/wavlm-base-plus-sv
wavlm_base
Public checkpoint 5.5047 0.436697
#18 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
Public checkpoint 5.6037 0.466737
#19 iic/eres2netv2-zh
eresv2_zh
Public checkpoint 6.3852 0.421188
#20 wespeaker/res34-cnceleb
wespeaker_r34
Public checkpoint 7.0897 0.433848
#21 iic/campplus
campplus
Public checkpoint 7.7917 0.488954
#22 speechbrain/xvector
xvector
Public checkpoint 8.9618 0.489966
#23 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
Public checkpoint 13.0837 0.638176