Trial Set

FFSVC 2022 Cross-Channel

Filters the official dev trial pairs to the channel/device robustness view.

Notice: This is not the original official SV trial list.

Source dataset
FFSVC 2022
Trials
72000
Protocol source
Official protocol subset
Source split
FFSVC 2022 public dev trials
ffsvc2022_cross_channel Channel/device
Source Dataset

About FFSVC 2022

The Far-field Speaker Verification Challenge 2022 (FFSVC 2022) examined speaker verification under far-field domain mismatch. Its released development trials use single-channel speech segments and cover recording-device and domain variation. OpenSVBench filters those public development pairs into channel and near/far views; these are subsets of the challenge trials, not new official challenge tracks.

Task
Far-field speaker verification
Audio format
Single-channel trial segments
Variation
Devices, recording domains, and distance
Release used here
Public development trial pairs
Direct Ranking

Systems on this trial set

23 reviewed systems currently have valid results.

Rank System Submitted by Trial-Set EER ↓ Trial-Set minDCF ↓
#1 Agora Voiceprint (ResNet293)
agora_vp
agora_vp 3.1333 0.195556
#2 W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
pengjy 5.5694 0.375361
#3 AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
Public checkpoint 5.6222 0.327056
#4 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
Public checkpoint 5.7472 0.351306
#5 iic/eres2netv2-zh
eresv2_zh
Public checkpoint 6.5083 0.420444
#6 palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
Public checkpoint 6.8083 0.362667
#7 palabraai/redimnet2-b6
redimnet2
Public checkpoint 8.6806 0.505111
#8 iic/campplus
campplus
Public checkpoint 8.7417 0.527583
#9 Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
shangguanqituan 8.8306 0.482306
#10 wespeaker/res293-voxceleb
wespeaker_resnet293
Public checkpoint 8.9944 0.524556
#11 wespeaker/samresnet100
vb2-sam100
Public checkpoint 9.0972 0.472500
#12 wespeaker/res152-voxceleb
wespeaker_resnet152
Public checkpoint 9.5111 0.545528
#13 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
Public checkpoint 10.5833 0.597111
#14 wespeaker/res34-cnceleb
wespeaker_r34
Public checkpoint 10.9389 0.677111
#15 wespeaker/w2vbert2
vb2-w2vbert
Public checkpoint 11.1389 0.529167
#16 iic/eres2net-en
eres_en
Public checkpoint 11.4278 0.615056
#17 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
Public checkpoint 12.0417 0.697056
#18 wespeaker/campplus-voxceleb
campplus_wespeaker
Public checkpoint 12.3000 0.715667
#19 speechbrain/ecapa
ecapa
Public checkpoint 12.3500 0.708500
#20 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
Public checkpoint 13.0333 0.708806
#21 speechbrain/xvector
xvector
Public checkpoint 19.4139 0.929194
#22 microsoft/wavlm-base-plus-sv
wavlm_base
Public checkpoint 26.0500 0.995778
#23 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
Public checkpoint 26.7500 0.998667