Protocol Index

Trial sets

Trial sets are the basic scored units behind the scenario and global summaries. Each page exposes the source, protocol, and direct system ranking.

26 trial sets 11 scenarios

Global leaderboard Scenario index

Fixed-Core Protocols

Trial-set index

Trial Set	Source Dataset	Protocol	Scenario Groups	Current Leader
TidyVoiceX2-ASV tidyvoice	TidyVoiceX2-ASV	Official eval-key subset + constructed completion TidyVoiceX2-ASV eval A/U	Cross-lingual	Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice) shangguanqituan
HI-MIA hi_mia	HI-MIA	Self-constructed protocol Public test split	Short-duration	Agora Voiceprint (ResNet293) agora_vp
GSC Short gsc_short	Google Speech Commands	Self-constructed protocol Official testing split	Short-duration	Agora Voiceprint (ResNet293) agora_vp
GLOBE globe	GLOBE	Self-constructed protocol GLOBE_V2 canonical HF train+test shards	Accent/dialect	W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2) pengjy
CN-Celeb cnceleb	CN-Celeb	Official protocol Official evaluation protocol	In-the-wild	iic/eres2netv2-zh Public checkpoint
CN-Celeb Genre cnceleb_genre	CN-Celeb	Self-constructed supplement CN-Celeb prepared evaluation pool	Genre shift	iic/eres2netv2-zh Public checkpoint
CN-Celeb Short cnceleb_short	CN-Celeb	Self-constructed supplement CN-Celeb prepared evaluation pool	Short-duration	W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2) pengjy
VoxCeleb1-O voxceleb_o	VoxCeleb1	Official protocol VoxCeleb1-O	In-the-wild	wespeaker/w2vbert2 Public checkpoint
VoxCeleb1-E voxceleb_e	VoxCeleb1	Official protocol VoxCeleb1-E	In-the-wild	AntSpeaker/MECT-B2 Public checkpoint
VoxCeleb1-H voxceleb_h	VoxCeleb1	Official protocol VoxCeleb1-H	In-the-wild	AntSpeaker/MECT-B2 Public checkpoint
VoxCeleb Short voxceleb_short	VoxCeleb1	Self-constructed supplement VoxCeleb1 evaluation audio	Short-duration	AntSpeaker/MECT-B2 Public checkpoint
3D-Speaker Device speaker3d_device	3D-Speaker	Official protocol 3D-Speaker device trial file	Channel/device	Agora Voiceprint (ResNet293) agora_vp
3D-Speaker Distance speaker3d_distance	3D-Speaker	Official protocol 3D-Speaker distance trial file	Distance	Agora Voiceprint (ResNet293) agora_vp
3D-Speaker Dialect speaker3d_dialect	3D-Speaker	Official protocol 3D-Speaker dialect trial file	Accent/dialect	Agora Voiceprint (ResNet293) agora_vp
FFSVC 2022 Cross-Channel ffsvc2022_cross_channel	FFSVC 2022	Official protocol subset FFSVC 2022 public dev trials	Channel/device	Agora Voiceprint (ResNet293) agora_vp
FFSVC 2022 Cross-Domain ffsvc2022_cross_domain	FFSVC 2022	Official protocol subset FFSVC 2022 public dev trials	Distance	Agora Voiceprint (ResNet293) agora_vp
Whisper40 Whisper whisper40_whisper	Whisper40	Self-constructed protocol Provided Whisper40 archive	Speaking style	W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2) pengjy
Lombard Grid Lombard lombardgrid_lombard	Lombard Grid	Self-constructed protocol Public Lombard Grid audio release	Speaking style	AntSpeaker/MECT-B2 Public checkpoint
VOiCES Noise/Reverb voices_noise_reverb	VOiCES	Self-constructed protocol subset VOiCES devkit test split	Noise/reverb	palabraai/redimnet2-b6-vb2+vox2 Public checkpoint
CHiME-6 Domestic Far-Field chime6_domestic_farfield	CHiME-6	Self-constructed protocol CHiME-6 dev split	Distance	AntSpeaker/MECT-B2 Public checkpoint
CHiME-6 Overlap chime6_overlap	CHiME-6	Self-constructed protocol CHiME-6 dev split	Overlap	W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2) pengjy
ESD esd	ESD	Self-constructed protocol Public ESD recordings	Speaking style	AntSpeaker/MECT-B2 Public checkpoint
AliMeeting Near/Far alimeeting_near_far	AliMeeting	Self-constructed protocol Public AliMeeting test-set segments	Distance	Agora Voiceprint (ResNet293) agora_vp
AliMeeting Overlap alimeeting_overlap	AliMeeting	Self-constructed protocol Public AliMeeting test-set segments	Overlap	Agora Voiceprint (ResNet293) agora_vp
VoxKnesset voxknesset	VoxKnesset	Self-constructed protocol Official VoxKnesset test split	Aging	W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2) pengjy
VoxPopuli Aging voxpopuli_cross_time	VoxPopuli	Self-constructed protocol VoxPopuli English train split	Aging	wespeaker/w2vbert2 Public checkpoint