Trial Set
CHiME-6 Domestic Far-Field
Uses dev sessions with location/ref metadata to build wearable-to-array domestic far-field trials.
- Source dataset
- CHiME-6
- Trials
- 36487
- Protocol source
- Self-constructed protocol
- Source split
- CHiME-6 dev split
Source Dataset
About CHiME-6
CHiME-6 is a corpus of conversational speech recorded during dinner parties in real homes. It was designed for distant-microphone speech recognition and diarization, with wearable microphones and synchronized microphone arrays capturing overlapping conversation and everyday household noise. OpenSVBench uses the public development sessions to construct separate domestic far-field and overlap trials.
- Language
- English
- Sessions
- 20 dinner-party sessions in four homes
- Recording
- Wearable microphones and multi-channel arrays
- Conditions
- Natural conversation, household noise, and speaker overlap
Direct Ranking
Systems on this trial set
23 reviewed systems currently have valid results.
| Rank | System | Submitted by | Trial-Set EER ↓ | Trial-Set minDCF ↓ |
|---|---|---|---|---|
| #1 |
AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
|
Public checkpoint | 6.2828 | 0.277510 |
| #2 |
W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
|
pengjy | 6.5421 | 0.343925 |
| #3 |
wespeaker/w2vbert2
vb2-w2vbert
|
Public checkpoint | 6.6928 | 0.260295 |
| #4 |
palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
|
Public checkpoint | 7.3741 | 0.266385 |
| #5 |
Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
|
shangguanqituan | 7.7781 | 0.310431 |
| #6 |
Agora Voiceprint (ResNet293)
agora_vp
|
agora_vp | 7.9289 | 0.329545 |
| #7 |
wespeaker/samresnet100
vb2-sam100
|
Public checkpoint | 8.4112 | 0.319174 |
| #8 |
palabraai/redimnet2-b6
redimnet2
|
Public checkpoint | 8.4715 | 0.379560 |
| #9 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
Public checkpoint | 11.1336 | 0.435876 |
| #10 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
Public checkpoint | 12.0320 | 0.480796 |
| #11 |
iic/eres2net-en
eres_en
|
Public checkpoint | 12.0892 | 0.487278 |
| #12 |
speechbrain/ecapa
ecapa
|
Public checkpoint | 12.4299 | 0.530841 |
| #13 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
Public checkpoint | 13.0540 | 0.549864 |
| #14 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
Public checkpoint | 13.6569 | 0.577058 |
| #15 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
Public checkpoint | 13.6871 | 0.500573 |
| #16 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
Public checkpoint | 15.1040 | 0.585680 |
| #17 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
Public checkpoint | 17.2988 | 0.733554 |
| #18 |
iic/eres2netv2-zh
eresv2_zh
|
Public checkpoint | 18.3901 | 0.771721 |
| #19 |
wespeaker/res34-cnceleb
wespeaker_r34
|
Public checkpoint | 22.9123 | 0.914742 |
| #20 |
speechbrain/xvector
xvector
|
Public checkpoint | 23.8288 | 0.972807 |
| #21 |
iic/campplus
campplus
|
Public checkpoint | 24.2086 | 0.902834 |
| #22 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
Public checkpoint | 26.7802 | 0.970516 |
| #23 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
Public checkpoint | 29.0021 | 0.989720 |