Trial Set
Lombard Grid Lombard
Builds plain-to-Lombard SV trials from the public Lombard Grid release because no upstream SV trial keys are used.
- Source dataset
- Lombard Grid
- Trials
- 29524
- Protocol source
- Self-constructed protocol
- Source split
- Public Lombard Grid audio release
Source Dataset
About Lombard Grid
The Lombard Grid corpus records English speakers producing ordinary and Lombard speech, the louder, more effortful style people often adopt in noise. It includes synchronized frontal and profile video, although OpenSVBench uses only the audio. The release contains 5,400 utterances from 54 talkers, split evenly between Lombard and plain reference speech.
- Language
- English
- Speakers
- 54 talkers
- Recordings
- 5,400 utterances
- Conditions
- Plain speech and noise-induced Lombard speech
Direct Ranking
Systems on this trial set
23 reviewed systems currently have valid results.
| Rank | System | Submitted by | Trial-Set EER ↓ | Trial-Set minDCF ↓ |
|---|---|---|---|---|
| #1 |
AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
|
Public checkpoint | 0.0075 | 0.000373 |
| #2 |
W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
|
pengjy | 0.0149 | 0.001118 |
| #3 |
Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
|
shangguanqituan | 0.0186 | 0.001863 |
| #4 |
palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
|
Public checkpoint | 0.0373 | 0.001453 |
| #5 |
wespeaker/samresnet100
vb2-sam100
|
Public checkpoint | 0.0373 | 0.004657 |
| #6 |
wespeaker/w2vbert2
vb2-w2vbert
|
Public checkpoint | 0.0559 | 0.005104 |
| #7 |
Agora Voiceprint (ResNet293)
agora_vp
|
agora_vp | 0.0708 | 0.002534 |
| #8 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
Public checkpoint | 0.0745 | 0.011736 |
| #9 |
palabraai/redimnet2-b6
redimnet2
|
Public checkpoint | 0.0782 | 0.007675 |
| #10 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
Public checkpoint | 0.1490 | 0.010991 |
| #11 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
Public checkpoint | 0.1490 | 0.014754 |
| #12 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
Public checkpoint | 0.2235 | 0.015499 |
| #13 |
iic/eres2net-en
eres_en
|
Public checkpoint | 0.2235 | 0.014903 |
| #14 |
speechbrain/ecapa
ecapa
|
Public checkpoint | 0.2608 | 0.021386 |
| #15 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
Public checkpoint | 0.3055 | 0.017288 |
| #16 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
Public checkpoint | 0.4098 | 0.039531 |
| #17 |
iic/eres2netv2-zh
eresv2_zh
|
Public checkpoint | 1.2034 | 0.075149 |
| #18 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
Public checkpoint | 1.7139 | 0.100335 |
| #19 |
iic/campplus
campplus
|
Public checkpoint | 1.7884 | 0.119188 |
| #20 |
speechbrain/xvector
xvector
|
Public checkpoint | 1.8405 | 0.099143 |
| #21 |
wespeaker/res34-cnceleb
wespeaker_r34
|
Public checkpoint | 3.3905 | 0.196237 |
| #22 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
Public checkpoint | 7.9993 | 0.495715 |
| #23 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
Public checkpoint | 8.1967 | 0.544113 |