Benchmark Scenario
Overlap Robustness
How well speaker identity survives light, mid, and heavy overlap in both meeting and domestic recordings.
Current Leader
18 ranked
wespeaker/w2vbert2
10.1383
scenario EER
0.467346 scenario minDCF
Scenario Coverage
2 trial sets
AliMeeting Overlap
CHiME-6 Overlap
Scenario Leaders
Top systems on this scenario
The current reviewed submissions for this scenario.
Scenario Ranking
Full ranking for Overlap Robustness
A scenario row first averages linked trial sets within each source dataset, then averages the source means and ranks systems by the resulting EER.
| Rank | System | Rank Signal | Scenario EER | Scenario minDCF |
Evidence
Rank / EER by trial-set order: AliMeeting Overlap ยท CHiME-6 Overlap
|
|---|---|---|---|---|---|
| #1 |
wespeaker/w2vbert2
vb2-w2vbert
|
Leader
|
10.1383
|
0.467346 | |
| #2 |
palabraai/redimnet2-b6
redimnet2
|
Top 3
|
10.6981
|
0.524446 | |
| #3 |
wespeaker/samresnet100
vb2-sam100
|
Top 3
|
11.0912
|
0.502019 | |
| #4 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
Competitive
|
12.3294
|
0.554516 | |
| #5 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
Competitive
|
12.9553
|
0.565796 | |
| #6 |
iic/eres2net-en
eres_en
|
Competitive
|
13.7639
|
0.580907 | |
| #7 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
Competitive
|
13.9414
|
0.591408 | |
| #8 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
Competitive
|
14.0816
|
0.622128 | |
| #9 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
Competitive
|
14.3667
|
0.552132 | |
| #10 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
Needs work
|
14.6411
|
0.618143 | |
| #11 |
speechbrain/ecapa
ecapa
|
Needs work
|
14.8522
|
0.616222 | |
| #12 |
iic/eres2netv2-zh
eresv2_zh
|
Needs work
|
14.8800
|
0.543251 | |
| #13 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
Needs work
|
14.9489
|
0.650355 | |
| #14 |
wespeaker/res34-cnceleb
wespeaker_r34
|
Needs work
|
16.4122
|
0.671276 | |
| #15 |
iic/campplus
campplus
|
Needs work
|
18.6371
|
0.617367 | |
| #16 |
speechbrain/xvector
xvector
|
Needs work
|
23.2363
|
0.916343 | |
| #17 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
Needs work
|
26.0906
|
0.926016 | |
| #18 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
Needs work
|
26.5022
|
0.944448 |