Leaderboards

Leaderboards containing the final primary system submission by each team, ranked in ascending order by DER on the core evaluation set. For each submission, the following fields are displayed:

  • Rank – ranking of the system; by default, systems are ranked in ascending order by DER on the core evaluation set
  • Team – name of team that made submission
  • # Entries – total number of submissions made by the team (primary and secondary) over the course of the evaluation
  • Submission URI – unique resource identifier (URI) for the submission; assigned by NIST
  • Date – datetime (GMT) of the submission in YYYY-MM-DD hh:mm:ss format
  • Description – link to corresponding system description
  • Workshop – link to corresponding workshop presentation
  • DER (core) – diarization error rate (in percent) of submission on the core evaluation set
  • JER (core) – Jaccard error rate (in percent) of submisson on the core evaluation set
  • DER (full) – diarization error rate (in percent) of submission on the full evaluation set
  • JER (full) – Jaccard error rate (in percent) of submission on the full evaluation set

Baseline results for each track are provided under the team name of DIHARD and indicated by a blue horizontal line in the bar plot. These results are also available from the challenge paper and baseline github repo.

Track 1

Submission information Core set Full set
Rank Team # Entries Submission URI      Date      Description Workshop DER JER DER JER
USTC-NELSLIP 50 1473 2020-12-31 11:51:04 system_descriptions/dihard3_system_description_team54.pdf https://dihardchallenge.github.io/dihard3workshop/program#ustc-nelslip 13.45 34.94 11.3 29.94
dh_Hitachi-JHU 47 1458 2020-12-31 11:01:48 system_descriptions/dihard3_system_description_team115.pdf https://dihardchallenge.github.io/dihard3workshop/program#hitachi-jhu 14.09 38.25 11.58 32.37
Clova 44 1445 2020-12-31 09:01:12 system_descriptions/dihard3_system_description_team73.pdf https://dihardchallenge.github.io/dihard3workshop/program#clova 15.4 43.07 13.95 37.43
DKU-Duke-Lenovo 29 1449 2020-12-31 10:27:00 system_descriptions/dihard3_system_description_team50.pdf https://dihardchallenge.github.io/dihard3workshop/program#dku-duke-lenovo 15.43 37.27 13.39 32.14
dh_BUT 45 1426 2020-12-31 00:57:11 system_descriptions/dihard3_system_description_team55.pdf https://dihardchallenge.github.io/dihard3workshop/program#but 15.46 38.49 13.29 33.35
CRIM 2 1265 2020-12-25 07:51:40 system_descriptions/dihard3_system_description_team7.pdf 16.44 37.4 15.5 33.35
RoyalFlush 35 1331 2020-12-28 01:10:39 17.59 42.5 15.59 37.4
dh_LEAP 22 1405 2020-12-30 10:51:31 system_descriptions/dihard3_system_description_team80.pdf https://dihardchallenge.github.io/dihard3workshop/program#leap 18.07 42.82 14.88 36.73
dh_team_f 4 997 2020-12-14 04:28:29 system_descriptions/dihard3_system_description_team106.pdf https://dihardchallenge.github.io/dihard3workshop/program#fano 18.4 46.31 15.12 39.32
DH_LiveFree 27 1373 2020-12-28 22:06:23 system_descriptions/dihard3_system_description_team60.pdf https://dihardchallenge.github.io/dihard3workshop/program#iit-kharagpur 18.66 42.23 17.2 37.73
dh_SAIL_USC 9 1396 2020-12-30 05:03:05 system_descriptions/dihard3_system_description_team57.pdf https://dihardchallenge.github.io/dihard3workshop/program#sail-usc 19.76 43.03 18.19 38.33
dh_DiaboLIIc 5 1092 2020-12-18 18:02:35 system_descriptions/dihard3_system_description_team71.pdf https://dihardchallenge.github.io/dihard3workshop/program#diaboliic 20.61 48.38 18.89 42.98
DIHARD 11 1261 2020-12-24 22:29:22 system_descriptions/dihard3_system_description_team18.pdf https://dihardchallenge.github.io/dihard3workshop/program#overview 20.65 47.74 19.25 42.45
dh_ciaic 2 994 2020-12-14 02:58:01 system_descriptions/dihard3_system_description_team94.pdf 21.77 38.46 20.16 34.79
XMUSPEECH 1 1183 2020-12-21 14:30:03 system_descriptions/dihard3_system_description_team123.pdf 22.07 48.39 19.87 42.32
HK 5 1160 2020-12-21 02:22:10 system_descriptions/dihard3_system_description_team67.pdf 22.95 54.26 20.89 48.35
Elektronika 1 1234 2020-12-23 14:43:39 23.33 42.09 23.42 38.76
dh_Great 8 1286 2020-12-27 05:12:25 system_descriptions/dihard3_system_description_team96.pdf 26.3 44.5 23.47 39.78
dh_sh 3 1408 2020-12-30 14:33:10 system_descriptions/dihard3_system_description_team93.pdf 33.06 67.67 31.69 63.61
dh_Mila 1 1090 2020-12-18 17:25:21 43.08 53.19 45.55 52.24
dh_UWB-NTIS 1 1034 2020-12-16 09:55:30 system_descriptions/dihard3_system_description_team56.pdf 49.41 64.76 44.69 59.56

Track 2

Submission information Core set Full set
Rank Team # Entries Submission URI Date Description Workshop DER JER DER JER
USTC-NELSLIP 44 1471 2020-12-31 11:44:10 system_descriptions/dihard3_system_description_team54.pdf https://dihardchallenge.github.io/dihard3workshop/program#ustc-nelslip 19.37 39.22 16.78 34.42
dh_Hitachi-JHU 46 1457 2020-12-31 11:01:35 system_descriptions/dihard3_system_description_team115.pdf https://dihardchallenge.github.io/dihard3workshop/program#hitachi-jhu 20.01 41.78 16.94 36.31
DKU-Duke-Lenovo 6 1418 2020-12-30 22:45:38 system_descriptions/dihard3_system_description_team50.pdf https://dihardchallenge.github.io/dihard3workshop/program#dku-duke-lenovo 21.63 41.8 18.9 36.69
dh_team_f 13 995 2020-12-14 03:49:56 system_descriptions/dihard3_system_description_team106.pdf https://dihardchallenge.github.io/dihard3workshop/program#fano 23.86 48.85 20.05 42.06
Clova 12 1459 2020-12-31 11:06:41 system_descriptions/dihard3_system_description_team73.pdf https://dihardchallenge.github.io/dihard3workshop/program#clova 24.31 49.22 21.86 43.78
dh_BUT 4 1419 2020-12-30 23:24:41 system_descriptions/dihard3_system_description_team55.pdf https://dihardchallenge.github.io/dihard3workshop/program#but 24.62 44.49 21.09 39.28
dh_LEAP 11 1404 2020-12-30 10:50:39 system_descriptions/dihard3_system_description_team80.pdf https://dihardchallenge.github.io/dihard3workshop/program#leap 24.99 45.13 21.09 39.54
DIHARD 2 929 2020-12-03 20:22:09 system_descriptions/dihard3_system_description_team18.pdf https://dihardchallenge.github.io/dihard3workshop/program#overview 27.34 51.91 25.36 46.95
dh_DiaboLIIc 2 1087 2020-12-18 15:09:18 system_descriptions/dihard3_system_description_team71.pdf https://dihardchallenge.github.io/dihard3workshop/program#diaboliic 27.63 52.81 25.4 47.88
Elektronika 2 1237 2020-12-23 19:40:38 28.1 53.73 25.87 49.03
HK 3 981 2020-12-10 11:05:15 system_descriptions/dihard3_system_description_team67.pdf 28.57 56.25 26.91 51.09
dh_Mila 1 1091 2020-12-18 17:25:43 43.08 53.19 45.55 52.24
dh_Great 1 1335 2020-12-28 02:40:51 system_descriptions/dihard3_system_description_team96.pdf 45.08 61.05 39.58 55.08