Leaderboards
Leaderboards containing the final primary system submission by each team, ranked in ascending order by DER on the core evaluation set. For each submission, the following fields are displayed:
- Rank – ranking of the system; by default, systems are ranked in ascending order by DER on the core evaluation set
- Team – name of team that made submission
- # Entries – total number of submissions made by the team (primary and secondary) over the course of the evaluation
- Submission URI – unique resource identifier (URI) for the submission; assigned by NIST
- Date – datetime (GMT) of the submission in YYYY-MM-DD hh:mm:ss format
- Description – link to corresponding system description
- Workshop – link to corresponding workshop presentation
- DER (core) – diarization error rate (in percent) of submission on the core evaluation set
- JER (core) – Jaccard error rate (in percent) of submisson on the core evaluation set
- DER (full) – diarization error rate (in percent) of submission on the full evaluation set
- JER (full) – Jaccard error rate (in percent) of submission on the full evaluation set
Baseline results for each track are provided under the team name of DIHARD and indicated by a blue horizontal line in the bar plot. These results are also available from the challenge paper and baseline github repo.
Track 1
| Submission information | Core set | Full set | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Rank | Team | # Entries | Submission URI | Date | Description | Workshop | DER (Core set) | JER (Core set) | DER (Full set) | JER (Full set) |
| USTC-NELSLIP | 50 | 1473 | 2020-12-31 11:51:04 | system_descriptions/dihard3_system_description_team54.pdf | https://dihardchallenge.github.io/dihard3workshop/program#ustc-nelslip | 13.45 | 34.94 | 11.3 | 29.94 | |
| dh_Hitachi-JHU | 47 | 1458 | 2020-12-31 11:01:48 | system_descriptions/dihard3_system_description_team115.pdf | https://dihardchallenge.github.io/dihard3workshop/program#hitachi-jhu | 14.09 | 38.25 | 11.58 | 32.37 | |
| Clova | 44 | 1445 | 2020-12-31 09:01:12 | system_descriptions/dihard3_system_description_team73.pdf | https://dihardchallenge.github.io/dihard3workshop/program#clova | 15.4 | 43.07 | 13.95 | 37.43 | |
| DKU-Duke-Lenovo | 29 | 1449 | 2020-12-31 10:27:00 | system_descriptions/dihard3_system_description_team50.pdf | https://dihardchallenge.github.io/dihard3workshop/program#dku-duke-lenovo | 15.43 | 37.27 | 13.39 | 32.14 | |
| dh_BUT | 45 | 1426 | 2020-12-31 00:57:11 | system_descriptions/dihard3_system_description_team55.pdf | https://dihardchallenge.github.io/dihard3workshop/program#but | 15.46 | 38.49 | 13.29 | 33.35 | |
| CRIM | 2 | 1265 | 2020-12-25 07:51:40 | system_descriptions/dihard3_system_description_team7.pdf | 16.44 | 37.4 | 15.5 | 33.35 | ||
| RoyalFlush | 35 | 1331 | 2020-12-28 01:10:39 | 17.59 | 42.5 | 15.59 | 37.4 | |||
| dh_LEAP | 22 | 1405 | 2020-12-30 10:51:31 | system_descriptions/dihard3_system_description_team80.pdf | https://dihardchallenge.github.io/dihard3workshop/program#leap | 18.07 | 42.82 | 14.88 | 36.73 | |
| dh_team_f | 4 | 997 | 2020-12-14 04:28:29 | system_descriptions/dihard3_system_description_team106.pdf | https://dihardchallenge.github.io/dihard3workshop/program#fano | 18.4 | 46.31 | 15.12 | 39.32 | |
| DH_LiveFree | 27 | 1373 | 2020-12-28 22:06:23 | system_descriptions/dihard3_system_description_team60.pdf | https://dihardchallenge.github.io/dihard3workshop/program#iit-kharagpur | 18.66 | 42.23 | 17.2 | 37.73 | |
| dh_SAIL_USC | 9 | 1396 | 2020-12-30 05:03:05 | system_descriptions/dihard3_system_description_team57.pdf | https://dihardchallenge.github.io/dihard3workshop/program#sail-usc | 19.76 | 43.03 | 18.19 | 38.33 | |
| dh_DiaboLIIc | 5 | 1092 | 2020-12-18 18:02:35 | system_descriptions/dihard3_system_description_team71.pdf | https://dihardchallenge.github.io/dihard3workshop/program#diaboliic | 20.61 | 48.38 | 18.89 | 42.98 | |
| DIHARD | 11 | 1261 | 2020-12-24 22:29:22 | system_descriptions/dihard3_system_description_team18.pdf | https://dihardchallenge.github.io/dihard3workshop/program#overview | 20.65 | 47.74 | 19.25 | 42.45 | |
| dh_ciaic | 2 | 994 | 2020-12-14 02:58:01 | system_descriptions/dihard3_system_description_team94.pdf | 21.77 | 38.46 | 20.16 | 34.79 | ||
| XMUSPEECH | 1 | 1183 | 2020-12-21 14:30:03 | system_descriptions/dihard3_system_description_team123.pdf | 22.07 | 48.39 | 19.87 | 42.32 | ||
| HK | 5 | 1160 | 2020-12-21 02:22:10 | system_descriptions/dihard3_system_description_team67.pdf | 22.95 | 54.26 | 20.89 | 48.35 | ||
| Elektronika | 1 | 1234 | 2020-12-23 14:43:39 | 23.33 | 42.09 | 23.42 | 38.76 | |||
| dh_Great | 8 | 1286 | 2020-12-27 05:12:25 | system_descriptions/dihard3_system_description_team96.pdf | 26.3 | 44.5 | 23.47 | 39.78 | ||
| dh_sh | 3 | 1408 | 2020-12-30 14:33:10 | system_descriptions/dihard3_system_description_team93.pdf | 33.06 | 67.67 | 31.69 | 63.61 | ||
| dh_Mila | 1 | 1090 | 2020-12-18 17:25:21 | 43.08 | 53.19 | 45.55 | 52.24 | |||
| dh_UWB-NTIS | 1 | 1034 | 2020-12-16 09:55:30 | system_descriptions/dihard3_system_description_team56.pdf | 49.41 | 64.76 | 44.69 | 59.56 | ||
Track 2
| Submission information | Core set | Full set | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Rank | Team | # Entries | Submission URI | Date | Description | Workshop | DER (Core set) | JER (Core set) | DER (Full set) | JER (Full set) |
| USTC-NELSLIP | 44 | 1471 | 2020-12-31 11:44:10 | system_descriptions/dihard3_system_description_team54.pdf | https://dihardchallenge.github.io/dihard3workshop/program#ustc-nelslip | 19.37 | 39.22 | 16.78 | 34.42 | |
| dh_Hitachi-JHU | 46 | 1457 | 2020-12-31 11:01:35 | system_descriptions/dihard3_system_description_team115.pdf | https://dihardchallenge.github.io/dihard3workshop/program#hitachi-jhu | 20.01 | 41.78 | 16.94 | 36.31 | |
| DKU-Duke-Lenovo | 6 | 1418 | 2020-12-30 22:45:38 | system_descriptions/dihard3_system_description_team50.pdf | https://dihardchallenge.github.io/dihard3workshop/program#dku-duke-lenovo | 21.63 | 41.8 | 18.9 | 36.69 | |
| dh_team_f | 13 | 995 | 2020-12-14 03:49:56 | system_descriptions/dihard3_system_description_team106.pdf | https://dihardchallenge.github.io/dihard3workshop/program#fano | 23.86 | 48.85 | 20.05 | 42.06 | |
| Clova | 12 | 1459 | 2020-12-31 11:06:41 | system_descriptions/dihard3_system_description_team73.pdf | https://dihardchallenge.github.io/dihard3workshop/program#clova | 24.31 | 49.22 | 21.86 | 43.78 | |
| dh_BUT | 4 | 1419 | 2020-12-30 23:24:41 | system_descriptions/dihard3_system_description_team55.pdf | https://dihardchallenge.github.io/dihard3workshop/program#but | 24.62 | 44.49 | 21.09 | 39.28 | |
| dh_LEAP | 11 | 1404 | 2020-12-30 10:50:39 | system_descriptions/dihard3_system_description_team80.pdf | https://dihardchallenge.github.io/dihard3workshop/program#leap | 24.99 | 45.13 | 21.09 | 39.54 | |
| DIHARD | 2 | 929 | 2020-12-03 20:22:09 | system_descriptions/dihard3_system_description_team18.pdf | https://dihardchallenge.github.io/dihard3workshop/program#overview | 27.34 | 51.91 | 25.36 | 46.95 | |
| dh_DiaboLIIc | 2 | 1087 | 2020-12-18 15:09:18 | system_descriptions/dihard3_system_description_team71.pdf | https://dihardchallenge.github.io/dihard3workshop/program#diaboliic | 27.63 | 52.81 | 25.4 | 47.88 | |
| Elektronika | 2 | 1237 | 2020-12-23 19:40:38 | 28.1 | 53.73 | 25.87 | 49.03 | |||
| HK | 3 | 981 | 2020-12-10 11:05:15 | system_descriptions/dihard3_system_description_team67.pdf | 28.57 | 56.25 | 26.91 | 51.09 | ||
| dh_Mila | 1 | 1091 | 2020-12-18 17:25:43 | 43.08 | 53.19 | 45.55 | 52.24 | |||
| dh_Great | 1 | 1335 | 2020-12-28 02:40:51 | system_descriptions/dihard3_system_description_team96.pdf | 45.08 | 61.05 | 39.58 | 55.08 | ||