Leaderboard

---

Team	Publication	dev-set	test-set	EdAcc Version
Anonymized Company	Sanabria et al, 2023	18.9	19.6	V1.0
Robust Wav2Vec 2.0 + LM MGB	Sanabria et al, 2023	33.4	36.1	V0.1
Whisper Large + not conditioned	Sanabria et al, 2023	16.4	19.7	V0.1
Anonymized Company	Sanabria et al, 2023	17.9	18.7	V0.1

• V1.0:
• Evaluation deployed on sclite.
• Evaluation perfromed at the utterance level.
• Removing read speech segments during scoring.
• Removing special tokens during scoring with sclite.
• Most of the difference in performance comes from removing read-speech segments.


• V0.1:
• Evaluation deployed on sclite.
• Evaluation perfromed at the conversation-level.
• Removing special tokens during scoring with sclite.