Leaderboard

Official test-set results for the Real-World Audio-Visual Speech Enhancement (AVSE) Challenge. Submissions are scored offline by the organizers with the full metric suite of the baseline evaluation protocol.

Loading…

Important note: the daily submission quota is now set to 3 submissions per team per track per day, and it stays 3 every day until the deadline.

Scope:

* Display-only: shown for reference but not counted in the official OVRL ranking.

Notes.
  1. Submitting your results does not guarantee that your data will be saved (be sure to save the data you submit yourself).
  2. Please be sure to submit your files in the specified format: both the file format and the number of files must follow the submission requirements. Note the layout has been updated: mix and remix are no longer packaged separately; every clip now goes under a single mixture folder, e.g. track1/test/mixture/<clip_id>/s1.wav  s2.wav.
  3. Official ranking: OVRL, the mean of a team's per-metric ranks (lower ↓ is better), computed over the metrics available in the current scope. Metrics marked with * (DNS-P808 / DNS-SIG / DNS-BAK) are display-only and excluded from OVRL; of the DNSMOS suite only DNS-OVRL counts toward the ranking.
  4. Each team is represented by its best submission, i.e. the one with the best OVRL among everything it has submitted.
  5. SI-SDR / PESQ / STOI require clean references, so they exist only for the remix scene.
  6. CER is character error rate (lower ↓ is better); all other metrics are higher ↑ is better.
  7. Click any column header to re-sort locally.