Overview of the Tenth Dialog System Technology Challenge: DSTC10
Journal
IEEE/ACM Transactions on Audio Speech and Language Processing
Date Issued
2023-01-01
Author(s)
Yoshino, Koichiro
Crook, Paul
Kottur, Satwik
Li, Jinchao
Hedayatnia, Behnam
Moon, Seungwhan
Fei, Zhengcong
Li, Zekang
Zhang, Jinchao
Feng, Yang
Zhou, Jie
Kim, Seokhwan
Liu, Yang
Jin, Di
Papangelis, Alexandros
Gopalakrishnan, Karthik
Hakkani-Tur, Dilek
Damavandi, Babak
Geramifard, Alborz
Hori, Chiori
Shah, Ankit
Zhang, Chen
Li, Haizhou
Sedoc, Joao
D'Haro, Luis F.
Banchs, Rafael
Rudnicky, Alexander
Abstract
This paper introduces the Tenth Dialog System Technology Challenge (DSTC-10). This edition of the DSTC focuses on applying end-to-end dialog technologies for five distinct tasks in dialog systems, namely 1. Incorporation of Meme images into open domain dialogs, 2. Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations, 3. Situated Interactive Multimodal dialogs, 4. Reasoning for Audio Visual Scene-Aware Dialog, and 5. Automatic Evaluation and Moderation of Open-domain Dialogue Systems. This paper describes the task definition, provided datasets, baselines, and evaluation setup for each track. We also summarize the results of the submitted systems to highlight the general trends of the state-of-the-art technologies for the tasks.
Subjects
Context modeling | History | Internet | Measurement | Oral communication | Task analysis | Visualization
Type
journal article