2017 I/ITSEC - 8250

Spoken-dialogue Interaction for Serious Games and Virtual Training Simulators (Room S320E)

Recent advances in deep learning have opened people’s minds to new levels of interaction within many Virtual Training Environments (VTEs)/Serious Games. Unfortunately, allowing users to fully interact through speech is a challenge for computers, particularly when the task is unconstrained or performed under adverse conditions. Speech is therefore often neglected as a modality, in spite of its naturalness. Furthermore, user-based evaluations of speech interfaces are intrinsically difficult. The recent AI revolution brings hope that, despite these shortcomings, there will at least be some areas of R&D that will lead to real improvements in both the design and implementation of spoken interactions in training systems.