Developing an Immersive Virtual Reality Aircrew Training Capability
(Room S320E)
30 Nov 17
11:30 AM
-
12:00 PM
The Combating Terrorism Technical Support Office (CTTSO) and the Air Force Special Operations Command (AFSOC) are assessing the training effectiveness of an immersive virtual reality part task trainer (vrPTT) for AC -130 cockpit familiarization. AFSOC wants to move AC-130 checklist procedures and cockpit familiarization training from low-density/high-demand weapons system simulators to a widely available, low-cost vrPTT, while simultaneously migrating the tutorial courseware and instructor-led portions of the course to a higher fidelity, more immersive environment. This blended learning vrPTT will allow pilots to receive instruction and immediately proceed to practicing scenarios in a highly realistic, immersive Virtual Reality (VR) environment. It also reduces time in the simulators by allowing pilots to learn the procedures and develop muscle memory. The vrPTT was designed and developed from an extensive front-end analysis, including task performance interviews with AC-130 pilots and instructors. The system consists of a 3D VR representation of the AC-130 cockpit viewed through an Oculus Rift head-mounted display (HMD) and underlying equipment behavior models that produce appropriate responses to pilot inputs. Pilots interact with the virtual control systems via the integration of a Leap Motion infrared sensor that tracks the position and motion of all ten fingers. Tutorial content is laid over the equipment simulation, and an integrated intelligent tutor provides adaptive feedback during a scenario and to adjust the initial instruction for future exercises. This paper describes the front-end analyses performed to create the measures for the intelligent tutor, approaches to overlay courseware in a VR HMD environment, and the overall system required to achieve acceptance by the pilot user group. It also details future phases of this program, including a training effectiveness study comparing a control group of students in the simulator who have not used the VR syst