Augmented Reality – Cockpit Display System In Real-Time Flight Simulation Environment

 Over recent years, hands-free Augmented Reality (AR) technologies are widely being used towards equipment manufacturing and maintenance services in various engineering platforms. One of such applications discussed in this report is an Electronic Flight Instrument System (EFIS)/glass cockpit/Cockpit Display System (CDS), in AR, for real-time testing during the early designs of an aircraft’s flight deck. Two prototype designs, both built using the Buildwagon HoloLens Development Platform and tested on Microsoft HoloLens 1 headset using X-Plane 11 flight simulator for flight tests, are presented. For the presented project, several flight data, as well as any other simulation data, were sent to BinariesLid’s Buildwagon Collaboration Server in the form of messages using the Socket.IO library via the Internet. These messages were processed and used to redraw the EFIS on Buildwagon JavaScript Editor. This thesis presents the design methodology and performance benchmarks of the systems involved during the flight test, i.e. HoloLens 1 AR headset, Buildwagon Emulator, and the simulator system itself.