Firefighting AR/MR Simulator Game - Proof of Concept

Objective The development of a simple POC (proof-of-concept) PC firefighting game. The game must be fully functional in a Microsoft Windows environment as described. This prototype aims to demonstrate the ‘mixing’ real live camera footage and computer-generated 3D fires and a fire extinguishing apparatus (or hose). Description/user journey This project aims to build a very simple, fully functional, firefighting AR game prototype for windows based on Unity3D or Unreal gaming engines. Before opening the game, the user will place a physical page with a pattern/marker printed on it 2-4 meters away from the user. After opening the application, the game displays the video feed of the attached camera and the software replaces the prepositioned pattern with a 3D animated fire (achieved via an existing 3D gaming graphics engine). The user should be able to move the camera freely and the fire would act as a real fire (ie. Moving the camera forward increases the size of the fire, moving back decreases it) Realism is very important in this project. Crosshairs for aiming are also present in the middle of the monitoring screen. (Figure 1) The user then uses the joystick to move the crosshairs around the monitor. Whenever the user presses the ‘fire’ button on the controller, a hose appears and sprays to try to extinguish the fire (this is animated and therefore also achieved via an engine like Unity3D or Unreal). If the extinguisher sprays the fire for more than 2 seconds, the fire emits white smoke. If the extinguisher sprays the fire for more than 4 seconds, the fire extinguishes. (Figure 2) Once the fire is extinguished, a “retry” button will appear reloading the fire in place of the marker so the user can play again. (Figure 3)