Location: Universidad Politécnica de Madrid (UPM) > Grupo de Tratamiento de Imágenes (GTI) > Data > AR_SituationalAwareness
This site contains some supplementary material associated to the Augmented Reality tool proposed in [*]:
The work [*] proposes an Augmented Reality (AR) tool for UAV operators. Common Ground Control Stations (GCSs) provide information in separate screens: one presents the video stream while the other displays information about the mission plan and information coming from several sensors. The proposed AR tool avoids the burden of fusing information displayed in those two screens.
The AR system has two functionalities for Medium-Altitude Long-Endurance (MALE) UAVs:
For any question about the article [*] or about the described test data, please contact Susana Ruano at srs@gti.ssr.upm.es.
[*] S. Ruano, C. Cuevas, G. Gallego, and N. García, "Augmented reality tool for situational awareness improvement of UAV opperators", Sensors, vol. 17, no. 1, article ID 297, 16 pages, 2017 (doi: 10.3390/s17020297).
The software can be downloaded here.
The binary has been compiled for 32-bit Windows 7 and it depends on the following external libraries to be installed:
Five arguments must be indicated in the execution:
The proposed AR tool has been tested in a GCS demonstrator in AIRBUS facilities, during a mission that takes place in the south of Spain.
The objective of the mission was the identification of several targets that were reported to the operator. The targets chosen for the test were buildings, and the operator had to check if the targets were actually present in the indicated locations or not. This assignment was framed in a reconnaissance procedure. The UAV followed a route that was predefined according to several restrictions (e.g., non-flying zones) during mission planning. The UAV is flown with an automated control system and the operator is responsible for the supervision the flight, the alerts and the payload. The operator can control the camera sensor manually with a joystick.
Several tests were carried out with different operators and two representatives moments of the mission are illustrated below.
This video shows a moment of the mission in which the operator is moving the joystict to try to visualize four targets, which correspond to four buildings. The targets are highlighted, allowing the operator to easily identify them. Moreover, the presence of occlusions is taken into account so that the operator can reduce the time to find themand prevent the use of the camera zoomwhen it is not necessary.
This video illustrates a moment of the mission in which the camera points forward and does not change its position. Therefore, it allows to see the augmented flight route. This example shows that the augmented route benefit the world exploration, since the operator can infer the remaining time to visit a waypoint and which will be the following movements of the UAV.
Grupo de Tratamiento de Imágenes (GTI), E.T.S.Ing. Telecomunicación
Universidad Politécnica de Madrid (UPM)
Av. Complutense nº 30, "Ciudad Universitaria". 28040 - Madrid (Spain). Tel: +34 913367353. Fax: +34 913367353