Liu, Chang and Szirányi, Tamás (2021) Gesture Recognition for UAV-based Rescue Operation based on Deep Learning. In: Proceedings of the International Conference on Image Processing and Vision Engineering, Vol. 1. SciTePress, Setúbal, pp. 180-187. ISBN 9789897585111 10.5220/0010522001800187

Text Liu_180_32009685_z.pdf Restricted to Registered users only Download (2MB) | Request a copy

Abstract

UAVs play an important role in different application fields, especially in rescue. To achieve good communication between the onboard UAV and humans, an approach to accurately recognize various body gestures in the wild environment by using deep learning algorithms is presented in this work. The system can not only recognize human rescue gestures but also detect people, track people, and count the number of humans. A dataset of ten basic rescue gestures (i.e. Kick, Punch, Squat, Stand, Attention, Cancel, Walk, Sit, Direction, and PhoneCall) has been created by a UAV’s camera. From the perspective of UAV rescue, the feedback from the user is very important. The two most important dynamic rescue gestures are the novel dynamic Attention and Cancel which represent the set and reset functions respectively. The system shows a warning help message when the user is waving to the UAV. The user can also cancel the communication at any time by showing the drone the body rescue gesture that indica tes the cancellation according to their needs. This work has laid the groundwork for the next rescue routes that the UAV will design based on user feedback. The system achieves 99.47% accuracy on training data and 99.09% accuracy on testing data by using the deep learning method.

Item Type:	Book Section
Subjects:	Q Science > QA Mathematics and Computer Science > QA75 Electronic computers. Computer science / számítástechnika, számítógéptudomány
Divisions:	Distributed Events Analysis Research Laboratory
SWORD Depositor:	MTMT Injector
Depositing User:	MTMT Injector
Date Deposited:	07 Jan 2022 08:36
Last Modified:	07 Jan 2022 08:36
URI:	https://eprints.sztaki.hu/id/eprint/10220

Update Item