Development of a classification model for UAVs and birds based on the YOLOv9 neural network to improve anti-drone systems

The article presents the materials of the development of a model for classification and recognition of UAVs and birds based on the neural network of the YOLOv9 architecture in the optoelectronic channels of Anti-drone systems. To train the neural network, a dataset was prepared in the form of annotated images of UAVs and birds. The total number, taking into account augmentation, was 5265 images. The authors implemented training, verification and testing of neural networks in the Windows 11 operating system, in the Python 3.10.8 runtime environment and the Pycharm 2024 development environment. The training process was carried out on the basis of the AD103 graphics processor of the NVIDIA GeForce RTX 4080 video card with support for CUDA Toolkit 12.1. As a result of training the neural network, the following metrics were obtained: mAP50-95: 0.59; mAP50: 0.95; Recall: 0.89; Precision: 0.95. According to these indicators, the trained model outperforms the UAV and bird recognition and classification models trained on the basis of YOLOv2, YOLOv4, YOLOv5, YOLOv7 and YOLOX. The inference results on two videos with DJI Inspire 2 and DJI Mini 3 UAV flights showed FPS values of 131 and 119, respectively. It was found that, due to the obtained accuracy and FPS metrics, the trained YOLOv9 model can be used as a module for recognizing and classifying UAVs and birds in real time in the optoelectronic surveillance channels of Anti-drone systems.

1. Mahdavi F., Rajabi R. (2020). Drone Detection Using Convolutional Neural Networks, 2020 6th Iranian Conference on Signal Processing and Intelligent Systems (ICSPIS), Mashhad, Iran, 2020, pp. 1-5, DOI: 10.1109/ICSPIS51611.2020.9349620.

2. Hammer M., Borgmann B., Hebel M., Arens M. (2020). Image-based classification of small flying objects detected in LiDAR point clouds. Proceedings of SPIE - The International Society for Optical Engineering, 11410, 1141002. DOI: 10.1117/12.2557246.

3. Mebtouche N.E.-D., Baha N. (2022). Robust UAV detection based on saliency cues and magnified features on thermal images. Multimedia Tools and Applications. 82(13), pp. 20039-20058. DOI: 10.1007/s11042-022-14271-3.

4. Beasley P., Ritchie M., Griffiths H., Miceli W., Inggs M., Lewis S., Kahn B. (2020). Multistatic Radar Measurements of Uavs at X-Band and L-Band. IEEE National Radar Conference - Proceedings, 2020- September, art. no. 9266444. DOI: 10.1109/RadarConf2043947.2020.9266444.

5. Teo M.I., Seow C.K., Wen K. (2021). 5G Radar and Wi-Fi Based Machine Learning on Drone Detection and Localization. 2021 IEEE 6th International Conference on Computer and Communication Systems (ICCCS), Chengdu, China, 2021, pp. 875-880, DOI: 10.1109/ICCCS52626.2021.9449224.

6. Flak P., Czyba R. (2023). RF Drone Detection System Based on a Distributed Sensor Grid With Remote Hardware-Accelerated Signal Processing. IEEE Access. PP. 1-1. DOI: 10.1109/ACCESS.2023.3340133.

7. Yang S., Luo Y., Miao W., Ge C., Sun W., Luo C. (2021). RF Signal-Based UAV Detection and Mode Classification: A Joint Feature Engineering Generator and Multi-Channel Deep Neural Network Approach. Entropy. 23. 1678. DOI: 10.3390/e23121678.

8. Al-Emadi S., Al-Ali A., Al-Ali A. (2021) Audio-based drone detection and identification using deep learning techniques with dataset enhancement through generative adversarial networks. Sensors 2021, 21, 4953. DOI: 10.3390/s21154953.

9. Salman S., Mir J., Farooq M.T., Malik A.N., Haleemdeen R. (2021) Machine learning inspired efficient audio drone detection using acoustic features. In Proceedings of the 2021 International Bhurban Conference on Applied Sciences and Technologies (IBCAST), Islamabad, Pakistan, 12-16 January 2021; pp. 335-339. DOI: 10.1109/IBCAST51254.2021.9393232.

10. Svanstrom F., Alonso-Fernandez F., Englund C. (2021). A Dataset for Multi-Sensor Drone Detection. Data in Brief. 39. DOI: 10.1016/j.dib.2021.107521.

11. Semenyuk V., Kurmashev I., Lupidi A., Cantelli-Forti A. (2023). Developing the GoogleNet neural network for the detection and recognition of unmanned aerial vehicles in the Data Fusion System. EasternEuropean Journal of Enterprise Technologies, 2(9-122), pp. 16-25. DOI: 10.15587/1729-4061.2023.276175.

12. Jajaga E., Rushiti V., Ramadani B., Pavleski D., Cantelli-Forti A., Stojkovska B., Petrovska O. (2022). An Image-Based Classification Module for Data Fusion Anti-drone System. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 13374 LNCS, pp. 422-433 DOI: 10.1007/978-3-031-13324-4_36.

13. Elbit Systems (2024). ReDrone. [online] Elbit Systems. Available at: https://elbitsystems.com/product/redrone/ [Accessed 22 June, 2024].

14. Dedrone (2024). DedroneRapidResponse: Multi-Layered Mobile Drone Detection Unit. [online] Dedrone. Available at: https://www.dedrone.com/solutions/dedrone-rapid-response [Accessed 22 June, 2024].

15. Singha S., Aydin B. (2021). Automated Drone Detection Using YOLO v4. Drones. September 2021. DOI: 10.3390/drones5030095.

16. Seidaliyeva U., Alduraibi M., Ilipbayeva L., Almagambetov A. (2020). Detection of Loaded and Unloaded UAV Using Deep Neural Network. In Proceedings of the 2020 Fourth IEEE International Conference on Ro-botic Computing (IRC), Taichung, Taiwan, 9-11 November 2020; pp. 490-494. DOI: 10.1109/IRC.2020.00093.

17. Aydin B., Singha S. (2023). Drone Detection Using YOLO v5. Eng. 4. DOI: 10.3390/eng4010025.

18. Zhai X., Huang Z., Li T., Liu H., Wang S. (2023). YOLO-Drone: An Optimized YOLOv8 Network for Tiny UAV Object Detection. Electronics. 12. 3664. DOI: 10.3390/electronics12173664.