Document Type : Research Article


1 Assistant professor, Aerospace Research Institute, Ministry of Science Research and Technology, Tehran, Iran.

2 PhD. Student, Science and Research Branch. Islamic Azad University. Tehran. Iran.

3 M.Sc. Student، Department of Aerospace Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran

4 Ph.D. Holder, Science, and Research Branch. Islamic Azad University.


This paper proposes a method based on the artificial intelligence reinforcement Q-learning algorithm and paired comparison technique to solve the problem of health monitoring devices shortage in airlines. In this research, Kish Airline destinations considered as a case study. By considering the importance of continuing air travels during covid-19 pandemic, one of the most effective ways for decreasing the risk of COVID-19 infections in air travels is establishing the health monitoring stations at the airport gates. In view of the enormous number of airports and airlines routes, nationwide coverage of them by health monitoring stations is unimaginable. Therefore, in this paper, artificial intelligence reinforcement Q-learning algorithm functionality in estimating the risk of infecting the COVID-19 virus was considered for the Kish Airline destinations. Furthermore, the optimal policy for the distribution of the health monitoring devices is designed based on the computational model.


Main Subjects

[1]   C. Huang et al., "Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China," The lancet, vol. 395, no. 10223, pp. 497-506, 2020.
[2]   T. Hale, N. Angrist, B. Kira, A. Petherick, T. Phillips, and S. Webster, "Variation in government responses to COVID-19," Work. Pap, 2020.
[3]   C. Hou et al., "The effectiveness of quarantine of Wuhan city against the Corona Virus Disease 2019 (COVID‐19): A well‐mixed SEIR model analysis," ournal of medical virology, vol. 92, no. 7, pp. 841-848, 2020.
[4]   D. Rodríguez-Urrego and L. Rodríguez-Urrego, "Air quality during the COVID-19: PM2. 5 analysis in the 50 most polluted capital cities in the world," Environmental Pollution, vol. 266, p. 115042, 2020.
[5]   R. E. Jordan, P. Adab, and K. Cheng, "Covid-19: risk factors for severe disease and death,"  vol. 368, ed. Bmj: British Medical Journal Publishing Group, 2020.
[6]   M. Casagrande, F. Favieri, R. Tambelli, and G. Forte, "The enemy who sealed the world: effects quarantine due to the COVID-19 on sleep quality, anxiety, and psychological distress in the Italian population," Sleep medicine, vol. 75, pp. 12-20, 2020.
[7]   B. N. Ashraf, "Economic impact of government interventions during the COVID-19 pandemic: International evidence from financial markets," Journal of behavioral experimental finance, vol. 27, p. 100371, 2020.
[8]   M. Chinazzi et al., "The effect of travel restrictions on the spread of the 2019 novel coronavirus (COVID-19) outbreak," Science, vol. 368, no. 6489, pp. 395-400, 2020.
[9]   S. Gössling, D. Scott, and C. M. Hall, "Pandemics, tourism and global change: a rapid assessment of COVID-19," Journal of sustainable tourism, vol. 29, no. 1, pp. 1-20, 2020.
[10] M. L. Ranney, V. Griffeth, and A. K. Jha, "Critical supply shortages—the need for ventilators and personal protective equipment during the Covid-19 pandemic," New England Journal of Medicine, vol. 382, no. 18, p. e41, 2020.
[11] C. Beetz et al., "Rapid large-scale COVID-19 testing during shortages," Diagnostics, vol. 10, no. 7, p. 464, 2020.
[12] D. Lee, H. Seo, and M. W. Jung, "Neural basis of reinforcement learning and decision making," Annual review of neuroscience, vol. 35, p. 287, 2012.
[13] I. Shafieenejad, S. Ghasemi, and M. Siami, "COVID-19 Infection Risk Index Estimation in Flight Destinations (case study: Kish Air destinations),"  International Journal of Reliability, Risk Safety: Theory Application, vol. 3, no. 2, pp. 63-70, 2020.
[14] "Airports Council International Advisory Bulletin: The Impact of COVID- 19 on the Airport Business. Montreal, Canada: Airports Council International; 2020.."
[15] S. M. Iacus, F. Natale, C. Santamaria, S. Spyratos, and M. Vespe, "Estimating and projecting air passenger traffic during the COVID-19 coronavirus outbreak and its socio-economic impact," Safety Science, vol. 129, p. 104791, 2020.
[16] J. P. Bartkowski, X. Xu, and M. L. Levin, "Religion and child development: Evidence from the early childhood longitudinal study," Social science research, vol. 37, no. 1, pp. 18-36, 2008.
[17] D. Gillen and A. Lall, "International transmission of shocks in the airline industry," Journal of Air Transport Management, vol. 9, no. 1, pp. 37-49, 2003.
[18] E. Loh, "The impact of SARS on the performance and risk profile of airline stocks," The Impact of SARS on the Performance Risk Profile of Airline Stocks, pp. 1000-1022, 2006.
[19] L. Zhang, H. Yang, K. Wang, Y. Zhan, and L. Bian, "Measuring imported case risk of COVID-19 from inbound international flights---A case study on China," Journal of Air Transport Management, vol. 89, p. 101918, 2020.
[20] J. Chen et al., "Potential transmission of SARS-CoV-2 on a flight from Singapore to Hangzhou, China: an epidemiological investigation," Travel medicine infectious disease, vol. 36, p. 101816, 2020.
[21] E. Foruzan, L.-K. Soh, and S. Asgarpoor, "Reinforcement learning approach for optimal distributed energy management in a microgrid," IEEE Transactions on Power Systems, vol. 33, no. 5, pp. 5749-5758, 2018.
[22] C. Watkins, "Learning from delayed rewards," PhD thesis, University of Cambridge, 1989.
[23] C.-H. Yeh, H. Deng, and H. Pan, "Multi-criteria analysis for dredger dispatching under uncertainty," Journal of the Operational Research Society, vol. 50, no. 1, pp. 35-43, 1999.
[24] F. Wauthier, M. Jordan, and N. Jojic, "Efficient ranking from pairwise comparisons," in International Conference on Machine Learning, 2013, pp. 109-117: PMLR.
[25] K. J. Arrow, Social choice and individual values. Yale university press, 2012.
[26] National portal of statistics. Available:, 1395
[28] Introduction of National SDI. Available:, 1399
[29] Flight Schedule. Available:, 1399
[30] A. Jain, K. Nandakumar, and A. Ross, "Score normalization in multimodal biometric systems," Pattern recognition, vol. 38, no. 12, pp. 2270-2285, 2005.
[31] M. Aghaali, G. Kolifarhood, R. Nikbakht, H. M. Saadati, and S. S. Hashemi Nazari, "Estimation of the serial interval and basic reproduction number of COVID‐19 in Qom, Iran, and three other countries: A data‐driven analysis in the early phase of the outbreak," Transboundary emerging diseases, vol. 67, no. 6, pp. 2860-2868, 2020.