AI Driven Approaches in Swarm Robotics - A review
DOI:
https://doi.org/10.59992/IJCI.2024.v3n5p4Keywords:
AI Algorithms, AI in Swarm Robotics, AI Roles, Robotics Real-World Scenarios, Swarm RoboticsAbstract
The integration of artificial intelligence (AI) and swarm robotics has brought about significant advancements. Swarm robotics is based on decentralized control and self-organization, taking inspiration from natural swarms. It involves employing a large number of uncomplicated robots to collaboratively complete intricate tasks. The algorithms underpinning swarm robotics, which is artificial intelligence, vary depending on the specific role of AI - such as error detection, navigation, coordination, and optimization - and according to the tasks that these robots aim to undertake. In this systematic review, we aim to explore algorithms based on artificial intelligence in swarm robots and the advantages of applying them in the real world. In this systematic review, 74 scientific papers published between the years 2020 to 2024 were examined, but 53 of them were included after applying our methodology to them. The review investigated the common role of AI in swarm robotics, the most commonly used AI algorithms, and the percentage of the research that was conducted and tested in the real world. In conclusion, we discovered that there is a need for research that develops fault detection and coordination strategies, as well as a need for real-world testing.
References
1. Z. H. Ismail and M. G. M. Hamami, “Systematic Literature Review of Swarm Robotics Strategies Applied to Target Search Problem with Environment Constraints,” Appl. Sci., vol. 11, no. 5, p. 2383, Mar. 2021, doi: 10.3390/app11052383.
2. A. R. Cheraghi, S. Shahzad, and K. Graffi, “Past, Present, and Future of Swarm Robotics,” in Intelligent Systems and Applications, K. Arai, Ed., in Lecture Notes in Networks and Systems, vol. 296. Cham: Springer International Publishing, 2022, pp. 190–233. doi: 10.1007/978-3-030-82199-9_13.
3. I. Olaronke, I. Rhoda, I. Gambo, O. A. Ojerinde, and O. Janet, “A Systematic Review of Swarm Robots,” 2020, Accessed: Apr. 25, 2024. [Online]. Available: http://repository.futminna.edu.ng:8080/jspui/handle/123456789/11538
4. A. Puente-Castro, D. Rivero, A. Pazos, and E. Fernandez-Blanco, “A review of artificial intelligence applied to path planning in UAV swarms,” Neural Comput. Appl., vol. 34, no. 1, pp. 153–170, Jan. 2022, doi: 10.1007/s00521-021-06569-4.
5. X. Wang, M. C. Gursoy, T. Erpek, and Y. E. Sagduyu, “Learning-Based UAV Path Planning for Data Collection with Integrated Collision Avoidance,” IEEE Internet Things J., vol. 9, no. 17, pp. 16663–16676, Sep. 2022, doi: 10.1109/JIOT.2022.3153585.
6. Y. Pan, Y. Yang, and W. Li, “A Deep Learning Trained by Genetic Algorithm to Improve the Efficiency of Path Planning for Data Collection With Multi-UAV,” IEEE Access, vol. 9, pp. 7994–8005, 2021, doi: 10.1109/ACCESS.2021.3049892.
7. J. Westheider, J. Rückin, and M. Popović, “Multi-UAV Adaptive Path Planning Using Deep Reinforcement Learning.” arXiv, Mar. 02, 2023. Accessed: Feb. 06, 2024. [Online]. Available: http://arxiv.org/abs/2303.01150
8. W. Zhang, V. S. Chipade, and D. Panagou, “Herding an Adversarial Swarm in Three-dimensional Spaces,” in 2021 American Control Conference (ACC), New Orleans, LA, USA: IEEE, May 2021, pp. 4722–4728. doi: 10.23919/ACC50511.2021.9482990.
9. K. Cui, M. Li, C. Fabian, and H. Koeppl, “Scalable Task-Driven Robotic Swarm Control via Collision Avoidance and Learning Mean-Field Control,” in 2023 IEEE International Conference on Robotics and Automation (ICRA), London, United Kingdom: IEEE, May 2023, pp. 1192–1199. doi: 10.1109/ICRA48891.2023.10161498.
10. J. Prasetyo, G. De Masi, R. Zakir, M. Alkilabi, E. Tuci, and E. Ferrante, “A bio-inspired spatial defence strategy for collective decision making in self-organized swarms,” in Proceedings of the Genetic and Evolutionary Computation Conference, Lille France: ACM, Jun. 2021, pp. 49–56. doi: 10.1145/3449639.3459356.
11. M. Calvo-Fullana, A. Pyattaev, D. Mox, S. Andreev, and A. Ribeiro, “Communications and Robotics Simulation in UAVs: A Case Study on Aerial Synthetic Aperture Antennas,” IEEE Commun. Mag., vol. 59, no. 1, pp. 22–27, Jan. 2021, doi: 10.1109/MCOM.001.2000496.
12. Q. Fang, X. Xu, X. Wang, and Y. Zeng, “Target‐driven visual navigation in indoor scenes using reinforcement learning and imitation learning,” CAAI Trans. Intell. Technol., vol. 7, no. 2, pp. 167–176, Jun. 2022, doi: 10.1049/cit2.12043.
13. F. Lotfi, F. Faraji, N. Kakodkar, T. Manderson, D. Meger, and G. Dudek, “Constrained Robotic Navigation on Preferred Terrains Using LLMs and Speech Instruction: Exploiting the Power of Adverbs,” 2024, doi: 10.48550/ARXIV.2404.02294.
14. B. Ai, Z. Wu, and D. Hsu, “Invariance is Key to Generalization: Examining the Role of Representation in Sim-to-Real Transfer for Visual Navigation,” 2023, doi: 10.48550/ARXIV.2310.15020.
15. Q. Tang, F. Yu, Z. Xu, and P. Eberhard, “Swarm Robots Search for Multiple Targets,” IEEE Access, pp. 1–1, 2020, doi: 10.1109/ACCESS.2020.2994151.
16. G. Spaey, M. Kegeleirs, D. Garzón Ramos, and M. Birattari, “Evaluation of Alternative Exploration Schemes in the Automatic Modular Design of Robot Swarms,” in Artificial Intelligence and Machine Learning, B. Bogaerts, G. Bontempi, P. Geurts, N. Harley, B. Lebichot, T. Lenaerts, and G. Louppe, Eds., in Communications in Computer and Information Science, vol. 1196. Cham: Springer International Publishing, 2020, pp. 18–33. doi: 10.1007/978-3-030-65154-1_2.
17. K. A.-R. Youssefi and M. Rouhani, “Swarm intelligence based robotic search in unknown maze-like environments,” Expert Syst. Appl., vol. 178, p. 114907, Sep. 2021, doi: 10.1016/j.eswa.2021.114907.
18. Y. Huang, S. Wu, Z. Mu, X. Long, S. Chu, and G. Zhao, “A Multi-agent Reinforcement Learning Method for Swarm Robots in Space Collaborative Exploration,” in 2020 6th International Conference on Control, Automation and Robotics (ICCAR), Singapore: IEEE, Apr. 2020, pp. 139–144. doi: 10.1109/ICCAR49639.2020.9107997.
19. X. Zhou et al., “Swarm of micro flying robots in the wild,” Sci. Robot., vol. 7, no. 66, p. eabm5954, May 2022, doi: 10.1126/scirobotics.abm5954.
20. G. Beraldo, A. Bacchin, and E. Menegatti, “People-aware navigation: AI-driven approaches to enhance the robot’s navigation capabilities,” 2021.
21. E. Karmanova, V. Serpiva, S. Perminov, A. Fedoseev, and D. Tsetserukou, “SwarmPlay: Interactive Tic-tac-toe Board Game with Swarm of Nano-UAVs driven by Reinforcement Learning,” in 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN), Vancouver, BC, Canada: IEEE, Aug. 2021, pp. 1269–1274. doi: 10.1109/RO-MAN50785.2021.9515355.
22. T. Z. Jiahao, L. Pan, and M. A. Hsieh, “Learning to Swarm with Knowledge-Based Neural Ordinary Differential Equations,” in 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA: IEEE, Dec. 2021, pp. 6912–6918. doi: 10.1109/ICRA46639.2022.9811997.
23. D. H. Stolfi and G. Danoy, “Optimising Robot Swarm Formations by Using Surrogate Models and Simulations,” Appl. Sci., vol. 13, no. 10, p. 5989, May 2023, doi: 10.3390/app13105989.
24. A. Y. Mjaid, V. Prasad, M. Jonker, C. Van Der Horst, L. De Groot, and S. Narayana, “AI-based Simultaneous Audio Localization and Communication for Robots,” in Proceedings of the 8th ACM/IEEE Conference on Internet of Things Design and Implementation, San Antonio TX USA: ACM, May 2023, pp. 172–183. doi: 10.1145/3576842.3582373.
25. T. Praczyk, “Neural control system for a swarm of autonomous underwater vehicles,” Knowl.-Based Syst., vol. 276, p. 110783, Sep. 2023, doi: 10.1016/j.knosys.2023.110783.
26. C. Jimenez Romero, A. Yegenoglu, A. Pérez Martín, S. Diaz-Pier, and A. Morrison, “Emergent communication enhances foraging behavior in evolved swarms controlled by spiking neural networks,” Swarm Intell., vol. 18, no. 1, pp. 1–29, Mar. 2024, doi: 10.1007/s11721-023-00231-6.
27. T. Zheng, Q. Han, and H. Lin, “Transporting Robotic Swarms Via Mean-Field Feedback Control,” IEEE Trans. Autom. Control, vol. 67, no. 8, pp. 4170–4177, Aug. 2022, doi: 10.1109/TAC.2021.3108672.
28. H. Zhang and L. Liu, “Intelligent Control of Swarm Robotics Employing Biomimetic Deep Learning,” Machines, vol. 9, no. 10, p. 236, Oct. 2021, doi: 10.3390/machines9100236.
29. O. Medina, S. Hacohen, and N. Shvalb, “Robotic Swarm Motion Planning for Load Carrying and Manipulating,” IEEE Access, vol. 8, pp. 53141–53150, 2020, doi: 10.1109/ACCESS.2020.2979929.
30. A. Barcis and C. Bettstetter, “Sandsbots: Robots That Sync and Swarm,” IEEE Access, vol. 8, pp. 218752–218764, 2020, doi: 10.1109/ACCESS.2020.3041393.
31. J. Hu, A. E. Turgut, B. Lennox, and F. Arvin, “Robust Formation Coordination of Robot Swarms With Nonlinear Dynamics and Unknown Disturbances: Design and Experiments,” IEEE Trans. Circuits Syst. II Express Briefs, vol. 69, no. 1, pp. 114–118, Jan. 2022, doi: 10.1109/TCSII.2021.3074705.
32. G. Adorni, “Simulation of robot swarms for learning communication-aware coordination,” 2023, doi: 10.48550/ARXIV.2302.13124.
33. N. Bredeche and N. Fontbonne, “Social learning in swarm robotics,” Philos. Trans. R. Soc. B Biol. Sci., vol. 377, no. 1843, p. 20200309, Jan. 2022, doi: 10.1098/rstb.2020.0309.
34. M. Vaidis and M. J.-D. Otis, “Toward a robot swarm protecting a group of migrants,” Intell. Serv. Robot., vol. 13, no. 2, pp. 299–314, Apr. 2020, doi: 10.1007/s11370-020-00315-w.
35. Abraham Kuriakose, Raiz Badarudheen, and Lalitaditya Charapanjeri, “Swarm Drone System with YOLOv8 Algorithm for Efficient Locust Management in Agricultural Environments,” Int. J. Adv. Res. Sci. Commun. Technol., pp. 177–188, Jun. 2023, doi: 10.48175/IJARSCT-11430.
36. S. S. Alotaibi et al., “Swarm Intelligence with Deep Transfer Learning Driven Aerial Image Classification Model on UAV Networks,” Appl. Sci., vol. 12, no. 13, p. 6488, Jun. 2022, doi: 10.3390/app12136488.
37. M. Dhuheir, E. Baccour, A. Erbad, S. Sabeeh, and M. Hamdi, “Efficient Real-Time Image Recognition Using Collaborative Swarm of UAVs and Convolutional Networks,” in 2021 International Wireless Communications and Mobile Computing (IWCMC), Harbin City, China: IEEE, Jun. 2021, pp. 1954–1959. doi: 10.1109/IWCMC51323.2021.9498967.
38. V. S. Chipade, V. S. A. Marella, and D. Panagou, “Aerial Swarm Defense by StringNet Herding: Theory and Experiments,” Front. Robot. AI, vol. 8, p. 640446, Apr. 2021, doi: 10.3389/frobt.2021.640446.
39. Y. Song, X. Fang, B. Liu, C. Li, Y. Li, and S. X. Yang, “A novel foraging algorithm for swarm robotics based on virtual pheromones and neural network,” Appl. Soft Comput., vol. 90, p. 106156, May 2020, doi: 10.1016/j.asoc.2020.106156.
40. D. H. Stolfi and G. Danoy, “Optimising autonomous robot swarm parameters for stable formation design,” in Proceedings of the Genetic and Evolutionary Computation Conference, Boston Massachusetts: ACM, Jul. 2022, pp. 1281–1289. doi: 10.1145/3512290.3528709.
41. A. Chella et al., “Quantum planning for swarm robotics,” Robot. Auton. Syst., vol. 161, p. 104362, Mar. 2023, doi: 10.1016/j.robot.2023.104362.
42. H. J. M. Lopes and D. A. Lima, “Surveillance task optimized by Evolutionary shared Tabu Inverted Ant Cellular Automata Model for swarm robotics navigation control,” Results Control Optim., vol. 8, p. 100141, Sep. 2022, doi: 10.1016/j.rico.2022.100141.
43. B. Khaldi, F. Harrou, S. M. Benslimane, and Y. Sun, “A Data-Driven Soft Sensor for Swarm Motion Speed Prediction Using Ensemble Learning Methods,” IEEE Sens. J., vol. 21, no. 17, pp. 19025–19037, Sep. 2021, doi: 10.1109/JSEN.2021.3087342.
44. A. Prabhakar et al., “Ergodic Specifications for Flexible Swarm Control: From User Commands to Persistent Adaptation,” 2020, doi: 10.48550/ARXIV.2006.06081.
45. Q. Chen et al., “A Bio-inspired Model for Bee Simulations,” IEEE Trans. Vis. Comput. Graph., pp. 1–13, 2024, doi: 10.1109/TVCG.2024.3379080.
46. A. Belkhiri, A. Amouri, and A. Cherfia, “Design of Fractional-Order PID controller for trajectory tracking control of continuum robots,” FME Trans., vol. 51, no. 2, pp. 243–252, 2023, doi: 10.5937/fme2302243B.
47. X. Zhu, F. Zhang, and H. Li, “Swarm Deep Reinforcement Learning for Robotic Manipulation,” Procedia Comput. Sci., vol. 198, pp. 472–479, 2022, doi: 10.1016/j.procs.2021.12.272.
48. G. Rossides, B. Metcalfe, and A. Hunter, “Particle Swarm Optimization—An Adaptation for the Control of Robotic Swarms,” Robotics, vol. 10, no. 2, p. 58, Apr. 2021, doi: 10.3390/robotics10020058.
49. X. Zhang and M. Ali, “A Bean Optimization-Based Cooperation Method for Target Searching by Swarm UAVs in Unknown Environments,” IEEE Access, vol. 8, pp. 43850–43862, 2020, doi: 10.1109/ACCESS.2020.2977499.
50. J. Kuckling, V. Van Pelt, and M. Birattari, “Automatic Modular Design of Behavior Trees for Robot Swarms with Communication Capabilites,” in Applications of Evolutionary Computation, P. A. Castillo and J. L. Jiménez Laredo, Eds., in Lecture Notes in Computer Science, vol. 12694. Cham: Springer International Publishing, 2021, pp. 130–145. doi: 10.1007/978-3-030-72699-7_9.
51. M. N. Sholeh, M. W. Khosiin, A. Nurdiana, and S. Fauziyah, “Achieving optimal contractor selection: an AI-driven particle swarm optimization method,” J. Proy. Tek. Sipil, vol. 6, no. 2, pp. 36–42, Sep. 2023, doi: 10.14710/potensi.2023.19629.
52. D. Morimoto, Y. Iwamoto, M. Hiraga, and K. Ohkura, “Generating Collective Behavior of a Multi-Legged Robotic Swarm Using Deep Reinforcement Learning,” J. Robot. Mechatron., vol. 35, no. 4, pp. 977–987, Aug. 2023, doi: 10.20965/jrm.2023.p0977.
53. K. I. Usanova, A. Vi. Kumar, M. Ikram, A. Dev, and S. S. Sarpal, “Intelligent Control of Electric Vehicle Drives using Swarm Robotics,” E3S Web Conf., vol. 511, p. 01028, 2024, doi: 10.1051/e3sconf/202451101028.
54. A. Khelvas et al., “Optimization of the Swarm of Robots Routing for the Sorting Center,” E3S Web Conf., vol. 469, p. 00093, 2023, doi: 10.1051/e3sconf/202346900093.
55. H. Guo, Z. Sun, and P. Wang, “Joint Design of Communication, Wireless Energy Transfer, and Control for Swarm Autonomous Underwater Vehicles,” IEEE Trans. Veh. Technol., vol. 70, no. 2, pp. 1821–1835, Feb. 2021, doi: 10.1109/TVT.2021.3053456.
56. D. H. Stolfi and G. Danoy, “Evolutionary swarm formation: From simulations to real world robots,” Eng. Appl. Artif. Intell., vol. 128, p. 107501, Feb. 2024, doi: 10.1016/j.engappai.2023.107501.