Image Registration Algorithm for Deep Learning-Based Stereo Visual Control of Mobile Robots
Апстракт
Since the emergence of deep learning as a dominant technique for numerous tasks in the computer vision domain, the robotics community has strived to utilize its potential. Deep learning represents a framework capable of learning the most complex models necessary to carry out various robotic tasks. We propose to integrate deep learning and one of the fundamental robotic algorithms—visual servoing. Fully convolutional neural networks are used for semantic segmentation, which represents the process of labeling every pixel within the image. The obtained information from labeled (categorical) images can be crucial for mobile robot control in dynamic environments. To adequately utilize semantic segmentation for mobile robot control, the segmented images acquired at the desired and the current pose need to be registered (aligned). Since the accuracy of visual servoing depends on the accuracy of the image registration process, we propose to increase the accuracy of mobile robot positioning by ...analyzing three different optimization algorithms devoted to the registration of categorical images. The standard gradient descent algorithm is compared to the OnePlusOneEvolutionary algorithm, and simulated annealing. Moreover, different cost functions such as Mattes mutual information, global accuracy, and mean intersection over union are also investigated. All the algorithms are tested on our own wheeled mobile robot RAICO (Robot with Artificial Intelligence based COgnition) developed within the Laboratory for robotics and artificial intelligence. The results indicate that the algorithm with a larger exploration to exploitation ratio provides better results. Moreover, the cost function with the steepest convex domain is more advantageous.
Кључне речи:
Visual servoing / Stereo vision / Mobile robot control / Image registration / Deep learning / Cost functionsИзвор:
Studies in Computational Intelligence, 2021, 984, 447-479Издавач:
- Springer Science and Business Media Deutschland GmbH
Финансирање / пројекти:
- Министарство науке, технолошког развоја и иновација Републике Србије, институционално финансирање - 200105 (Универзитет у Београду, Машински факултет) (RS-MESTD-inst-2020-200105)
- MISSION4.0 - Deep Machine Learning and Swarm Intelligence-Based Optimization Algorithms for Control and Scheduling of Cyber-Physical Systems in Industry 4.0 (RS-ScienceFundRS-AI-6523109)
Колекције
Институција/група
Mašinski fakultetTY - CHAP AU - Miljković, Zoran AU - Jokić, Aleksandar AU - Petrović, Milica PY - 2021 UR - https://machinery.mas.bg.ac.rs/handle/123456789/3646 AB - Since the emergence of deep learning as a dominant technique for numerous tasks in the computer vision domain, the robotics community has strived to utilize its potential. Deep learning represents a framework capable of learning the most complex models necessary to carry out various robotic tasks. We propose to integrate deep learning and one of the fundamental robotic algorithms—visual servoing. Fully convolutional neural networks are used for semantic segmentation, which represents the process of labeling every pixel within the image. The obtained information from labeled (categorical) images can be crucial for mobile robot control in dynamic environments. To adequately utilize semantic segmentation for mobile robot control, the segmented images acquired at the desired and the current pose need to be registered (aligned). Since the accuracy of visual servoing depends on the accuracy of the image registration process, we propose to increase the accuracy of mobile robot positioning by analyzing three different optimization algorithms devoted to the registration of categorical images. The standard gradient descent algorithm is compared to the OnePlusOneEvolutionary algorithm, and simulated annealing. Moreover, different cost functions such as Mattes mutual information, global accuracy, and mean intersection over union are also investigated. All the algorithms are tested on our own wheeled mobile robot RAICO (Robot with Artificial Intelligence based COgnition) developed within the Laboratory for robotics and artificial intelligence. The results indicate that the algorithm with a larger exploration to exploitation ratio provides better results. Moreover, the cost function with the steepest convex domain is more advantageous. PB - Springer Science and Business Media Deutschland GmbH T2 - Studies in Computational Intelligence T1 - Image Registration Algorithm for Deep Learning-Based Stereo Visual Control of Mobile Robots EP - 479 SP - 447 VL - 984 DO - 10.1007/978-3-030-77939-9_13 ER -
@inbook{ author = "Miljković, Zoran and Jokić, Aleksandar and Petrović, Milica", year = "2021", abstract = "Since the emergence of deep learning as a dominant technique for numerous tasks in the computer vision domain, the robotics community has strived to utilize its potential. Deep learning represents a framework capable of learning the most complex models necessary to carry out various robotic tasks. We propose to integrate deep learning and one of the fundamental robotic algorithms—visual servoing. Fully convolutional neural networks are used for semantic segmentation, which represents the process of labeling every pixel within the image. The obtained information from labeled (categorical) images can be crucial for mobile robot control in dynamic environments. To adequately utilize semantic segmentation for mobile robot control, the segmented images acquired at the desired and the current pose need to be registered (aligned). Since the accuracy of visual servoing depends on the accuracy of the image registration process, we propose to increase the accuracy of mobile robot positioning by analyzing three different optimization algorithms devoted to the registration of categorical images. The standard gradient descent algorithm is compared to the OnePlusOneEvolutionary algorithm, and simulated annealing. Moreover, different cost functions such as Mattes mutual information, global accuracy, and mean intersection over union are also investigated. All the algorithms are tested on our own wheeled mobile robot RAICO (Robot with Artificial Intelligence based COgnition) developed within the Laboratory for robotics and artificial intelligence. The results indicate that the algorithm with a larger exploration to exploitation ratio provides better results. Moreover, the cost function with the steepest convex domain is more advantageous.", publisher = "Springer Science and Business Media Deutschland GmbH", journal = "Studies in Computational Intelligence", booktitle = "Image Registration Algorithm for Deep Learning-Based Stereo Visual Control of Mobile Robots", pages = "479-447", volume = "984", doi = "10.1007/978-3-030-77939-9_13" }
Miljković, Z., Jokić, A.,& Petrović, M.. (2021). Image Registration Algorithm for Deep Learning-Based Stereo Visual Control of Mobile Robots. in Studies in Computational Intelligence Springer Science and Business Media Deutschland GmbH., 984, 447-479. https://doi.org/10.1007/978-3-030-77939-9_13
Miljković Z, Jokić A, Petrović M. Image Registration Algorithm for Deep Learning-Based Stereo Visual Control of Mobile Robots. in Studies in Computational Intelligence. 2021;984:447-479. doi:10.1007/978-3-030-77939-9_13 .
Miljković, Zoran, Jokić, Aleksandar, Petrović, Milica, "Image Registration Algorithm for Deep Learning-Based Stereo Visual Control of Mobile Robots" in Studies in Computational Intelligence, 984 (2021):447-479, https://doi.org/10.1007/978-3-030-77939-9_13 . .