Miljković, Zoran

Link to this page

Authority KeyName Variants
orcid::0000-0001-9706-6134
  • Miljković, Zoran (247)
Projects
An innovative ecologically based approach to implementation of intelligent manufacturing systems for production of sheet metal parts Fleksibilna automatizacija i implementacija inteligentnih tehnoloških sistema u domenu proizvodnje delova od lima
Ministry of Education, Science and Technological Development, Republic of Serbia, Grant no. 200105 (University of Belgrade, Faculty of Mechanical Engineering) MISSION4.0 - Deep Machine Learning and Swarm Intelligence-Based Optimization Algorithms for Control and Scheduling of Cyber-Physical Systems in Industry 4.0
Research and development of modelling methods and approaches in manufacturing of dental recoveries with the application of modern technologies and computer aided systems Project “Biologically inspired optimization algorithms for control and scheduling of intelligent robotic systems”, Grant No. PPN/ULM/2019/1/00354/U/00001
An innovative ecologically based approach to implementation of intelligent manufacturing systems for production of sheet metal parts (RS-35004) “Biologically inspired optimization algorithms for control and scheduling of intelligent robotic systems”, Grant No. PPN/ULM/2019/1/00354/U/00001
DPI2017 - Performance indices in experimental results 86915-C3-1-R "Cognitive inspiration navigation for autonomous driving" H2020 project Grant 826417 Power2Power
Razvoj metoda i tehnika za karakterizaciju biomaterijala, biomolekula i tkiva pomoću Nanoskopa i bioimpendance Sustainability and improvement of mechanical systems in energetic, material handling and conveying by using forensic engineering, environmental and robust design
Development of devices for pilot training and dynamic flight simulation of modern fighter aircrafts: 3DoF centrifuge and 4DoF spatial disorientation trainer Ministerstwo Edukacji i Nauki WZ/WE-IA/4/2020
Ministry of Education, Science and Technological Development Ministry of Science and Technological Development
Narodowa Agencja Wymiany Akademickiej PPN/ULM/2019/1/00354/U/00001 NAWA Polish agency through the IPAE project: “Industry 4.0 in Production and Aeronautical Engineering”
Polish Ministry of Science and Higher Education, grant No WZ/WEIA/4/2020 Polish Ministry of Science and Higher Education, Grant No. WZ/WE-IA/4/2020
Polish Ministry of Science and Higher Education [WZ/WE-IA/4/2020] Polish National Agency for Academic Exchange
Polish National Agency for Academic Exchange [PPN/ULM/2019/1/00354/U/00001] Polish National Agency for Academic Exchange through the project: "Industry 4.0 in Production and Aeronautical Engineering (IPAE)"
project "Cognitive inspired navigation for autonomous driving" - "Ministerio de Economia, Industria y Competitividad" [DPI2017-86915-C3-1-R] Serbian Government

Author's Bibliography

The Arithmetic Optimization Algorithm for Multi-Objective Mobile Robot Scheduling

Jokić, Aleksandar; Petrović, Milica; Miljković, Zoran

(2023)

TY  - CONF
AU  - Jokić, Aleksandar
AU  - Petrović, Milica
AU  - Miljković, Zoran
PY  - 2023
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/7004
AB  - In recent years, metaheuristic algorithms have become increasingly advantageous for solving many real-world optimization-based engineering tasks. Integrated process planning and scheduling of machine tools and mobile robots utilized for transportation tasks in a manufacturing environment represents one such task. Since the number of solutions increases exponentially with the addition of either parts, machines, or robots, this task belongs to a group of NP-hard problems. Therefore, for its successful resolution, it is essential to use efficient algorithms that are able to explore vast solution space and provide optimal solutions. In this paper, we propose an algorithm for solving integrated scheduling of machine tools and mobile robots based on a novel arithmetic metaheuristic optimization. The arithmetic optimization algorithm belongs to a group of stochastic population-based algorithms inspired by arithmetic mathematical operations. The main advantage of the proposed algorithm is in a well-suited balance between exploration and exploitation phases that are appropriate for extremely hard multi-objective optimization. A multi-objective metric is utilized to evaluate obtained Pareto front solutions in terms of the exploration capabilities in the solution space. The proposed algorithm is compared with two other state-of-the-art metaheuristic algorithms. The experimental evaluation is carried out on 20 benchmark problems, and the results show the advantages of the proposed algorithm.
C3  - 39th International Conference on Production Engineering of Serbia (ICPES 2023)
T1  - The Arithmetic Optimization Algorithm for  Multi-Objective Mobile Robot Scheduling
EP  - 15
SP  - 9
UR  - https://hdl.handle.net/21.15107/rcub_machinery_7004
ER  - 
@conference{
author = "Jokić, Aleksandar and Petrović, Milica and Miljković, Zoran",
year = "2023",
abstract = "In recent years, metaheuristic algorithms have become increasingly advantageous for solving many real-world optimization-based engineering tasks. Integrated process planning and scheduling of machine tools and mobile robots utilized for transportation tasks in a manufacturing environment represents one such task. Since the number of solutions increases exponentially with the addition of either parts, machines, or robots, this task belongs to a group of NP-hard problems. Therefore, for its successful resolution, it is essential to use efficient algorithms that are able to explore vast solution space and provide optimal solutions. In this paper, we propose an algorithm for solving integrated scheduling of machine tools and mobile robots based on a novel arithmetic metaheuristic optimization. The arithmetic optimization algorithm belongs to a group of stochastic population-based algorithms inspired by arithmetic mathematical operations. The main advantage of the proposed algorithm is in a well-suited balance between exploration and exploitation phases that are appropriate for extremely hard multi-objective optimization. A multi-objective metric is utilized to evaluate obtained Pareto front solutions in terms of the exploration capabilities in the solution space. The proposed algorithm is compared with two other state-of-the-art metaheuristic algorithms. The experimental evaluation is carried out on 20 benchmark problems, and the results show the advantages of the proposed algorithm.",
journal = "39th International Conference on Production Engineering of Serbia (ICPES 2023)",
title = "The Arithmetic Optimization Algorithm for  Multi-Objective Mobile Robot Scheduling",
pages = "15-9",
url = "https://hdl.handle.net/21.15107/rcub_machinery_7004"
}
Jokić, A., Petrović, M.,& Miljković, Z.. (2023). The Arithmetic Optimization Algorithm for  Multi-Objective Mobile Robot Scheduling. in 39th International Conference on Production Engineering of Serbia (ICPES 2023), 9-15.
https://hdl.handle.net/21.15107/rcub_machinery_7004
Jokić A, Petrović M, Miljković Z. The Arithmetic Optimization Algorithm for  Multi-Objective Mobile Robot Scheduling. in 39th International Conference on Production Engineering of Serbia (ICPES 2023). 2023;:9-15.
https://hdl.handle.net/21.15107/rcub_machinery_7004 .
Jokić, Aleksandar, Petrović, Milica, Miljković, Zoran, "The Arithmetic Optimization Algorithm for  Multi-Objective Mobile Robot Scheduling" in 39th International Conference on Production Engineering of Serbia (ICPES 2023) (2023):9-15,
https://hdl.handle.net/21.15107/rcub_machinery_7004 .

Efficient Machine Learning of Mobile Robotic Systems based on Convolutional Neural Networks

Petrović, Milica; Miljković, Zoran; Jokić, Aleksandar

(Springer Cham, SWITZERLAND, 2023)

TY  - CHAP
AU  - Petrović, Milica
AU  - Miljković, Zoran
AU  - Jokić, Aleksandar
PY  - 2023
UR  - https://www.riotu-lab.org/airasbook/
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/6660
AB  - During the last decade, Convolutional Neural Networks (CNNs) have been recognized as one of the most promising machine learning methods that are being utilized for deep learning of autonomous robotic systems. Faced with everlasting uncertainties while working in unstructured and dynamical real-world environments, robotic systems need to be able to recognize different environmental scenarios and make adequate decisions based on machine learning of the current environment’s state representation. One of the main challenges in the development of machine learning models based on CNN is in the selection of appropriate model structure and parameters that can achieve adequate accuracy of environment representation. In order to address this challenge, the book chapter provides a comprehensive analysis of the accuracy and efficiency of CNN models for autonomous robotic applications. Particularly, different CNN models (i.e., structures and parameters) are trained, validated, and tested on real-world image data gathered by a mobile robot’s stereo vision system. The best performing CNN models based on two criteria – the number of frames per second and mean intersection over union are implemented on the real-world wheeled mobile robot RAICO (Robot with Artificial Intelligence based COgnition), which is developed in the Laboratory for robotics and artificial intelligence (ROBOTICS & AI) and tested for obstacle avoidance tasks. The achieved experimental results show that the proposed machine learning strategy based on CNN provides high accuracy of mobile robot’s current environment state estimation. This book addresses many applications of artificial intelligence in robotics, namely AI using visual and motional input. Robotic technology has made significant contributions to daily living, industrial uses, and medicinal applications. Machine learning, in particular, is critical for intelligent robots or unmanned/autonomous systems such as UAVs, UGVs, UUVs, cooperative robots, and so on. Humans are distinguished from animals by capacities such as receiving visual information, adjusting to uncertain circumstances, and making decisions to take action in a complex system. Significant progress has been made in robotics toward human-like intelligence; yet, there are still numerous unresolved issues. Deep learning, reinforcement learning, real-time learning, swarm intelligence, and other developing approaches such as tiny-ML have been developed in recent decades and used in robotics. Artificial intelligence is being integrated into robots in order to develop advanced robotics capable of performing multiple tasks and learning new things with a better perception of the environment, allowing robots to perform critical tasks with human-like vision to detect or recognize various objects. Intelligent robots have been successfully constructed using machine learning and deep learning AI technology. Robotics performance is improving as higher quality, and more precise machine learning processes are used to train computer vision models to recognize different things and carry out operations correctly with the desired outcome.
PB  - Springer Cham, SWITZERLAND
T2  - Chapter accepted for printing in the monograph book: "Artificial intelligence for Robotics and Autonomous Systems Applications", 1st ed. 2023, Edited by Prof. Ahmad Taher Azar and Prof. Anis Koubaa, Series Title: "Studies in Computational Intelligence", printed by Springer Cham
T1  - Efficient Machine Learning of  Mobile Robotic Systems based on Convolutional Neural Networks
VL  - 1093
UR  - https://hdl.handle.net/21.15107/rcub_machinery_6660
ER  - 
@inbook{
author = "Petrović, Milica and Miljković, Zoran and Jokić, Aleksandar",
year = "2023",
abstract = "During the last decade, Convolutional Neural Networks (CNNs) have been recognized as one of the most promising machine learning methods that are being utilized for deep learning of autonomous robotic systems. Faced with everlasting uncertainties while working in unstructured and dynamical real-world environments, robotic systems need to be able to recognize different environmental scenarios and make adequate decisions based on machine learning of the current environment’s state representation. One of the main challenges in the development of machine learning models based on CNN is in the selection of appropriate model structure and parameters that can achieve adequate accuracy of environment representation. In order to address this challenge, the book chapter provides a comprehensive analysis of the accuracy and efficiency of CNN models for autonomous robotic applications. Particularly, different CNN models (i.e., structures and parameters) are trained, validated, and tested on real-world image data gathered by a mobile robot’s stereo vision system. The best performing CNN models based on two criteria – the number of frames per second and mean intersection over union are implemented on the real-world wheeled mobile robot RAICO (Robot with Artificial Intelligence based COgnition), which is developed in the Laboratory for robotics and artificial intelligence (ROBOTICS & AI) and tested for obstacle avoidance tasks. The achieved experimental results show that the proposed machine learning strategy based on CNN provides high accuracy of mobile robot’s current environment state estimation. This book addresses many applications of artificial intelligence in robotics, namely AI using visual and motional input. Robotic technology has made significant contributions to daily living, industrial uses, and medicinal applications. Machine learning, in particular, is critical for intelligent robots or unmanned/autonomous systems such as UAVs, UGVs, UUVs, cooperative robots, and so on. Humans are distinguished from animals by capacities such as receiving visual information, adjusting to uncertain circumstances, and making decisions to take action in a complex system. Significant progress has been made in robotics toward human-like intelligence; yet, there are still numerous unresolved issues. Deep learning, reinforcement learning, real-time learning, swarm intelligence, and other developing approaches such as tiny-ML have been developed in recent decades and used in robotics. Artificial intelligence is being integrated into robots in order to develop advanced robotics capable of performing multiple tasks and learning new things with a better perception of the environment, allowing robots to perform critical tasks with human-like vision to detect or recognize various objects. Intelligent robots have been successfully constructed using machine learning and deep learning AI technology. Robotics performance is improving as higher quality, and more precise machine learning processes are used to train computer vision models to recognize different things and carry out operations correctly with the desired outcome.",
publisher = "Springer Cham, SWITZERLAND",
journal = "Chapter accepted for printing in the monograph book: "Artificial intelligence for Robotics and Autonomous Systems Applications", 1st ed. 2023, Edited by Prof. Ahmad Taher Azar and Prof. Anis Koubaa, Series Title: "Studies in Computational Intelligence", printed by Springer Cham",
booktitle = "Efficient Machine Learning of  Mobile Robotic Systems based on Convolutional Neural Networks",
volume = "1093",
url = "https://hdl.handle.net/21.15107/rcub_machinery_6660"
}
Petrović, M., Miljković, Z.,& Jokić, A.. (2023). Efficient Machine Learning of  Mobile Robotic Systems based on Convolutional Neural Networks. in Chapter accepted for printing in the monograph book: "Artificial intelligence for Robotics and Autonomous Systems Applications", 1st ed. 2023, Edited by Prof. Ahmad Taher Azar and Prof. Anis Koubaa, Series Title: "Studies in Computational Intelligence", printed by Springer Cham
Springer Cham, SWITZERLAND., 1093.
https://hdl.handle.net/21.15107/rcub_machinery_6660
Petrović M, Miljković Z, Jokić A. Efficient Machine Learning of  Mobile Robotic Systems based on Convolutional Neural Networks. in Chapter accepted for printing in the monograph book: "Artificial intelligence for Robotics and Autonomous Systems Applications", 1st ed. 2023, Edited by Prof. Ahmad Taher Azar and Prof. Anis Koubaa, Series Title: "Studies in Computational Intelligence", printed by Springer Cham. 2023;1093.
https://hdl.handle.net/21.15107/rcub_machinery_6660 .
Petrović, Milica, Miljković, Zoran, Jokić, Aleksandar, "Efficient Machine Learning of  Mobile Robotic Systems based on Convolutional Neural Networks" in Chapter accepted for printing in the monograph book: "Artificial intelligence for Robotics and Autonomous Systems Applications", 1st ed. 2023, Edited by Prof. Ahmad Taher Azar and Prof. Anis Koubaa, Series Title: "Studies in Computational Intelligence", printed by Springer Cham, 1093 (2023),
https://hdl.handle.net/21.15107/rcub_machinery_6660 .

Reinforcement Learning-based Collision Avoidance for UAV

Jevtić, Đorđe; Miljković, Zoran; Petrović, Milica; Jokić, Aleksandar

(ETRAN Society, The Society for Electronics, Telecommunications, Computing, Automatics and Nuclear engineering supported by IEEE, 2023)

TY  - CONF
AU  - Jevtić, Đorđe
AU  - Miljković, Zoran
AU  - Petrović, Milica
AU  - Jokić, Aleksandar
PY  - 2023
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/6896
AB  - One of the significant aspects for enabling the intelligent behavior to the Unmanned Aerial Vehicles (UAVs) is by providing an algorithm for navigation through the dynamic and unseen environment. Therefore, to be autonomous, they need sensors to perceive their surroundings and utilize gathered information to decide which action to take. Having that in mind, in this paper, the authors designed the system for obstacle avoidance and also investigate the elements of the Markov decision process and their influence on each other. The flying mobile robot used within the considered problem is quadrotor type and has an integrated Lidar sensor which is utilized to
detect obstacles. The sequential decision-making model based on Q-learning is trained within the MATLAB Simulink environment. The simulation results demonstrate that the UAV can navigate through the environment in most algorithm runs without colliding with surrounding obstacles.
PB  - ETRAN Society, The Society for Electronics, Telecommunications, Computing, Automatics and Nuclear engineering supported by IEEE
C3  - Proceedings of the 10th International Conference on Electrical, Electronics and Computing Engineering (IcETRAN 2023)
T1  - Reinforcement Learning-based Collision Avoidance for UAV
EP  - 6
IS  - 5496
SP  - 1
UR  - https://hdl.handle.net/21.15107/rcub_machinery_6896
ER  - 
@conference{
author = "Jevtić, Đorđe and Miljković, Zoran and Petrović, Milica and Jokić, Aleksandar",
year = "2023",
abstract = "One of the significant aspects for enabling the intelligent behavior to the Unmanned Aerial Vehicles (UAVs) is by providing an algorithm for navigation through the dynamic and unseen environment. Therefore, to be autonomous, they need sensors to perceive their surroundings and utilize gathered information to decide which action to take. Having that in mind, in this paper, the authors designed the system for obstacle avoidance and also investigate the elements of the Markov decision process and their influence on each other. The flying mobile robot used within the considered problem is quadrotor type and has an integrated Lidar sensor which is utilized to
detect obstacles. The sequential decision-making model based on Q-learning is trained within the MATLAB Simulink environment. The simulation results demonstrate that the UAV can navigate through the environment in most algorithm runs without colliding with surrounding obstacles.",
publisher = "ETRAN Society, The Society for Electronics, Telecommunications, Computing, Automatics and Nuclear engineering supported by IEEE",
journal = "Proceedings of the 10th International Conference on Electrical, Electronics and Computing Engineering (IcETRAN 2023)",
title = "Reinforcement Learning-based Collision Avoidance for UAV",
pages = "6-1",
number = "5496",
url = "https://hdl.handle.net/21.15107/rcub_machinery_6896"
}
Jevtić, Đ., Miljković, Z., Petrović, M.,& Jokić, A.. (2023). Reinforcement Learning-based Collision Avoidance for UAV. in Proceedings of the 10th International Conference on Electrical, Electronics and Computing Engineering (IcETRAN 2023)
ETRAN Society, The Society for Electronics, Telecommunications, Computing, Automatics and Nuclear engineering supported by IEEE.(5496), 1-6.
https://hdl.handle.net/21.15107/rcub_machinery_6896
Jevtić Đ, Miljković Z, Petrović M, Jokić A. Reinforcement Learning-based Collision Avoidance for UAV. in Proceedings of the 10th International Conference on Electrical, Electronics and Computing Engineering (IcETRAN 2023). 2023;(5496):1-6.
https://hdl.handle.net/21.15107/rcub_machinery_6896 .
Jevtić, Đorđe, Miljković, Zoran, Petrović, Milica, Jokić, Aleksandar, "Reinforcement Learning-based Collision Avoidance for UAV" in Proceedings of the 10th International Conference on Electrical, Electronics and Computing Engineering (IcETRAN 2023), no. 5496 (2023):1-6,
https://hdl.handle.net/21.15107/rcub_machinery_6896 .

Development of a Domestic 4-axis SCARA Robot

Miljković, Zoran; Slavković, Nikola; Momčilović, Bogdan; Milićević, Đorđe

(University of Kragujevac, Faculty of Mechanical and Civil Engineering in Kraljevo, 2023)

TY  - CONF
AU  - Miljković, Zoran
AU  - Slavković, Nikola
AU  - Momčilović, Bogdan
AU  - Milićević, Đorđe
PY  - 2023
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/6908
AB  - The global manufacturing industry has been demanding a steady increase in active industrial robots worldwide for years. The fields and technological tasks in which industrial robots are applied are rapidly expanding with a constant demand for improvement of their functions, technical characteristics as well as control and programming systems. One of the goals of the current research in the Laboratory for Robotics & AI is development of a domestic industrial robot with the possibility of automated programming based on information obtained from the camera. The paper presents the first part of the research developing a 4-axis SCARA industrial robot with the control system integrated camera. Professor Hiroshi Makino from Yamanashi University designed SCARA (Selective Compliance Assembly Robot Arm), and this robot is the most famous robot configuration originated at the universities. This part of the research includes the design of the mechanical structure, preliminary CAD/CAM testing, development of control and programming systems, virtual robot simulation, and robot production that were parts of two Master theses done in 2022. The realization of the robot control system starts from a well-known SCARA robot kinematic model. The open architecture control system realized in the LinuxCNC software allows the possibility of further development and full camera integration. The control system includes the integrated virtual robot model configured using several predefined Python classes and OpenGL as a digital shadow of the developed SCARA robot. Several successfully done examples of technological tasks of laser engraving have shown the verification of the complete robotic system.
PB  - University of Kragujevac, Faculty of Mechanical and Civil Engineering in Kraljevo
C3  - Proceedings of the XI International Conference Heavy Machinery-HM 2023
T1  - Development of a Domestic 4-axis SCARA Robot
EP  - P9
SP  - P1
UR  - https://hdl.handle.net/21.15107/rcub_machinery_6908
ER  - 
@conference{
author = "Miljković, Zoran and Slavković, Nikola and Momčilović, Bogdan and Milićević, Đorđe",
year = "2023",
abstract = "The global manufacturing industry has been demanding a steady increase in active industrial robots worldwide for years. The fields and technological tasks in which industrial robots are applied are rapidly expanding with a constant demand for improvement of their functions, technical characteristics as well as control and programming systems. One of the goals of the current research in the Laboratory for Robotics & AI is development of a domestic industrial robot with the possibility of automated programming based on information obtained from the camera. The paper presents the first part of the research developing a 4-axis SCARA industrial robot with the control system integrated camera. Professor Hiroshi Makino from Yamanashi University designed SCARA (Selective Compliance Assembly Robot Arm), and this robot is the most famous robot configuration originated at the universities. This part of the research includes the design of the mechanical structure, preliminary CAD/CAM testing, development of control and programming systems, virtual robot simulation, and robot production that were parts of two Master theses done in 2022. The realization of the robot control system starts from a well-known SCARA robot kinematic model. The open architecture control system realized in the LinuxCNC software allows the possibility of further development and full camera integration. The control system includes the integrated virtual robot model configured using several predefined Python classes and OpenGL as a digital shadow of the developed SCARA robot. Several successfully done examples of technological tasks of laser engraving have shown the verification of the complete robotic system.",
publisher = "University of Kragujevac, Faculty of Mechanical and Civil Engineering in Kraljevo",
journal = "Proceedings of the XI International Conference Heavy Machinery-HM 2023",
title = "Development of a Domestic 4-axis SCARA Robot",
pages = "P9-P1",
url = "https://hdl.handle.net/21.15107/rcub_machinery_6908"
}
Miljković, Z., Slavković, N., Momčilović, B.,& Milićević, Đ.. (2023). Development of a Domestic 4-axis SCARA Robot. in Proceedings of the XI International Conference Heavy Machinery-HM 2023
University of Kragujevac, Faculty of Mechanical and Civil Engineering in Kraljevo., P1-P9.
https://hdl.handle.net/21.15107/rcub_machinery_6908
Miljković Z, Slavković N, Momčilović B, Milićević Đ. Development of a Domestic 4-axis SCARA Robot. in Proceedings of the XI International Conference Heavy Machinery-HM 2023. 2023;:P1-P9.
https://hdl.handle.net/21.15107/rcub_machinery_6908 .
Miljković, Zoran, Slavković, Nikola, Momčilović, Bogdan, Milićević, Đorđe, "Development of a Domestic 4-axis SCARA Robot" in Proceedings of the XI International Conference Heavy Machinery-HM 2023 (2023):P1-P9,
https://hdl.handle.net/21.15107/rcub_machinery_6908 .

The Framework for Mobile Robot Task Planning Based on the Optimal Manufacturing Schedule

Jokić, Aleksandar; Petrović, Milica; Miljković, Zoran

(Springer, Cham, Switzerland, 2023)

TY  - CHAP
AU  - Jokić, Aleksandar
AU  - Petrović, Milica
AU  - Miljković, Zoran
PY  - 2023
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/6861
AB  - Integrated process planning and scheduling of manufacturing entities
represents one of the most impactful processes for optimizing production systems. The result of integrated process planning and scheduling is visually presented in the form of the Gantt chart that summarizes the timing and order of all
manufacturing operations. Moreover, a sequence of actions that needs to be performed by a transportation system to ensure the smooth execution of all manufacturing processes is also incorporated within the Gantt chart. Therefore, in this
paper, we develop a framework for mobile robot action planning based on highlevel action, e.g., transporting the part from one machine to another. The idea is
to automatically plan a sequence of robot-performable actions that, if performed
accurately, results in achieving a high-level goal. The framework is developed in
the standard Robot Operative System 2 (ROS2) middleware. The system, domain, and essential entities are modeled by using Planning Domain Definition
Language (PDDL). The mobile robot actions are modeled by Behavior trees
within the PlanSys2 framework.
PB  - Springer, Cham, Switzerland
T2  - New Trends in Medical and Service Robotics - MESROB 2023. Series: Mechanisms and Machine Science
T1  - The Framework for Mobile Robot Task Planning Based on the Optimal Manufacturing Schedule
EP  - 325
SP  - 317
VL  - 133
DO  - 10.1007/978-3-031-32446-8_34
ER  - 
@inbook{
author = "Jokić, Aleksandar and Petrović, Milica and Miljković, Zoran",
year = "2023",
abstract = "Integrated process planning and scheduling of manufacturing entities
represents one of the most impactful processes for optimizing production systems. The result of integrated process planning and scheduling is visually presented in the form of the Gantt chart that summarizes the timing and order of all
manufacturing operations. Moreover, a sequence of actions that needs to be performed by a transportation system to ensure the smooth execution of all manufacturing processes is also incorporated within the Gantt chart. Therefore, in this
paper, we develop a framework for mobile robot action planning based on highlevel action, e.g., transporting the part from one machine to another. The idea is
to automatically plan a sequence of robot-performable actions that, if performed
accurately, results in achieving a high-level goal. The framework is developed in
the standard Robot Operative System 2 (ROS2) middleware. The system, domain, and essential entities are modeled by using Planning Domain Definition
Language (PDDL). The mobile robot actions are modeled by Behavior trees
within the PlanSys2 framework.",
publisher = "Springer, Cham, Switzerland",
journal = "New Trends in Medical and Service Robotics - MESROB 2023. Series: Mechanisms and Machine Science",
booktitle = "The Framework for Mobile Robot Task Planning Based on the Optimal Manufacturing Schedule",
pages = "325-317",
volume = "133",
doi = "10.1007/978-3-031-32446-8_34"
}
Jokić, A., Petrović, M.,& Miljković, Z.. (2023). The Framework for Mobile Robot Task Planning Based on the Optimal Manufacturing Schedule. in New Trends in Medical and Service Robotics - MESROB 2023. Series: Mechanisms and Machine Science
Springer, Cham, Switzerland., 133, 317-325.
https://doi.org/10.1007/978-3-031-32446-8_34
Jokić A, Petrović M, Miljković Z. The Framework for Mobile Robot Task Planning Based on the Optimal Manufacturing Schedule. in New Trends in Medical and Service Robotics - MESROB 2023. Series: Mechanisms and Machine Science. 2023;133:317-325.
doi:10.1007/978-3-031-32446-8_34 .
Jokić, Aleksandar, Petrović, Milica, Miljković, Zoran, "The Framework for Mobile Robot Task Planning Based on the Optimal Manufacturing Schedule" in New Trends in Medical and Service Robotics - MESROB 2023. Series: Mechanisms and Machine Science, 133 (2023):317-325,
https://doi.org/10.1007/978-3-031-32446-8_34 . .
1

Semantic segmentation based stereo visual servoing of nonholonomic mobile robot in intelligent manufacturing environment

Jokić, Aleksandar; Petrović, Milica; Miljković, Zoran

(Pergamon-Elsevier Science Ltd, Oxford, 2022)

TY  - JOUR
AU  - Jokić, Aleksandar
AU  - Petrović, Milica
AU  - Miljković, Zoran
PY  - 2022
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/3757
AB  - In the interest of developing an intelligent manufacturing environment with an agile, efficient, and optimally utilized transportation system, mobile robots need to achieve a certain level of autonomy as they play an important role in carrying out transportation tasks. Bearing this in mind, in the paper we propose a novel stereo visual servoing method for nonholonomic mobile robot control based on semantic segmentation. Semantic segmentation provides a rich body of information required for an adequate decision-making process in a clustered, dynamic, and ever-changing manufacturing environment. The innovative idea behind the new visual servoing system is to utilize semantic information of the scene for visual servoing, as well as for other mobile robot tasks, such as obstacle avoidance, scene understanding, and simultaneous localization and mapping. Semantic segmentation is carried out by exploiting fully convolutional neural networks. The new visual servoing algorithm utilizes an intensity-based image registration procedure, which results in the image transformation matrix. The transformation matrix encompasses the relations of images taken at the current and desired pose, and that information is directly used for visual servoing. The developed algorithm is deployed on our own developed wheeled differential drive mobile robot RAICO (Robot with Artificial Intelligence based COgnition). The experimental evaluation is carried out in the 3D simulation environment and in the laboratory model of the real manufacturing environment. The experimental results show that the accuracy of the proposed approach is improved when compared to the state-of-the-art approaches while being robust to the partial occlusions of the scene and illumination changes.
PB  - Pergamon-Elsevier Science Ltd, Oxford
T2  - Expert Systems With Applications
T1  - Semantic segmentation based stereo visual servoing of nonholonomic mobile robot in intelligent manufacturing environment
SP  - 116203
VL  - 190
DO  - 10.1016/j.eswa.2021.116203
ER  - 
@article{
author = "Jokić, Aleksandar and Petrović, Milica and Miljković, Zoran",
year = "2022",
abstract = "In the interest of developing an intelligent manufacturing environment with an agile, efficient, and optimally utilized transportation system, mobile robots need to achieve a certain level of autonomy as they play an important role in carrying out transportation tasks. Bearing this in mind, in the paper we propose a novel stereo visual servoing method for nonholonomic mobile robot control based on semantic segmentation. Semantic segmentation provides a rich body of information required for an adequate decision-making process in a clustered, dynamic, and ever-changing manufacturing environment. The innovative idea behind the new visual servoing system is to utilize semantic information of the scene for visual servoing, as well as for other mobile robot tasks, such as obstacle avoidance, scene understanding, and simultaneous localization and mapping. Semantic segmentation is carried out by exploiting fully convolutional neural networks. The new visual servoing algorithm utilizes an intensity-based image registration procedure, which results in the image transformation matrix. The transformation matrix encompasses the relations of images taken at the current and desired pose, and that information is directly used for visual servoing. The developed algorithm is deployed on our own developed wheeled differential drive mobile robot RAICO (Robot with Artificial Intelligence based COgnition). The experimental evaluation is carried out in the 3D simulation environment and in the laboratory model of the real manufacturing environment. The experimental results show that the accuracy of the proposed approach is improved when compared to the state-of-the-art approaches while being robust to the partial occlusions of the scene and illumination changes.",
publisher = "Pergamon-Elsevier Science Ltd, Oxford",
journal = "Expert Systems With Applications",
title = "Semantic segmentation based stereo visual servoing of nonholonomic mobile robot in intelligent manufacturing environment",
pages = "116203",
volume = "190",
doi = "10.1016/j.eswa.2021.116203"
}
Jokić, A., Petrović, M.,& Miljković, Z.. (2022). Semantic segmentation based stereo visual servoing of nonholonomic mobile robot in intelligent manufacturing environment. in Expert Systems With Applications
Pergamon-Elsevier Science Ltd, Oxford., 190, 116203.
https://doi.org/10.1016/j.eswa.2021.116203
Jokić A, Petrović M, Miljković Z. Semantic segmentation based stereo visual servoing of nonholonomic mobile robot in intelligent manufacturing environment. in Expert Systems With Applications. 2022;190:116203.
doi:10.1016/j.eswa.2021.116203 .
Jokić, Aleksandar, Petrović, Milica, Miljković, Zoran, "Semantic segmentation based stereo visual servoing of nonholonomic mobile robot in intelligent manufacturing environment" in Expert Systems With Applications, 190 (2022):116203,
https://doi.org/10.1016/j.eswa.2021.116203 . .
1
22
16

Multi-objective scheduling of a single mobile robot based on the grey wolf optimization algorithm

Petrović, Milica; Jokić, Aleksandar; Miljković, Zoran; Kulesza, Zbigniew

(Elsevier, 2022)

TY  - JOUR
AU  - Petrović, Milica
AU  - Jokić, Aleksandar
AU  - Miljković, Zoran
AU  - Kulesza, Zbigniew
PY  - 2022
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/3946
AB  - During the last decades, intelligent mobile robots have been recognized as one of the most promising
and emerging solutions used for fulfilling material transport demands in intelligent manufacturing
systems. One of the most significant characteristics of those demands is their multi-objectivity, where
identified objectives might usually conflict. Therefore, obtaining the optimally scheduled robotic-
based material transport system that is simultaneously facing several conflicting objectives is a highly
challenging task. To address such a challenge, this paper proposes a novel multi-objective Grey Wolf
Optimizer (MOGWO) methodology to efficiently schedule material transport systems based on an
intelligent single mobile robot. The proposed optimization methodology includes the comprehensive
analysis and the mathematical formulation of 13 novel fitness functions combined to form a Pareto
front of the multi-objective optimization problem and a novel strategy for optimal exploration of multi-
objective search space. Moreover, four metrics, i.e., Generational Distance (GD), Inverted Generational
Distance (IGD), Spacing (SP), and Maximum Spread (MS), are employed to quantitively evaluate and
compare the effectiveness of the proposed enhanced MOGWO algorithm with three state-of-the-
art metaheuristic methods (MOGA, MOAOA, and MOPSO) on 25 benchmark problems. The results
achieved through two experimental scenarios indicate that the enhanced MOGWO algorithm outper-
forms other algorithms in terms of convergence, coverage, and the robust optimal Pareto solution.
Finally, transportation paths based on obtained scheduling plans are experimentally corroborated
by the mobile robot RAICO (Robot with Artificial Intelligence based Cognition) within a physical
model of the intelligent manufacturing environment. The achieved experimental results successfully
demonstrate the efficiency of the proposed methodology for optimal multi-objective scheduling of
material transport tasks based on a single mobile robotic system.
PB  - Elsevier
T2  - Applied Soft Computing
T1  - Multi-objective scheduling of a single mobile robot based on the grey wolf optimization algorithm
SP  - 109784
VL  - 131
DO  - 10.1016/j.asoc.2022.109784
ER  - 
@article{
author = "Petrović, Milica and Jokić, Aleksandar and Miljković, Zoran and Kulesza, Zbigniew",
year = "2022",
abstract = "During the last decades, intelligent mobile robots have been recognized as one of the most promising
and emerging solutions used for fulfilling material transport demands in intelligent manufacturing
systems. One of the most significant characteristics of those demands is their multi-objectivity, where
identified objectives might usually conflict. Therefore, obtaining the optimally scheduled robotic-
based material transport system that is simultaneously facing several conflicting objectives is a highly
challenging task. To address such a challenge, this paper proposes a novel multi-objective Grey Wolf
Optimizer (MOGWO) methodology to efficiently schedule material transport systems based on an
intelligent single mobile robot. The proposed optimization methodology includes the comprehensive
analysis and the mathematical formulation of 13 novel fitness functions combined to form a Pareto
front of the multi-objective optimization problem and a novel strategy for optimal exploration of multi-
objective search space. Moreover, four metrics, i.e., Generational Distance (GD), Inverted Generational
Distance (IGD), Spacing (SP), and Maximum Spread (MS), are employed to quantitively evaluate and
compare the effectiveness of the proposed enhanced MOGWO algorithm with three state-of-the-
art metaheuristic methods (MOGA, MOAOA, and MOPSO) on 25 benchmark problems. The results
achieved through two experimental scenarios indicate that the enhanced MOGWO algorithm outper-
forms other algorithms in terms of convergence, coverage, and the robust optimal Pareto solution.
Finally, transportation paths based on obtained scheduling plans are experimentally corroborated
by the mobile robot RAICO (Robot with Artificial Intelligence based Cognition) within a physical
model of the intelligent manufacturing environment. The achieved experimental results successfully
demonstrate the efficiency of the proposed methodology for optimal multi-objective scheduling of
material transport tasks based on a single mobile robotic system.",
publisher = "Elsevier",
journal = "Applied Soft Computing",
title = "Multi-objective scheduling of a single mobile robot based on the grey wolf optimization algorithm",
pages = "109784",
volume = "131",
doi = "10.1016/j.asoc.2022.109784"
}
Petrović, M., Jokić, A., Miljković, Z.,& Kulesza, Z.. (2022). Multi-objective scheduling of a single mobile robot based on the grey wolf optimization algorithm. in Applied Soft Computing
Elsevier., 131, 109784.
https://doi.org/10.1016/j.asoc.2022.109784
Petrović M, Jokić A, Miljković Z, Kulesza Z. Multi-objective scheduling of a single mobile robot based on the grey wolf optimization algorithm. in Applied Soft Computing. 2022;131:109784.
doi:10.1016/j.asoc.2022.109784 .
Petrović, Milica, Jokić, Aleksandar, Miljković, Zoran, Kulesza, Zbigniew, "Multi-objective scheduling of a single mobile robot based on the grey wolf optimization algorithm" in Applied Soft Computing, 131 (2022):109784,
https://doi.org/10.1016/j.asoc.2022.109784 . .
8
8

Multi-Objective Population-based Optimization Algorithms for Scheduling of Manufacturing Entities

Petrović, Milica; Jokić, Aleksandar; Miljković, Zoran; Kulesza, Zbigniew

(2022)

TY  - CONF
AU  - Petrović, Milica
AU  - Jokić, Aleksandar
AU  - Miljković, Zoran
AU  - Kulesza, Zbigniew
PY  - 2022
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/3968
AB  - The contemporary manufacturing systems face a challenging and uncertain future due to frequent customer demands for customized products. A promising direction that can enable manufacturing systems to fulfill the market requirements is the adaptation of a reconfigurable manufacturing system paradigm. Physical reconfigurability can be achieved by developing systems that can satisfy conflicting production priorities such as minimal production time and maximal profit. Having that in mind, in this paper, the authors present a comprehensive analysis of population-based multi-objective optimization algorithms utilized for scheduling manufacturing entities. The output of multi-objective optimization is a set of Pareto optimal solutions in the form of production scheduling plans with transportation constraints. Three state-of-the-art population-based algorithms i.e., Genetic Algorithm (GA), Particle Swarm Optimization (PSO), and Whale Optimization Algorithm (WOA), are employed for optimization, while the experimental results show the effectiveness and superiority of the WOA algorithm.
C3  - Proceedings of the 26th International Conference on Methods and Models in Automation and Robotics (MMAR 2022)
T1  - Multi-Objective Population-based Optimization Algorithms for Scheduling of Manufacturing Entities
SP  - 403-407
DO  - 10.1109/MMAR55195.2022.9874301
ER  - 
@conference{
author = "Petrović, Milica and Jokić, Aleksandar and Miljković, Zoran and Kulesza, Zbigniew",
year = "2022",
abstract = "The contemporary manufacturing systems face a challenging and uncertain future due to frequent customer demands for customized products. A promising direction that can enable manufacturing systems to fulfill the market requirements is the adaptation of a reconfigurable manufacturing system paradigm. Physical reconfigurability can be achieved by developing systems that can satisfy conflicting production priorities such as minimal production time and maximal profit. Having that in mind, in this paper, the authors present a comprehensive analysis of population-based multi-objective optimization algorithms utilized for scheduling manufacturing entities. The output of multi-objective optimization is a set of Pareto optimal solutions in the form of production scheduling plans with transportation constraints. Three state-of-the-art population-based algorithms i.e., Genetic Algorithm (GA), Particle Swarm Optimization (PSO), and Whale Optimization Algorithm (WOA), are employed for optimization, while the experimental results show the effectiveness and superiority of the WOA algorithm.",
journal = "Proceedings of the 26th International Conference on Methods and Models in Automation and Robotics (MMAR 2022)",
title = "Multi-Objective Population-based Optimization Algorithms for Scheduling of Manufacturing Entities",
pages = "403-407",
doi = "10.1109/MMAR55195.2022.9874301"
}
Petrović, M., Jokić, A., Miljković, Z.,& Kulesza, Z.. (2022). Multi-Objective Population-based Optimization Algorithms for Scheduling of Manufacturing Entities. in Proceedings of the 26th International Conference on Methods and Models in Automation and Robotics (MMAR 2022), 403-407.
https://doi.org/10.1109/MMAR55195.2022.9874301
Petrović M, Jokić A, Miljković Z, Kulesza Z. Multi-Objective Population-based Optimization Algorithms for Scheduling of Manufacturing Entities. in Proceedings of the 26th International Conference on Methods and Models in Automation and Robotics (MMAR 2022). 2022;:403-407.
doi:10.1109/MMAR55195.2022.9874301 .
Petrović, Milica, Jokić, Aleksandar, Miljković, Zoran, Kulesza, Zbigniew, "Multi-Objective Population-based Optimization Algorithms for Scheduling of Manufacturing Entities" in Proceedings of the 26th International Conference on Methods and Models in Automation and Robotics (MMAR 2022) (2022):403-407,
https://doi.org/10.1109/MMAR55195.2022.9874301 . .
1
1

Object Detection and Reinforcement Learning Approach for Intelligent Control of UAV

Miljković, Zoran; Jevtić, Đorđe

(Springer Science and Business Media Deutschland GmbH, 2022)

TY  - CONF
AU  - Miljković, Zoran
AU  - Jevtić, Đorđe
PY  - 2022
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/3823
AB  - In recent years, the development of deep learning models that can generate more accurate predictions and operate in real-time has brought both opportunities and challenges across the various domains of robotic vision. This breakthrough enables researchers to design and deploy more challenging tasks on intelligent mobile robots, which require emphasized abilities of learning and reasoning. In this paper, a new method for intelligent robot control, based on deep learning and reinforcement learning is proposed. The fundamental idea of this work is how the UAV equipped with a monocular camera can learn significant information about the object of interest in the context of its localization and navigation. For such purpose, the object detection system based on Tiny YOLOv2 architecture is employed. Furthermore, bounding box data generated by a convolution neural network is utilized for depth estimation and determining object boundaries. This information has shown how the state-space dimensions can be significantly reduced, which was essential for further implementation of the Q-learning algorithm. In order to test the proposed framework, a model is developed in MATLAB Simulink. The simulation, which covered different scenarios, was carried out on the UAV within the 3D scene rendered by Unreal Engine. The obtained results have demonstrated the applicability of the proposed methodology for depth estimation, gathering information about the object, object-driven navigation, and autonomous localization and navigation.
PB  - Springer Science and Business Media Deutschland GmbH
C3  - Lecture Notes in Networks and Systems
T1  - Object Detection and Reinforcement Learning Approach for Intelligent Control of UAV
EP  - 669
SP  - 659
VL  - 472 LNNS
DO  - 10.1007/978-3-031-05230-9_79
ER  - 
@conference{
author = "Miljković, Zoran and Jevtić, Đorđe",
year = "2022",
abstract = "In recent years, the development of deep learning models that can generate more accurate predictions and operate in real-time has brought both opportunities and challenges across the various domains of robotic vision. This breakthrough enables researchers to design and deploy more challenging tasks on intelligent mobile robots, which require emphasized abilities of learning and reasoning. In this paper, a new method for intelligent robot control, based on deep learning and reinforcement learning is proposed. The fundamental idea of this work is how the UAV equipped with a monocular camera can learn significant information about the object of interest in the context of its localization and navigation. For such purpose, the object detection system based on Tiny YOLOv2 architecture is employed. Furthermore, bounding box data generated by a convolution neural network is utilized for depth estimation and determining object boundaries. This information has shown how the state-space dimensions can be significantly reduced, which was essential for further implementation of the Q-learning algorithm. In order to test the proposed framework, a model is developed in MATLAB Simulink. The simulation, which covered different scenarios, was carried out on the UAV within the 3D scene rendered by Unreal Engine. The obtained results have demonstrated the applicability of the proposed methodology for depth estimation, gathering information about the object, object-driven navigation, and autonomous localization and navigation.",
publisher = "Springer Science and Business Media Deutschland GmbH",
journal = "Lecture Notes in Networks and Systems",
title = "Object Detection and Reinforcement Learning Approach for Intelligent Control of UAV",
pages = "669-659",
volume = "472 LNNS",
doi = "10.1007/978-3-031-05230-9_79"
}
Miljković, Z.,& Jevtić, Đ.. (2022). Object Detection and Reinforcement Learning Approach for Intelligent Control of UAV. in Lecture Notes in Networks and Systems
Springer Science and Business Media Deutschland GmbH., 472 LNNS, 659-669.
https://doi.org/10.1007/978-3-031-05230-9_79
Miljković Z, Jevtić Đ. Object Detection and Reinforcement Learning Approach for Intelligent Control of UAV. in Lecture Notes in Networks and Systems. 2022;472 LNNS:659-669.
doi:10.1007/978-3-031-05230-9_79 .
Miljković, Zoran, Jevtić, Đorđe, "Object Detection and Reinforcement Learning Approach for Intelligent Control of UAV" in Lecture Notes in Networks and Systems, 472 LNNS (2022):659-669,
https://doi.org/10.1007/978-3-031-05230-9_79 . .
1
1

Inteligentno stereo-vizuelno upravljanje mobilnih robota i optimalno terminiranje tehnoloških procesa - pregled rezultata istraživanja u okviru projekta MISSION4.0/Intelligent stereo-visual mobile robot control and optimal process planning and scheduling – overview of research results within the project MISSION4.0

Miljković, Zoran; Babić, Bojan; Petrović, Milica; Jokić, Aleksandar; Miljković, Katarina; Jevtić, Đorđe; Đokić, Lazar

(2022)

TY  - CONF
AU  - Miljković, Zoran
AU  - Babić, Bojan
AU  - Petrović, Milica
AU  - Jokić, Aleksandar
AU  - Miljković, Katarina
AU  - Jevtić, Đorđe
AU  - Đokić, Lazar
PY  - 2022
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/3969
AB  - Projekat MISSION4.0 podrazumevao je, u okviru nekoliko radnih paketa, razvoj inteligentnog stereo-vizuelnog upravljanja mobilnih robota, kao i optimalno planiranje i terminiranje tehnoloških procesa, i to baziranim na tehnikama veštačke inteligencije, posebno na konvolucionim veštačkim neuronskim mrežama i biološki inspirisanim algoritmima optimizacije. Tokom dvogodišnjih intenzivnih naučnih istraživanja razvijena je nova metodologija za autonomnu navigaciju i inteligentno upravljanje mobilnih robota sopstvenog razvoja, nazvanih RAICO i DOMINO. Generisanje optimalnog plana terminiranja tehnoloških procesa, u okviru koga se izvršava i inteligentni unutrašnji transport korišćenjem mobilnih robota, takođe je bio jedan od važnih ciljeva ovih naprednih istraživanja. U ovom radu, dat je pregled nekih od ključnih rezultata projekta MISSION4.0, poput publikovanih u vodećim međunarodnim i nacionalnim naučnim časopisima, objavljenih poglavlja u naučnim monografijama, saopštenih i odštampanih naučnih radova u zbornicima prestižnih konferencija održanih u inostranstvu i regionu, zatim u okviru verifikovanih tehničkih rešenja, kao i preko skupova podataka sa otvorenim pristupom.
C3  - 43. JUPITER Konferencija, 39. simpozijum „NU-ROBOTI-FTS“, Zbornik radova
T1  - Inteligentno stereo-vizuelno upravljanje mobilnih robota i optimalno terminiranje tehnoloških procesa - pregled rezultata istraživanja u okviru projekta MISSION4.0/Intelligent stereo-visual mobile robot control and optimal process planning and scheduling – overview of research results within the project MISSION4.0
SP  - 3.13-3.25
UR  - https://hdl.handle.net/21.15107/rcub_machinery_3969
ER  - 
@conference{
author = "Miljković, Zoran and Babić, Bojan and Petrović, Milica and Jokić, Aleksandar and Miljković, Katarina and Jevtić, Đorđe and Đokić, Lazar",
year = "2022",
abstract = "Projekat MISSION4.0 podrazumevao je, u okviru nekoliko radnih paketa, razvoj inteligentnog stereo-vizuelnog upravljanja mobilnih robota, kao i optimalno planiranje i terminiranje tehnoloških procesa, i to baziranim na tehnikama veštačke inteligencije, posebno na konvolucionim veštačkim neuronskim mrežama i biološki inspirisanim algoritmima optimizacije. Tokom dvogodišnjih intenzivnih naučnih istraživanja razvijena je nova metodologija za autonomnu navigaciju i inteligentno upravljanje mobilnih robota sopstvenog razvoja, nazvanih RAICO i DOMINO. Generisanje optimalnog plana terminiranja tehnoloških procesa, u okviru koga se izvršava i inteligentni unutrašnji transport korišćenjem mobilnih robota, takođe je bio jedan od važnih ciljeva ovih naprednih istraživanja. U ovom radu, dat je pregled nekih od ključnih rezultata projekta MISSION4.0, poput publikovanih u vodećim međunarodnim i nacionalnim naučnim časopisima, objavljenih poglavlja u naučnim monografijama, saopštenih i odštampanih naučnih radova u zbornicima prestižnih konferencija održanih u inostranstvu i regionu, zatim u okviru verifikovanih tehničkih rešenja, kao i preko skupova podataka sa otvorenim pristupom.",
journal = "43. JUPITER Konferencija, 39. simpozijum „NU-ROBOTI-FTS“, Zbornik radova",
title = "Inteligentno stereo-vizuelno upravljanje mobilnih robota i optimalno terminiranje tehnoloških procesa - pregled rezultata istraživanja u okviru projekta MISSION4.0/Intelligent stereo-visual mobile robot control and optimal process planning and scheduling – overview of research results within the project MISSION4.0",
pages = "3.13-3.25",
url = "https://hdl.handle.net/21.15107/rcub_machinery_3969"
}
Miljković, Z., Babić, B., Petrović, M., Jokić, A., Miljković, K., Jevtić, Đ.,& Đokić, L.. (2022). Inteligentno stereo-vizuelno upravljanje mobilnih robota i optimalno terminiranje tehnoloških procesa - pregled rezultata istraživanja u okviru projekta MISSION4.0/Intelligent stereo-visual mobile robot control and optimal process planning and scheduling – overview of research results within the project MISSION4.0. in 43. JUPITER Konferencija, 39. simpozijum „NU-ROBOTI-FTS“, Zbornik radova, 3.13-3.25.
https://hdl.handle.net/21.15107/rcub_machinery_3969
Miljković Z, Babić B, Petrović M, Jokić A, Miljković K, Jevtić Đ, Đokić L. Inteligentno stereo-vizuelno upravljanje mobilnih robota i optimalno terminiranje tehnoloških procesa - pregled rezultata istraživanja u okviru projekta MISSION4.0/Intelligent stereo-visual mobile robot control and optimal process planning and scheduling – overview of research results within the project MISSION4.0. in 43. JUPITER Konferencija, 39. simpozijum „NU-ROBOTI-FTS“, Zbornik radova. 2022;:3.13-3.25.
https://hdl.handle.net/21.15107/rcub_machinery_3969 .
Miljković, Zoran, Babić, Bojan, Petrović, Milica, Jokić, Aleksandar, Miljković, Katarina, Jevtić, Đorđe, Đokić, Lazar, "Inteligentno stereo-vizuelno upravljanje mobilnih robota i optimalno terminiranje tehnoloških procesa - pregled rezultata istraživanja u okviru projekta MISSION4.0/Intelligent stereo-visual mobile robot control and optimal process planning and scheduling – overview of research results within the project MISSION4.0" in 43. JUPITER Konferencija, 39. simpozijum „NU-ROBOTI-FTS“, Zbornik radova (2022):3.13-3.25,
https://hdl.handle.net/21.15107/rcub_machinery_3969 .

Mobile robot decision-making system based on deep machine learning

Jokić, Aleksandar; Petrović, Milica; Miljković, Zoran

(2022)

TY  - CONF
AU  - Jokić, Aleksandar
AU  - Petrović, Milica
AU  - Miljković, Zoran
PY  - 2022
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/4230
AB  - One of the major aspects of Industry 4.0 is enabling
the manufacturing entities to operate in the dynamical systems
autonomously. Therefore, to be autonomous, manufacturing
entities need to have sensors to perceive their environment and
utilize that information to make decisions regarding their
actions. Having that in mind, in this paper, the authors propose a
mobile robot decision-making system based on the integration of
visual data and mobile robot pose. Mobile robot pose (current
position and orientation) is integrated with two images gathered
by two cameras and utilized to predict the possibility of gripping
the part to be manufactured. A decision-making system is
created by utilizing the deep learning model Resnet18 with an
additional input for the mobile robot pose. The model is trained
end-to-end and experimental evaluation is performed by using
the mobile robot RACIO (Robot with Artificial Intelligence
based COgnition).
C3  - Proceedings / 9th International Conference on Electrical, Electronics and Computing Engineering (IcETRAN 2022) Novi Pazar, Serbia, 6-9, June, 2022
T1  - Mobile robot decision-making system based on deep machine learning
EP  - 638
SP  - 635
UR  - https://hdl.handle.net/21.15107/rcub_machinery_4230
ER  - 
@conference{
author = "Jokić, Aleksandar and Petrović, Milica and Miljković, Zoran",
year = "2022",
abstract = "One of the major aspects of Industry 4.0 is enabling
the manufacturing entities to operate in the dynamical systems
autonomously. Therefore, to be autonomous, manufacturing
entities need to have sensors to perceive their environment and
utilize that information to make decisions regarding their
actions. Having that in mind, in this paper, the authors propose a
mobile robot decision-making system based on the integration of
visual data and mobile robot pose. Mobile robot pose (current
position and orientation) is integrated with two images gathered
by two cameras and utilized to predict the possibility of gripping
the part to be manufactured. A decision-making system is
created by utilizing the deep learning model Resnet18 with an
additional input for the mobile robot pose. The model is trained
end-to-end and experimental evaluation is performed by using
the mobile robot RACIO (Robot with Artificial Intelligence
based COgnition).",
journal = "Proceedings / 9th International Conference on Electrical, Electronics and Computing Engineering (IcETRAN 2022) Novi Pazar, Serbia, 6-9, June, 2022",
title = "Mobile robot decision-making system based on deep machine learning",
pages = "638-635",
url = "https://hdl.handle.net/21.15107/rcub_machinery_4230"
}
Jokić, A., Petrović, M.,& Miljković, Z.. (2022). Mobile robot decision-making system based on deep machine learning. in Proceedings / 9th International Conference on Electrical, Electronics and Computing Engineering (IcETRAN 2022) Novi Pazar, Serbia, 6-9, June, 2022, 635-638.
https://hdl.handle.net/21.15107/rcub_machinery_4230
Jokić A, Petrović M, Miljković Z. Mobile robot decision-making system based on deep machine learning. in Proceedings / 9th International Conference on Electrical, Electronics and Computing Engineering (IcETRAN 2022) Novi Pazar, Serbia, 6-9, June, 2022. 2022;:635-638.
https://hdl.handle.net/21.15107/rcub_machinery_4230 .
Jokić, Aleksandar, Petrović, Milica, Miljković, Zoran, "Mobile robot decision-making system based on deep machine learning" in Proceedings / 9th International Conference on Electrical, Electronics and Computing Engineering (IcETRAN 2022) Novi Pazar, Serbia, 6-9, June, 2022 (2022):635-638,
https://hdl.handle.net/21.15107/rcub_machinery_4230 .

Data Augmentation Methods for Semantic Segmentation-based Mobile Robot Perception System

Jokić, Aleksandar; Đokić, Lazar; Petrović, Milica; Miljković, Zoran

(2022)

TY  - JOUR
AU  - Jokić, Aleksandar
AU  - Đokić, Lazar
AU  - Petrović, Milica
AU  - Miljković, Zoran
PY  - 2022
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/3967
AB  - Data augmentation has become a standard technique for increasing deep learning models’ accuracy and robustness. Different pixel intensity modifications, image transformations, and noise additions represent the most utilized data augmentation methods. In this paper, a comprehensive evaluation of data augmentation techniques for mobile robot perception system is performed. The perception system based on a deep learning model for semantic segmentation is augmented by 17 techniques to obtain better generalization characteristics during the training process. The deep learning model is trained and tested on a custom dataset and utilized in real-time scenarios. The experimental results show the increment of 6.2 in mIoU (mean Intersection over Union) for the best combination of data augmentation strategies.
T2  - Serbian Journal of Electrical Engineering
T1  - Data Augmentation Methods for Semantic Segmentation-based Mobile Robot Perception System
IS  - 3
SP  - 291-302
VL  - 19
DO  - https://doi.org/10.2298/SJEE2203291J
ER  - 
@article{
author = "Jokić, Aleksandar and Đokić, Lazar and Petrović, Milica and Miljković, Zoran",
year = "2022",
abstract = "Data augmentation has become a standard technique for increasing deep learning models’ accuracy and robustness. Different pixel intensity modifications, image transformations, and noise additions represent the most utilized data augmentation methods. In this paper, a comprehensive evaluation of data augmentation techniques for mobile robot perception system is performed. The perception system based on a deep learning model for semantic segmentation is augmented by 17 techniques to obtain better generalization characteristics during the training process. The deep learning model is trained and tested on a custom dataset and utilized in real-time scenarios. The experimental results show the increment of 6.2 in mIoU (mean Intersection over Union) for the best combination of data augmentation strategies.",
journal = "Serbian Journal of Electrical Engineering",
title = "Data Augmentation Methods for Semantic Segmentation-based Mobile Robot Perception System",
number = "3",
pages = "291-302",
volume = "19",
doi = "https://doi.org/10.2298/SJEE2203291J"
}
Jokić, A., Đokić, L., Petrović, M.,& Miljković, Z.. (2022). Data Augmentation Methods for Semantic Segmentation-based Mobile Robot Perception System. in Serbian Journal of Electrical Engineering, 19(3), 291-302.
https://doi.org/https://doi.org/10.2298/SJEE2203291J
Jokić A, Đokić L, Petrović M, Miljković Z. Data Augmentation Methods for Semantic Segmentation-based Mobile Robot Perception System. in Serbian Journal of Electrical Engineering. 2022;19(3):291-302.
doi:https://doi.org/10.2298/SJEE2203291J .
Jokić, Aleksandar, Đokić, Lazar, Petrović, Milica, Miljković, Zoran, "Data Augmentation Methods for Semantic Segmentation-based Mobile Robot Perception System" in Serbian Journal of Electrical Engineering, 19, no. 3 (2022):291-302,
https://doi.org/https://doi.org/10.2298/SJEE2203291J . .

Real-Time Mobile Robot Perception Based on Deep Learning Detection Model

Jokić, Aleksandar; Petrović, Milica; Miljković, Zoran

(Springer Science and Business Media Deutschland GmbH, 2022)

TY  - CONF
AU  - Jokić, Aleksandar
AU  - Petrović, Milica
AU  - Miljković, Zoran
PY  - 2022
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/3815
AB  - The recent advances in deep learning models have enabled the robotics community to utilize their potential. The mobile robot domain on which deep learning has the most influence is scene understanding. Scene understanding enables mobile robots to exist and execute their tasks through processes such as object detection, semantic segmentation, or instance segmentation. A perception system that can recognize and locate objects in the scene is of the highest importance for achieving autonomous behavior of robotic systems. Having that in mind, we develop the mobile robot perception system based on deep learning. More precisely, we utilize an accurate and fast Convolution Neural Network (CNN) model to enable a mobile robot to detect objects in its scene in a real-time manner. The integration of two CNN models (SSD and MobileNet) is performed and implemented on mobile robot RAICO (Robot with Artificial Intelligence based COgnition). The experimental results show that the proposed perception system enables a high degree of object recognition with satisfying inference speed, even with limited processing power provided by Nvidia Jetson Nano integrated within RACIO.
PB  - Springer Science and Business Media Deutschland GmbH
C3  - Lecture Notes in Networks and Systems
T1  - Real-Time Mobile Robot Perception Based on Deep Learning Detection Model
EP  - 677
SP  - 670
VL  - 472
DO  - 10.1007/978-3-031-05230-9_80
ER  - 
@conference{
author = "Jokić, Aleksandar and Petrović, Milica and Miljković, Zoran",
year = "2022",
abstract = "The recent advances in deep learning models have enabled the robotics community to utilize their potential. The mobile robot domain on which deep learning has the most influence is scene understanding. Scene understanding enables mobile robots to exist and execute their tasks through processes such as object detection, semantic segmentation, or instance segmentation. A perception system that can recognize and locate objects in the scene is of the highest importance for achieving autonomous behavior of robotic systems. Having that in mind, we develop the mobile robot perception system based on deep learning. More precisely, we utilize an accurate and fast Convolution Neural Network (CNN) model to enable a mobile robot to detect objects in its scene in a real-time manner. The integration of two CNN models (SSD and MobileNet) is performed and implemented on mobile robot RAICO (Robot with Artificial Intelligence based COgnition). The experimental results show that the proposed perception system enables a high degree of object recognition with satisfying inference speed, even with limited processing power provided by Nvidia Jetson Nano integrated within RACIO.",
publisher = "Springer Science and Business Media Deutschland GmbH",
journal = "Lecture Notes in Networks and Systems",
title = "Real-Time Mobile Robot Perception Based on Deep Learning Detection Model",
pages = "677-670",
volume = "472",
doi = "10.1007/978-3-031-05230-9_80"
}
Jokić, A., Petrović, M.,& Miljković, Z.. (2022). Real-Time Mobile Robot Perception Based on Deep Learning Detection Model. in Lecture Notes in Networks and Systems
Springer Science and Business Media Deutschland GmbH., 472, 670-677.
https://doi.org/10.1007/978-3-031-05230-9_80
Jokić A, Petrović M, Miljković Z. Real-Time Mobile Robot Perception Based on Deep Learning Detection Model. in Lecture Notes in Networks and Systems. 2022;472:670-677.
doi:10.1007/978-3-031-05230-9_80 .
Jokić, Aleksandar, Petrović, Milica, Miljković, Zoran, "Real-Time Mobile Robot Perception Based on Deep Learning Detection Model" in Lecture Notes in Networks and Systems, 472 (2022):670-677,
https://doi.org/10.1007/978-3-031-05230-9_80 . .
1
1

AUTONOMNOST KRETANjA MOBILNOG ROBOTA -LETELICE ZA RAD NA VISINAMA – SPECIFIČNOSTI KONFIGURACIJE, MODELIRANjE, FUNKCIONALNA APROKSIMACIJA I MAŠINSKO UČENjE OJAČAVANjEM

Miljković, Zoran; Jevtić, Đorđe; Svorcan, Jelena

(Mašinski fakultet Univerziteta u Beogradu, 2021)

TY  - GEN
AU  - Miljković, Zoran
AU  - Jevtić, Đorđe
AU  - Svorcan, Jelena
PY  - 2021
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/6625
AB  - Roboti koji imaju mogućnost kretanja uz vertikalnu podlogu (engl. wall-climbing), a u koje spadaju i roboti namenjeni posebnim zadacima kao što je čišćenje gabaritnih staklenih površina eksterijera visokih zgrada (engl. glass and façade-cleaning), predstavljaju predmet brojnih istraživanja u prethodnih trideset godina. Interesovanja naučne i stručne zajednice u ovoj oblasti su posledica pre svega njihovog velikog potencijala za rešavanje mnogobrojnih izazova kao što su održavanje i inspekcija građevinskih konstrukcija, ispitivanja teško dostupnih ili veoma opasnih radnih mesta i dr. Iako je na ovom polju ostvaren vidan napredak poslednjih nekoliko godina, ova tehnologija i dalje poseduje određena ograničenja kao što su nemogućnost kontinualnog kretanja ovih robota po fizički odvojenim površinama visokih zgrada i nemogućnost kretanja po neravnim površinama. Male bespilotne letelice (MBL) predstavljaju aktuelni tip letelica poslednjih dvadeset godina, a koje mogu da se korisno upotrebe u širokom opsegu primena. Minijaturizacija i smanjenje troškova električnih komponenti doveli su do njihove komercijalizacije i masovne upotrebe u mnogim oblastima, kao što su gašenje požara, inspekcija, nadzor, farbanje, održavanje vetro-generatora i brodova. Najveću primenu u praksi pronašli su kvadkopteri, pre svega zbog činjenice da se pomoću četiri veličine, tj. upravljanjem brzinama obrta propelera, može ostvariti šest stepeni slobode pri kretanju. Prednosti ovih letelica su dobre manevarske sposobnosti i jednostavno upravljanje. Međutim, smanjenje njihovih dimenzija dovodi do smanjenja efikasnosti, kao i povećanja viskoznih efekata što je posledica malih Rejnoldsovih brojeva. Koncept predstavljen ovim predavanjem po pozivu podrazumeva sledeće prioritete: 1. Realizovati robotski sistem za čišćenje koji treba da omogući kvalitetno obavljanje ove namene. 2. Ostvariti bezbednu, pouzdanu i laku tranziciju. 3. Osmisliti sistem za prianjanje koji će omogućiti robotu potrebnu mobilnost u svim pravcima pri izrvšavanju zadatka na radnim površinama različitih oblika uz minimalni utrošak energije. 4. Obezbediti robotu mogućnost savladavanja prepreka malih dimenzija radi izbegavanja potrebe za čestom tranzicijom. 5. Ostvariti bezbednost u radu i u slučaju neplaniranog otkaza sistema za prianjanje. 6. Omogućiti bezbedno spuštanje robota na tlo usled otkaza nekog od motora namenjenih generisanju vučne sile. Zadatak koji se postavlja pred mobilni robot letelicu je učenje optimalne putanje od početnog položaja (predstavlja položaj robota u neposrednoj blizini objekta) do ciljnog položaja predstavlja položaj robota na radnoj površini. Određivanje ciljnog položaja se ostvaruje aktiviranjem kamere kao spoljašnjeg senzora koja uz pomoć metoda mašinskog gledanja omogućava mobilnom robotu letelici detektovanje staklenih površina, kao i izdvajanje karakterističnih objekata. Kako je u okviru navedenog problema nemoguće odrediti tačan matematički model kretanja mobilnog robota letelice, odnosno okruženja, uvodi se pojam mašinskog učenja ojačavanjem (engl. Reinforcement Learning). Dva osnovna činioca koncepta mašinskog učenja ojačavanjem predstavljaju inteligentni agent i okruženje. Inteligentni agent ima zadatak da istraživanjem okruženja pomoću eksternih senzora kao i eksploatacijom stečenog znanja generiše optimalno ponašanje u cilju izvršavanja postavljenog tehnološkog zadatka. Stanje sistema se može definisati kao skup komponenti nastalih kao rezultat akcija robota i/ili rezultat interakcije robot okruženje. Stanja mogu činiti sledeći elementi: položaj robota u okruženju u odnosu na izabrani referentni koordinatni sistem, njegova brzina kretanja, položaj i brzina kretanja pokretnih objekata u okruženju i sl. Nagradna oceana stanja (engl. Reward ) se definiše kao stepen uspešnosti odabrane akcije u prethodnom stanju sistema izražene u vidu numeričke vrednosti. Cilj agenta jeste da pronađe skup najpovoljnijih akcija u svim stanjima mobilnog robota letelice pri njenom kretanju od početnog do ciljnog položaja. Na osnovu informacija o trenutnom stanju sistema kao i trenutnom stepenu obučenosti, inteligentni agent treba da odabere akciju koja će ga dovesti u naredni položaj. Ovaj položaj predstavlja ulaz u upravljačku jedinicu za kontrolu položaja koja treba da odredi signale na ulazu u kontrolere rada električnih motora kako bi se generisale odgovarajuće vučne sile. Stanje sistema u razmatranom primeru predstavlja položaj mobilnog robota letelice u režimu lebdenja. Okruženje je sastavljeno od sfera jednakih prečnika, čiji su centri moguća stanja sistema. U konkretnom primeru razmatrani prostor je dimenzija 9000x6000x4000mm, i
PB  - Mašinski fakultet Univerziteta u Beogradu
T2  - 7. Kongres studenata tehnike - "TEHNOLOGIJE MODERNOG INŽENjERSTVA"
T1  - AUTONOMNOST KRETANjA MOBILNOG ROBOTA -LETELICE ZA RAD NA VISINAMA – SPECIFIČNOSTI KONFIGURACIJE, MODELIRANjE, FUNKCIONALNA APROKSIMACIJA I MAŠINSKO UČENjE OJAČAVANjEM
UR  - https://hdl.handle.net/21.15107/rcub_machinery_6625
ER  - 
@misc{
author = "Miljković, Zoran and Jevtić, Đorđe and Svorcan, Jelena",
year = "2021",
abstract = "Roboti koji imaju mogućnost kretanja uz vertikalnu podlogu (engl. wall-climbing), a u koje spadaju i roboti namenjeni posebnim zadacima kao što je čišćenje gabaritnih staklenih površina eksterijera visokih zgrada (engl. glass and façade-cleaning), predstavljaju predmet brojnih istraživanja u prethodnih trideset godina. Interesovanja naučne i stručne zajednice u ovoj oblasti su posledica pre svega njihovog velikog potencijala za rešavanje mnogobrojnih izazova kao što su održavanje i inspekcija građevinskih konstrukcija, ispitivanja teško dostupnih ili veoma opasnih radnih mesta i dr. Iako je na ovom polju ostvaren vidan napredak poslednjih nekoliko godina, ova tehnologija i dalje poseduje određena ograničenja kao što su nemogućnost kontinualnog kretanja ovih robota po fizički odvojenim površinama visokih zgrada i nemogućnost kretanja po neravnim površinama. Male bespilotne letelice (MBL) predstavljaju aktuelni tip letelica poslednjih dvadeset godina, a koje mogu da se korisno upotrebe u širokom opsegu primena. Minijaturizacija i smanjenje troškova električnih komponenti doveli su do njihove komercijalizacije i masovne upotrebe u mnogim oblastima, kao što su gašenje požara, inspekcija, nadzor, farbanje, održavanje vetro-generatora i brodova. Najveću primenu u praksi pronašli su kvadkopteri, pre svega zbog činjenice da se pomoću četiri veličine, tj. upravljanjem brzinama obrta propelera, može ostvariti šest stepeni slobode pri kretanju. Prednosti ovih letelica su dobre manevarske sposobnosti i jednostavno upravljanje. Međutim, smanjenje njihovih dimenzija dovodi do smanjenja efikasnosti, kao i povećanja viskoznih efekata što je posledica malih Rejnoldsovih brojeva. Koncept predstavljen ovim predavanjem po pozivu podrazumeva sledeće prioritete: 1. Realizovati robotski sistem za čišćenje koji treba da omogući kvalitetno obavljanje ove namene. 2. Ostvariti bezbednu, pouzdanu i laku tranziciju. 3. Osmisliti sistem za prianjanje koji će omogućiti robotu potrebnu mobilnost u svim pravcima pri izrvšavanju zadatka na radnim površinama različitih oblika uz minimalni utrošak energije. 4. Obezbediti robotu mogućnost savladavanja prepreka malih dimenzija radi izbegavanja potrebe za čestom tranzicijom. 5. Ostvariti bezbednost u radu i u slučaju neplaniranog otkaza sistema za prianjanje. 6. Omogućiti bezbedno spuštanje robota na tlo usled otkaza nekog od motora namenjenih generisanju vučne sile. Zadatak koji se postavlja pred mobilni robot letelicu je učenje optimalne putanje od početnog položaja (predstavlja položaj robota u neposrednoj blizini objekta) do ciljnog položaja predstavlja položaj robota na radnoj površini. Određivanje ciljnog položaja se ostvaruje aktiviranjem kamere kao spoljašnjeg senzora koja uz pomoć metoda mašinskog gledanja omogućava mobilnom robotu letelici detektovanje staklenih površina, kao i izdvajanje karakterističnih objekata. Kako je u okviru navedenog problema nemoguće odrediti tačan matematički model kretanja mobilnog robota letelice, odnosno okruženja, uvodi se pojam mašinskog učenja ojačavanjem (engl. Reinforcement Learning). Dva osnovna činioca koncepta mašinskog učenja ojačavanjem predstavljaju inteligentni agent i okruženje. Inteligentni agent ima zadatak da istraživanjem okruženja pomoću eksternih senzora kao i eksploatacijom stečenog znanja generiše optimalno ponašanje u cilju izvršavanja postavljenog tehnološkog zadatka. Stanje sistema se može definisati kao skup komponenti nastalih kao rezultat akcija robota i/ili rezultat interakcije robot okruženje. Stanja mogu činiti sledeći elementi: položaj robota u okruženju u odnosu na izabrani referentni koordinatni sistem, njegova brzina kretanja, položaj i brzina kretanja pokretnih objekata u okruženju i sl. Nagradna oceana stanja (engl. Reward ) se definiše kao stepen uspešnosti odabrane akcije u prethodnom stanju sistema izražene u vidu numeričke vrednosti. Cilj agenta jeste da pronađe skup najpovoljnijih akcija u svim stanjima mobilnog robota letelice pri njenom kretanju od početnog do ciljnog položaja. Na osnovu informacija o trenutnom stanju sistema kao i trenutnom stepenu obučenosti, inteligentni agent treba da odabere akciju koja će ga dovesti u naredni položaj. Ovaj položaj predstavlja ulaz u upravljačku jedinicu za kontrolu položaja koja treba da odredi signale na ulazu u kontrolere rada električnih motora kako bi se generisale odgovarajuće vučne sile. Stanje sistema u razmatranom primeru predstavlja položaj mobilnog robota letelice u režimu lebdenja. Okruženje je sastavljeno od sfera jednakih prečnika, čiji su centri moguća stanja sistema. U konkretnom primeru razmatrani prostor je dimenzija 9000x6000x4000mm, i",
publisher = "Mašinski fakultet Univerziteta u Beogradu",
journal = "7. Kongres studenata tehnike - "TEHNOLOGIJE MODERNOG INŽENjERSTVA"",
title = "AUTONOMNOST KRETANjA MOBILNOG ROBOTA -LETELICE ZA RAD NA VISINAMA – SPECIFIČNOSTI KONFIGURACIJE, MODELIRANjE, FUNKCIONALNA APROKSIMACIJA I MAŠINSKO UČENjE OJAČAVANjEM",
url = "https://hdl.handle.net/21.15107/rcub_machinery_6625"
}
Miljković, Z., Jevtić, Đ.,& Svorcan, J.. (2021). AUTONOMNOST KRETANjA MOBILNOG ROBOTA -LETELICE ZA RAD NA VISINAMA – SPECIFIČNOSTI KONFIGURACIJE, MODELIRANjE, FUNKCIONALNA APROKSIMACIJA I MAŠINSKO UČENjE OJAČAVANjEM. in 7. Kongres studenata tehnike - "TEHNOLOGIJE MODERNOG INŽENjERSTVA"
Mašinski fakultet Univerziteta u Beogradu..
https://hdl.handle.net/21.15107/rcub_machinery_6625
Miljković Z, Jevtić Đ, Svorcan J. AUTONOMNOST KRETANjA MOBILNOG ROBOTA -LETELICE ZA RAD NA VISINAMA – SPECIFIČNOSTI KONFIGURACIJE, MODELIRANjE, FUNKCIONALNA APROKSIMACIJA I MAŠINSKO UČENjE OJAČAVANjEM. in 7. Kongres studenata tehnike - "TEHNOLOGIJE MODERNOG INŽENjERSTVA". 2021;.
https://hdl.handle.net/21.15107/rcub_machinery_6625 .
Miljković, Zoran, Jevtić, Đorđe, Svorcan, Jelena, "AUTONOMNOST KRETANjA MOBILNOG ROBOTA -LETELICE ZA RAD NA VISINAMA – SPECIFIČNOSTI KONFIGURACIJE, MODELIRANjE, FUNKCIONALNA APROKSIMACIJA I MAŠINSKO UČENjE OJAČAVANjEM" in 7. Kongres studenata tehnike - "TEHNOLOGIJE MODERNOG INŽENjERSTVA" (2021),
https://hdl.handle.net/21.15107/rcub_machinery_6625 .

Технологија обраде резањем : приручник

Kalajdžić, Milisav; Tanović, Ljubodrag; Babić, Bojan; Glavonjić, Miloš; Miljković, Zoran; Puzović, Radovan; Kokotović, Branko; Popović, Mihajlo; Živanović, Saša; Tošić, Dragan; Vasić, Ivan

(Mašinski fakultet Univerziteta u Beogradu, 2021)

TY  - BOOK
AU  - Kalajdžić, Milisav
AU  - Tanović, Ljubodrag
AU  - Babić, Bojan
AU  - Glavonjić, Miloš
AU  - Miljković, Zoran
AU  - Puzović, Radovan
AU  - Kokotović, Branko
AU  - Popović, Mihajlo
AU  - Živanović, Saša
AU  - Tošić, Dragan
AU  - Vasić, Ivan
PY  - 2021
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/4436
AB  - Priručnik iz tehnologije obrade rezanjem namenjen je inženjerima, a posebno studentima kao pomoć pri izradi projektnih i ispitnih zadataka iz predmeta Tehnologija mašinogradnje nekada (do 2008. godine) i danas Tehnologija mašinske obrade, kao i iz drugih uže stručnih predmeta koje slušaju studenti proizvodnog mašinstva na osnovnim i master akademskim studijama Mašinskog fakulteta Univerziteta u Beogradu.
U prvom delu priručnika dat je formalizovan koncept za projektovanje i izbor tehnologije obrade rezanjem metala, koji je ilustrovan odgovarajućim primerima, dok drugi deo sadrži bogat sistem podataka, koji se odnose na:
(i) mašinske materijale i materijale reznih alata,
(ii) sistem kvaliteta i tačnost obrade,
(iii) obradne sisteme,
(iv) sistem podataka koji obuhvata režime obrade i
(v) sistem podataka, koji se odnosi na funkcije obradljivosti.
Ovaj priručnik, u pogledu svog sadržaja, predstavlja ravnotežu između klasičnog pristupa sa pokušajem da se svaki proces determiniše, i savremenog pristupa koji maksimizira izlaze i pojednostavljuje primenu. S druge strane, očekuje se da se znatno pojednostavi rešavanje određenih složenih inženjerskih problema, posebno prilikom projektovanja tehnoloških procesa obrade metala rezanjem.
PB  - Mašinski fakultet Univerziteta u Beogradu
T2  - UNIVERZITET U BEOGRADU - MAŠINSKI FAKULTET (COBISS.SR-ID - 48397833)
T1  - Технологија обраде резањем : приручник
T1  - CUTTING TECHNOLOGY: handbook
EP  - 453
IS  - IX izdanje
SP  - 1
UR  - https://hdl.handle.net/21.15107/rcub_machinery_4436
ER  - 
@book{
author = "Kalajdžić, Milisav and Tanović, Ljubodrag and Babić, Bojan and Glavonjić, Miloš and Miljković, Zoran and Puzović, Radovan and Kokotović, Branko and Popović, Mihajlo and Živanović, Saša and Tošić, Dragan and Vasić, Ivan",
year = "2021",
abstract = "Priručnik iz tehnologije obrade rezanjem namenjen je inženjerima, a posebno studentima kao pomoć pri izradi projektnih i ispitnih zadataka iz predmeta Tehnologija mašinogradnje nekada (do 2008. godine) i danas Tehnologija mašinske obrade, kao i iz drugih uže stručnih predmeta koje slušaju studenti proizvodnog mašinstva na osnovnim i master akademskim studijama Mašinskog fakulteta Univerziteta u Beogradu.
U prvom delu priručnika dat je formalizovan koncept za projektovanje i izbor tehnologije obrade rezanjem metala, koji je ilustrovan odgovarajućim primerima, dok drugi deo sadrži bogat sistem podataka, koji se odnose na:
(i) mašinske materijale i materijale reznih alata,
(ii) sistem kvaliteta i tačnost obrade,
(iii) obradne sisteme,
(iv) sistem podataka koji obuhvata režime obrade i
(v) sistem podataka, koji se odnosi na funkcije obradljivosti.
Ovaj priručnik, u pogledu svog sadržaja, predstavlja ravnotežu između klasičnog pristupa sa pokušajem da se svaki proces determiniše, i savremenog pristupa koji maksimizira izlaze i pojednostavljuje primenu. S druge strane, očekuje se da se znatno pojednostavi rešavanje određenih složenih inženjerskih problema, posebno prilikom projektovanja tehnoloških procesa obrade metala rezanjem.",
publisher = "Mašinski fakultet Univerziteta u Beogradu",
journal = "UNIVERZITET U BEOGRADU - MAŠINSKI FAKULTET (COBISS.SR-ID - 48397833)",
title = "Технологија обраде резањем : приручник, CUTTING TECHNOLOGY: handbook",
pages = "453-1",
number = "IX izdanje",
url = "https://hdl.handle.net/21.15107/rcub_machinery_4436"
}
Kalajdžić, M., Tanović, L., Babić, B., Glavonjić, M., Miljković, Z., Puzović, R., Kokotović, B., Popović, M., Živanović, S., Tošić, D.,& Vasić, I.. (2021). Технологија обраде резањем : приручник. in UNIVERZITET U BEOGRADU - MAŠINSKI FAKULTET (COBISS.SR-ID - 48397833)
Mašinski fakultet Univerziteta u Beogradu.(IX izdanje), 1-453.
https://hdl.handle.net/21.15107/rcub_machinery_4436
Kalajdžić M, Tanović L, Babić B, Glavonjić M, Miljković Z, Puzović R, Kokotović B, Popović M, Živanović S, Tošić D, Vasić I. Технологија обраде резањем : приручник. in UNIVERZITET U BEOGRADU - MAŠINSKI FAKULTET (COBISS.SR-ID - 48397833). 2021;(IX izdanje):1-453.
https://hdl.handle.net/21.15107/rcub_machinery_4436 .
Kalajdžić, Milisav, Tanović, Ljubodrag, Babić, Bojan, Glavonjić, Miloš, Miljković, Zoran, Puzović, Radovan, Kokotović, Branko, Popović, Mihajlo, Živanović, Saša, Tošić, Dragan, Vasić, Ivan, "Технологија обраде резањем : приручник" in UNIVERZITET U BEOGRADU - MAŠINSKI FAKULTET (COBISS.SR-ID - 48397833), no. IX izdanje (2021):1-453,
https://hdl.handle.net/21.15107/rcub_machinery_4436 .

VEŠTAČKA INTELIGENCIJA U FUNKCIJI RAZVOJA AUTONOMNIH SISTEMA

Miljković, Zoran

(PEP - Akademija za avijaciju, 2021)

TY  - GEN
AU  - Miljković, Zoran
PY  - 2021
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/6642
AB  - Ovo predavanje po pozivu, imalo je za cilj da se polaznicima PEP - Akademije za avijaciju otvore mogućnosti za sticanje elementarnih sposobnosti u funkciji korišćenja autonomnih sistema u vazduhoplovstvu, i to putem sticanja osnovnih spoznaja u domenu koncepcijskog projektovanja i evolutivnosti ovakvih savremenih sistema, a u skladu sa polaznim paradigmama veštačke inteligencije. Upoznavanjem strukture autonomnih sistema, poput danas aktuelne upotrebe letelica - dronova, zasnovanih na metodološkom pristupu koji obuhvata njihovu osnovnu mehaniku, senzorske i aktuatorske podsisteme, upravljanje i optimizaciju kretanja, kao i hardversko-softversku integraciju, uz korišćenje 3D simulacije primenom specijalizovanih softverskih alata, ovladali su neophodnim elementarnim znanjima i veštinama, prevashodno potrebnim za primenu ovih novih tehnologija u vazduhoplovstvu, a sadržanih u predočenim aktivnostima za implementaciju četvrte industrijske revolucije.
PB  - PEP - Akademija za avijaciju
T2  - PEP - Akademija za avijaciju
T1  - VEŠTAČKA INTELIGENCIJA U FUNKCIJI RAZVOJA AUTONOMNIH SISTEMA
UR  - https://hdl.handle.net/21.15107/rcub_machinery_6642
ER  - 
@misc{
author = "Miljković, Zoran",
year = "2021",
abstract = "Ovo predavanje po pozivu, imalo je za cilj da se polaznicima PEP - Akademije za avijaciju otvore mogućnosti za sticanje elementarnih sposobnosti u funkciji korišćenja autonomnih sistema u vazduhoplovstvu, i to putem sticanja osnovnih spoznaja u domenu koncepcijskog projektovanja i evolutivnosti ovakvih savremenih sistema, a u skladu sa polaznim paradigmama veštačke inteligencije. Upoznavanjem strukture autonomnih sistema, poput danas aktuelne upotrebe letelica - dronova, zasnovanih na metodološkom pristupu koji obuhvata njihovu osnovnu mehaniku, senzorske i aktuatorske podsisteme, upravljanje i optimizaciju kretanja, kao i hardversko-softversku integraciju, uz korišćenje 3D simulacije primenom specijalizovanih softverskih alata, ovladali su neophodnim elementarnim znanjima i veštinama, prevashodno potrebnim za primenu ovih novih tehnologija u vazduhoplovstvu, a sadržanih u predočenim aktivnostima za implementaciju četvrte industrijske revolucije.",
publisher = "PEP - Akademija za avijaciju",
journal = "PEP - Akademija za avijaciju",
title = "VEŠTAČKA INTELIGENCIJA U FUNKCIJI RAZVOJA AUTONOMNIH SISTEMA",
url = "https://hdl.handle.net/21.15107/rcub_machinery_6642"
}
Miljković, Z.. (2021). VEŠTAČKA INTELIGENCIJA U FUNKCIJI RAZVOJA AUTONOMNIH SISTEMA. in PEP - Akademija za avijaciju
PEP - Akademija za avijaciju..
https://hdl.handle.net/21.15107/rcub_machinery_6642
Miljković Z. VEŠTAČKA INTELIGENCIJA U FUNKCIJI RAZVOJA AUTONOMNIH SISTEMA. in PEP - Akademija za avijaciju. 2021;.
https://hdl.handle.net/21.15107/rcub_machinery_6642 .
Miljković, Zoran, "VEŠTAČKA INTELIGENCIJA U FUNKCIJI RAZVOJA AUTONOMNIH SISTEMA" in PEP - Akademija za avijaciju (2021),
https://hdl.handle.net/21.15107/rcub_machinery_6642 .

Deep learning of mobile service robots

Petrović, Milica; Jokić, Aleksandar; Kulesza, Z.; Miljković, Zoran

(Nova Science Publishers, Inc., 2021)

TY  - CHAP
AU  - Petrović, Milica
AU  - Jokić, Aleksandar
AU  - Kulesza, Z.
AU  - Miljković, Zoran
PY  - 2021
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/3661
AB  - In the last two decades, the development of state -of-the-art artificial intelligence (AI) models has significantly increased the utilization of commercial and task-specific robots in the service domain. The additional level of intelligence introduced by AI models has enabled service robots to coexist within different human environments and collaborate with end-users. One of the most promising AI techniques, Deep Learning (DL), can provide service robots with a wide range of abilities, such as detecting human pose and emotions, understanding natural languages, as well as scene understanding. Achieved abilities can enable mobile service robots to execute specific tasks in real and stochastic environments. Having that in mind, in this chapter, we provide an in-depth analysis of the tasks that are best-suited for DL within the service robots domain. Moreover, the study of the state-of-the-art DL models for object detection, semantic segmentation, and human pose estimation is carried out. In the end, the authors presented a thorough examination of the training process and analysis of the results for one of the most promising convolutional neural network models (DeepLabv3+) used for semantic segmentation.
PB  - Nova Science Publishers, Inc.
T2  - Service Robots: Advances in Research and Applications
T1  - Deep learning of mobile service robots
EP  - 97
SP  - 77
UR  - https://hdl.handle.net/21.15107/rcub_machinery_3661
ER  - 
@inbook{
author = "Petrović, Milica and Jokić, Aleksandar and Kulesza, Z. and Miljković, Zoran",
year = "2021",
abstract = "In the last two decades, the development of state -of-the-art artificial intelligence (AI) models has significantly increased the utilization of commercial and task-specific robots in the service domain. The additional level of intelligence introduced by AI models has enabled service robots to coexist within different human environments and collaborate with end-users. One of the most promising AI techniques, Deep Learning (DL), can provide service robots with a wide range of abilities, such as detecting human pose and emotions, understanding natural languages, as well as scene understanding. Achieved abilities can enable mobile service robots to execute specific tasks in real and stochastic environments. Having that in mind, in this chapter, we provide an in-depth analysis of the tasks that are best-suited for DL within the service robots domain. Moreover, the study of the state-of-the-art DL models for object detection, semantic segmentation, and human pose estimation is carried out. In the end, the authors presented a thorough examination of the training process and analysis of the results for one of the most promising convolutional neural network models (DeepLabv3+) used for semantic segmentation.",
publisher = "Nova Science Publishers, Inc.",
journal = "Service Robots: Advances in Research and Applications",
booktitle = "Deep learning of mobile service robots",
pages = "97-77",
url = "https://hdl.handle.net/21.15107/rcub_machinery_3661"
}
Petrović, M., Jokić, A., Kulesza, Z.,& Miljković, Z.. (2021). Deep learning of mobile service robots. in Service Robots: Advances in Research and Applications
Nova Science Publishers, Inc.., 77-97.
https://hdl.handle.net/21.15107/rcub_machinery_3661
Petrović M, Jokić A, Kulesza Z, Miljković Z. Deep learning of mobile service robots. in Service Robots: Advances in Research and Applications. 2021;:77-97.
https://hdl.handle.net/21.15107/rcub_machinery_3661 .
Petrović, Milica, Jokić, Aleksandar, Kulesza, Z., Miljković, Zoran, "Deep learning of mobile service robots" in Service Robots: Advances in Research and Applications (2021):77-97,
https://hdl.handle.net/21.15107/rcub_machinery_3661 .
1

Reinforcement Learning Approach for Autonomous UAV Navigation in 3D Space

Miljković, Zoran; Jevtić, Đorđe; Svorcan, Jelena

(Novi Sad : Faculty of Technical Sciences, 2021)

TY  - CONF
AU  - Miljković, Zoran
AU  - Jevtić, Đorđe
AU  - Svorcan, Jelena
PY  - 2021
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/4625
AB  - In the last two decades, the rapid development of unmanned aerial vehicles (UAVs) resulted in their usage for a wide range of applications. Miniaturization and cost reduction of electrical components have led to their commercialization, and today they can be utilized for various tasks in an unknown environment. Finding the optimal path based on the start and target pose information is one of the most complex demands for any intelligent UAV system. As this problem requires a high level of adaptability and learning capability of the UAV, the framework based
on reinforcement learning is proposed for the localization and navigation tasks. In this paper, Q-learning algorithm for the autonomous navigation of the UAV in 3D space is implemented. To test the proposed methodology for UAV intelligent control, the simulation is conducted in ROS-Gazebo environment. The obtained simulation results have shown that the UAV can reach the target pose autonomously in an efficient way.
PB  - Novi Sad : Faculty of Technical Sciences
C3  - Proceedings of the 14th International Scientific Conference MMA 2021 – Flexible Technologies, Novi Sad, September 23-25, 2021
T1  - Reinforcement Learning Approach for Autonomous UAV Navigation in 3D Space
EP  - 192
SP  - 189
SP  - 
UR  - https://hdl.handle.net/21.15107/rcub_machinery_4625
ER  - 
@conference{
author = "Miljković, Zoran and Jevtić, Đorđe and Svorcan, Jelena",
year = "2021",
abstract = "In the last two decades, the rapid development of unmanned aerial vehicles (UAVs) resulted in their usage for a wide range of applications. Miniaturization and cost reduction of electrical components have led to their commercialization, and today they can be utilized for various tasks in an unknown environment. Finding the optimal path based on the start and target pose information is one of the most complex demands for any intelligent UAV system. As this problem requires a high level of adaptability and learning capability of the UAV, the framework based
on reinforcement learning is proposed for the localization and navigation tasks. In this paper, Q-learning algorithm for the autonomous navigation of the UAV in 3D space is implemented. To test the proposed methodology for UAV intelligent control, the simulation is conducted in ROS-Gazebo environment. The obtained simulation results have shown that the UAV can reach the target pose autonomously in an efficient way.",
publisher = "Novi Sad : Faculty of Technical Sciences",
journal = "Proceedings of the 14th International Scientific Conference MMA 2021 – Flexible Technologies, Novi Sad, September 23-25, 2021",
title = "Reinforcement Learning Approach for Autonomous UAV Navigation in 3D Space",
pages = "192-189-",
url = "https://hdl.handle.net/21.15107/rcub_machinery_4625"
}
Miljković, Z., Jevtić, Đ.,& Svorcan, J.. (2021). Reinforcement Learning Approach for Autonomous UAV Navigation in 3D Space. in Proceedings of the 14th International Scientific Conference MMA 2021 – Flexible Technologies, Novi Sad, September 23-25, 2021
Novi Sad : Faculty of Technical Sciences., 189-192.
https://hdl.handle.net/21.15107/rcub_machinery_4625
Miljković Z, Jevtić Đ, Svorcan J. Reinforcement Learning Approach for Autonomous UAV Navigation in 3D Space. in Proceedings of the 14th International Scientific Conference MMA 2021 – Flexible Technologies, Novi Sad, September 23-25, 2021. 2021;:189-192.
https://hdl.handle.net/21.15107/rcub_machinery_4625 .
Miljković, Zoran, Jevtić, Đorđe, Svorcan, Jelena, "Reinforcement Learning Approach for Autonomous UAV Navigation in 3D Space" in Proceedings of the 14th International Scientific Conference MMA 2021 – Flexible Technologies, Novi Sad, September 23-25, 2021 (2021):189-192,
https://hdl.handle.net/21.15107/rcub_machinery_4625 .

Application of convolutional neural networks for visual control of intelligent robotic systems

Miljković, Zoran; Đokić, Lazar; Petrović, Milica

(De Gruyter, © 2022 Walter de Gruyter GmbH, Berlin/Boston, 2021)

TY  - CHAP
AU  - Miljković, Zoran
AU  - Đokić, Lazar
AU  - Petrović, Milica
PY  - 2021
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/3961
AB  - Intelligent mobile robots are foreseen as one of the possible solutions to efficiently
performing transportation and manipulation tasks in intelligent manufacturing
systems (IMS) of Industry 4.0. In the last few decades, deep learning models have been
recognized as a promising technique to enable the intelligent behavior of mobile robots
for performing such tasks. For the particular problems of object detection and classification,
a class of deep learning models, namely Convolutional Neural Networks (CNN),
is the most widely used. This chapter presents an application of Region-based
CNN (R-CNN) for advanced object identification tasks by using transfer learning.
The proposed learning approach is further used for the improvement of Image-
Based Visual Servoing (IBVS) algorithm used to control an intelligent mobile robot.
The proposed algorithms are implemented in the MATLAB software package, and
both simulation and the experimental verification of the proposed concept are performed
on intelligent mobile robot, DOMINO (Deep learning Omnidirectional Mobile
robot with INtelligent cOntrol). Four different CNN models are trained for object detection
and classification, and the most suitable CNN model is ResNet-18, with the
best recorded mean Average Precision (mAP) of 77%. Achieved experimental results
show the applicability of CNN for accurate detection and classification of different
manufacturing entities and the IBVS algorithm for efficient mobile robot control
within IMS.
PB  - De Gruyter, © 2022 Walter de Gruyter GmbH, Berlin/Boston
T2  - Soft Computing in Smart Manufacturing - Solutions toward Industry 5.0
T1  - Application of convolutional neural networks for visual control of intelligent robotic systems
SP  - 83/3
DO  - 10.1515/9783110693225-003
ER  - 
@inbook{
author = "Miljković, Zoran and Đokić, Lazar and Petrović, Milica",
year = "2021",
abstract = "Intelligent mobile robots are foreseen as one of the possible solutions to efficiently
performing transportation and manipulation tasks in intelligent manufacturing
systems (IMS) of Industry 4.0. In the last few decades, deep learning models have been
recognized as a promising technique to enable the intelligent behavior of mobile robots
for performing such tasks. For the particular problems of object detection and classification,
a class of deep learning models, namely Convolutional Neural Networks (CNN),
is the most widely used. This chapter presents an application of Region-based
CNN (R-CNN) for advanced object identification tasks by using transfer learning.
The proposed learning approach is further used for the improvement of Image-
Based Visual Servoing (IBVS) algorithm used to control an intelligent mobile robot.
The proposed algorithms are implemented in the MATLAB software package, and
both simulation and the experimental verification of the proposed concept are performed
on intelligent mobile robot, DOMINO (Deep learning Omnidirectional Mobile
robot with INtelligent cOntrol). Four different CNN models are trained for object detection
and classification, and the most suitable CNN model is ResNet-18, with the
best recorded mean Average Precision (mAP) of 77%. Achieved experimental results
show the applicability of CNN for accurate detection and classification of different
manufacturing entities and the IBVS algorithm for efficient mobile robot control
within IMS.",
publisher = "De Gruyter, © 2022 Walter de Gruyter GmbH, Berlin/Boston",
journal = "Soft Computing in Smart Manufacturing - Solutions toward Industry 5.0",
booktitle = "Application of convolutional neural networks for visual control of intelligent robotic systems",
pages = "83/3",
doi = "10.1515/9783110693225-003"
}
Miljković, Z., Đokić, L.,& Petrović, M.. (2021). Application of convolutional neural networks for visual control of intelligent robotic systems. in Soft Computing in Smart Manufacturing - Solutions toward Industry 5.0
De Gruyter, © 2022 Walter de Gruyter GmbH, Berlin/Boston., 83/3.
https://doi.org/10.1515/9783110693225-003
Miljković Z, Đokić L, Petrović M. Application of convolutional neural networks for visual control of intelligent robotic systems. in Soft Computing in Smart Manufacturing - Solutions toward Industry 5.0. 2021;:83/3.
doi:10.1515/9783110693225-003 .
Miljković, Zoran, Đokić, Lazar, Petrović, Milica, "Application of convolutional neural networks for visual control of intelligent robotic systems" in Soft Computing in Smart Manufacturing - Solutions toward Industry 5.0 (2021):83/3,
https://doi.org/10.1515/9783110693225-003 . .

Image Registration Algorithm for Deep Learning-Based Stereo Visual Control of Mobile Robots

Miljković, Zoran; Jokić, Aleksandar; Petrović, Milica

(Springer Science and Business Media Deutschland GmbH, 2021)

TY  - CHAP
AU  - Miljković, Zoran
AU  - Jokić, Aleksandar
AU  - Petrović, Milica
PY  - 2021
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/3646
AB  - Since the emergence of deep learning as a dominant technique for numerous tasks in the computer vision domain, the robotics community has strived to utilize its potential. Deep learning represents a framework capable of learning the most complex models necessary to carry out various robotic tasks. We propose to integrate deep learning and one of the fundamental robotic algorithms—visual servoing. Fully convolutional neural networks are used for semantic segmentation, which represents the process of labeling every pixel within the image. The obtained information from labeled (categorical) images can be crucial for mobile robot control in dynamic environments. To adequately utilize semantic segmentation for mobile robot control, the segmented images acquired at the desired and the current pose need to be registered (aligned). Since the accuracy of visual servoing depends on the accuracy of the image registration process, we propose to increase the accuracy of mobile robot positioning by analyzing three different optimization algorithms devoted to the registration of categorical images. The standard gradient descent algorithm is compared to the OnePlusOneEvolutionary algorithm, and simulated annealing. Moreover, different cost functions such as Mattes mutual information, global accuracy, and mean intersection over union are also investigated. All the algorithms are tested on our own wheeled mobile robot RAICO (Robot with Artificial Intelligence based COgnition) developed within the Laboratory for robotics and artificial intelligence. The results indicate that the algorithm with a larger exploration to exploitation ratio provides better results. Moreover, the cost function with the steepest convex domain is more advantageous.
PB  - Springer Science and Business Media Deutschland GmbH
T2  - Studies in Computational Intelligence
T1  - Image Registration Algorithm for Deep Learning-Based Stereo Visual Control of Mobile Robots
EP  - 479
SP  - 447
VL  - 984
DO  - 10.1007/978-3-030-77939-9_13
ER  - 
@inbook{
author = "Miljković, Zoran and Jokić, Aleksandar and Petrović, Milica",
year = "2021",
abstract = "Since the emergence of deep learning as a dominant technique for numerous tasks in the computer vision domain, the robotics community has strived to utilize its potential. Deep learning represents a framework capable of learning the most complex models necessary to carry out various robotic tasks. We propose to integrate deep learning and one of the fundamental robotic algorithms—visual servoing. Fully convolutional neural networks are used for semantic segmentation, which represents the process of labeling every pixel within the image. The obtained information from labeled (categorical) images can be crucial for mobile robot control in dynamic environments. To adequately utilize semantic segmentation for mobile robot control, the segmented images acquired at the desired and the current pose need to be registered (aligned). Since the accuracy of visual servoing depends on the accuracy of the image registration process, we propose to increase the accuracy of mobile robot positioning by analyzing three different optimization algorithms devoted to the registration of categorical images. The standard gradient descent algorithm is compared to the OnePlusOneEvolutionary algorithm, and simulated annealing. Moreover, different cost functions such as Mattes mutual information, global accuracy, and mean intersection over union are also investigated. All the algorithms are tested on our own wheeled mobile robot RAICO (Robot with Artificial Intelligence based COgnition) developed within the Laboratory for robotics and artificial intelligence. The results indicate that the algorithm with a larger exploration to exploitation ratio provides better results. Moreover, the cost function with the steepest convex domain is more advantageous.",
publisher = "Springer Science and Business Media Deutschland GmbH",
journal = "Studies in Computational Intelligence",
booktitle = "Image Registration Algorithm for Deep Learning-Based Stereo Visual Control of Mobile Robots",
pages = "479-447",
volume = "984",
doi = "10.1007/978-3-030-77939-9_13"
}
Miljković, Z., Jokić, A.,& Petrović, M.. (2021). Image Registration Algorithm for Deep Learning-Based Stereo Visual Control of Mobile Robots. in Studies in Computational Intelligence
Springer Science and Business Media Deutschland GmbH., 984, 447-479.
https://doi.org/10.1007/978-3-030-77939-9_13
Miljković Z, Jokić A, Petrović M. Image Registration Algorithm for Deep Learning-Based Stereo Visual Control of Mobile Robots. in Studies in Computational Intelligence. 2021;984:447-479.
doi:10.1007/978-3-030-77939-9_13 .
Miljković, Zoran, Jokić, Aleksandar, Petrović, Milica, "Image Registration Algorithm for Deep Learning-Based Stereo Visual Control of Mobile Robots" in Studies in Computational Intelligence, 984 (2021):447-479,
https://doi.org/10.1007/978-3-030-77939-9_13 . .

ИНТЕЛИГЕНТНИ ТЕХНОЛОШКИ СИСТЕМИ - са изводима из роботике и вештачке интелигенције

Miljković, Zoran; Petrović, Milica

(Mašinski fakultet Univerziteta u Beogradu, 2021)

TY  - BOOK
AU  - Miljković, Zoran
AU  - Petrović, Milica
PY  - 2021
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/4437
AB  - Овај основни уџбеник обухвата вишедеценијска искуства аутора остварена како кроз реализацију докторских дисертација, магистарских и мастер теза, као и при реализацији активности научно-истраживачких пројеката у домену развоја интелигентних технолошких система, тако и током образовног процеса и рада са бројним студентима на обавезним
предметима мастер академских студија Катедре за производно машинство под називом Интелигентни технолошки системи, Индустријски роботи и Методе одлучивања, а од 2020. године и на новоуспостављеном Студијском програму мастер академских студија Индустрија 4.0, у оквиру обавезних предмета Роботика и вештачка интелигенција, Машинско учење интелигентних роботских система и изборног предмета Терминирање технолошких система и процеса.
У овом капиталном уџбенику, поред детаљно обрађених наставних целина и брижљиво одабраних примера за набројане предмете, дате су и одговарајуће корисне дискусије аутора у домену производно оријентисаних напредних технологија, роботике и вештачке интелигенције, као и биолошки инспирисаних алгоритама оптимизације.
 Аутори очекују да, осим студентима, ова књига може корисно послужити мастер, односно дипломираним машинским инжењерима, а посебно докторандима који се баве истраживањем, развојем и увођењем интелигентних технолошких система и концепта Индустрија 4.0 у савремене производно оријентисане тзв. дигиталне фабрике.
PB  - Mašinski fakultet Univerziteta u Beogradu
T1  - ИНТЕЛИГЕНТНИ ТЕХНОЛОШКИ СИСТЕМИ - са изводима из роботике и вештачке интелигенције
T1  - INTELLIGENT MANUFACTURING SYSTEMS – with robotics and artificial intelligence backgrounds
EP  - 409
IS  - I izdanje
SP  - 1
UR  - https://hdl.handle.net/21.15107/rcub_machinery_4437
ER  - 
@book{
author = "Miljković, Zoran and Petrović, Milica",
year = "2021",
abstract = "Овај основни уџбеник обухвата вишедеценијска искуства аутора остварена како кроз реализацију докторских дисертација, магистарских и мастер теза, као и при реализацији активности научно-истраживачких пројеката у домену развоја интелигентних технолошких система, тако и током образовног процеса и рада са бројним студентима на обавезним
предметима мастер академских студија Катедре за производно машинство под називом Интелигентни технолошки системи, Индустријски роботи и Методе одлучивања, а од 2020. године и на новоуспостављеном Студијском програму мастер академских студија Индустрија 4.0, у оквиру обавезних предмета Роботика и вештачка интелигенција, Машинско учење интелигентних роботских система и изборног предмета Терминирање технолошких система и процеса.
У овом капиталном уџбенику, поред детаљно обрађених наставних целина и брижљиво одабраних примера за набројане предмете, дате су и одговарајуће корисне дискусије аутора у домену производно оријентисаних напредних технологија, роботике и вештачке интелигенције, као и биолошки инспирисаних алгоритама оптимизације.
 Аутори очекују да, осим студентима, ова књига може корисно послужити мастер, односно дипломираним машинским инжењерима, а посебно докторандима који се баве истраживањем, развојем и увођењем интелигентних технолошких система и концепта Индустрија 4.0 у савремене производно оријентисане тзв. дигиталне фабрике.",
publisher = "Mašinski fakultet Univerziteta u Beogradu",
title = "ИНТЕЛИГЕНТНИ ТЕХНОЛОШКИ СИСТЕМИ - са изводима из роботике и вештачке интелигенције, INTELLIGENT MANUFACTURING SYSTEMS – with robotics and artificial intelligence backgrounds",
pages = "409-1",
number = "I izdanje",
url = "https://hdl.handle.net/21.15107/rcub_machinery_4437"
}
Miljković, Z.,& Petrović, M.. (2021). ИНТЕЛИГЕНТНИ ТЕХНОЛОШКИ СИСТЕМИ - са изводима из роботике и вештачке интелигенције. 
Mašinski fakultet Univerziteta u Beogradu.(I izdanje), 1-409.
https://hdl.handle.net/21.15107/rcub_machinery_4437
Miljković Z, Petrović M. ИНТЕЛИГЕНТНИ ТЕХНОЛОШКИ СИСТЕМИ - са изводима из роботике и вештачке интелигенције. 2021;(I izdanje):1-409.
https://hdl.handle.net/21.15107/rcub_machinery_4437 .
Miljković, Zoran, Petrović, Milica, "ИНТЕЛИГЕНТНИ ТЕХНОЛОШКИ СИСТЕМИ - са изводима из роботике и вештачке интелигенције", no. I izdanje (2021):1-409,
https://hdl.handle.net/21.15107/rcub_machinery_4437 .

Object Detection and Tracking in Cooperative Multi-Robot Transportation

Miljković, Zoran; Đokić, Lazar; Petrović, Milica

(University of Kragujevac, Faculty of Technical Sciences Čačak, 2021)

TY  - CONF
AU  - Miljković, Zoran
AU  - Đokić, Lazar
AU  - Petrović, Milica
PY  - 2021
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/4471
AB  - Contemporary manufacturing systems imply the utilization of autonomous robotic systems, mainly for the execution of manipulation and transportation tasks. With a goal to reduce transportation and manipulation time, improve efficiency, and achieve flexibility of intelligent manufacturing systems, two or more intelligent mobile robots can be exploited. Such multi-robot systems require coordination and some level of communication between heterogeneous or homogeneous robotic systems. In this paper, we propose the utilization of two heterogeneous robotic systems, original intelligent mobile robots RAICO (Robot with Artificial Intelligence based COgnition) and DOMINO (Deep learning-based Omnidirectional Mobile robot with Intelligent cOntrol), for transportation tasks within a laboratory model of a manufacturing environment. In order to reach an adequate cooperation level and avoid collision while moving along predefined paths, our own developed intelligent mobile robots RAICO and DOMINO will communicate their current poses, and object detection and tracking system is developed. A stereo vision system equipped with two parallelly placed industrial-grade cameras is used for image acquisition, while convolutional neural networks are utilized for object detection, classification, and tracking. The proposed object detection and tracking system enables real-time tracking of another mobile robot within the same manufacturing environment. Furthermore, continuous information about mobile robot poses and the size of the bounding box generated by the convolutional neural network in the process of detection of another mobile robot is used for estimation of object movement and collision avoidance. Mobile robot localization through time is performed based on kinematic models of two intelligent mobile robots, and conducted experiments within a laboratory model of manufacturing environment confirm the applicability of the proposed framework for object detection and collision avoidance.
PB  - University of Kragujevac, Faculty of Technical Sciences Čačak
C3  - Proceedings of the 38th International Conference on Production Engineering - ICPE-S 2021, 14 – 15. October 2021, Čačak, Serbia
T1  - Object Detection and Tracking in Cooperative Multi-Robot Transportation
EP  - 143
SP  - 137
UR  - https://hdl.handle.net/21.15107/rcub_machinery_4471
ER  - 
@conference{
author = "Miljković, Zoran and Đokić, Lazar and Petrović, Milica",
year = "2021",
abstract = "Contemporary manufacturing systems imply the utilization of autonomous robotic systems, mainly for the execution of manipulation and transportation tasks. With a goal to reduce transportation and manipulation time, improve efficiency, and achieve flexibility of intelligent manufacturing systems, two or more intelligent mobile robots can be exploited. Such multi-robot systems require coordination and some level of communication between heterogeneous or homogeneous robotic systems. In this paper, we propose the utilization of two heterogeneous robotic systems, original intelligent mobile robots RAICO (Robot with Artificial Intelligence based COgnition) and DOMINO (Deep learning-based Omnidirectional Mobile robot with Intelligent cOntrol), for transportation tasks within a laboratory model of a manufacturing environment. In order to reach an adequate cooperation level and avoid collision while moving along predefined paths, our own developed intelligent mobile robots RAICO and DOMINO will communicate their current poses, and object detection and tracking system is developed. A stereo vision system equipped with two parallelly placed industrial-grade cameras is used for image acquisition, while convolutional neural networks are utilized for object detection, classification, and tracking. The proposed object detection and tracking system enables real-time tracking of another mobile robot within the same manufacturing environment. Furthermore, continuous information about mobile robot poses and the size of the bounding box generated by the convolutional neural network in the process of detection of another mobile robot is used for estimation of object movement and collision avoidance. Mobile robot localization through time is performed based on kinematic models of two intelligent mobile robots, and conducted experiments within a laboratory model of manufacturing environment confirm the applicability of the proposed framework for object detection and collision avoidance.",
publisher = "University of Kragujevac, Faculty of Technical Sciences Čačak",
journal = "Proceedings of the 38th International Conference on Production Engineering - ICPE-S 2021, 14 – 15. October 2021, Čačak, Serbia",
title = "Object Detection and Tracking in Cooperative Multi-Robot Transportation",
pages = "143-137",
url = "https://hdl.handle.net/21.15107/rcub_machinery_4471"
}
Miljković, Z., Đokić, L.,& Petrović, M.. (2021). Object Detection and Tracking in Cooperative Multi-Robot Transportation. in Proceedings of the 38th International Conference on Production Engineering - ICPE-S 2021, 14 – 15. October 2021, Čačak, Serbia
University of Kragujevac, Faculty of Technical Sciences Čačak., 137-143.
https://hdl.handle.net/21.15107/rcub_machinery_4471
Miljković Z, Đokić L, Petrović M. Object Detection and Tracking in Cooperative Multi-Robot Transportation. in Proceedings of the 38th International Conference on Production Engineering - ICPE-S 2021, 14 – 15. October 2021, Čačak, Serbia. 2021;:137-143.
https://hdl.handle.net/21.15107/rcub_machinery_4471 .
Miljković, Zoran, Đokić, Lazar, Petrović, Milica, "Object Detection and Tracking in Cooperative Multi-Robot Transportation" in Proceedings of the 38th International Conference on Production Engineering - ICPE-S 2021, 14 – 15. October 2021, Čačak, Serbia (2021):137-143,
https://hdl.handle.net/21.15107/rcub_machinery_4471 .

A Mobile Robot Visual Perception System based on Deep Learning Approach

Jokić, Aleksandar; Đokić, Lazar; Petrović, Milica; Miljković, Zoran

(Belgrade : Društvo za ETRAN, 2021)

TY  - CONF
AU  - Jokić, Aleksandar
AU  - Đokić, Lazar
AU  - Petrović, Milica
AU  - Miljković, Zoran
PY  - 2021
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/4233
AB  - In this paper, we present the novel mobile robot
perception system based on a deep learning framework. The
hardware subsystem consists of an Nvidia Jetson Nano
development board integrated with two parallelly positioned
Basler daA1600-60uc cameras, while the software subsystem is
based on the convolutional neural networks utilized for semantic
segmentation of the environment scene. A Fully Convolutional
neural Network (FCN) based on the ResNet18 backbone
architecture is utilized to provide accurate information about
machine tool models and background position in the image. FCN
model is trained on our custom-developed dataset of a laboratory
model of manufacturing environment and implemented on
mobile robot RAICO (Robot with Artificial Intelligence based
COgnition).
PB  - Belgrade : Društvo za ETRAN
PB  - Beograd : Akademska misao
C3  - Зборник радова ‐ 65. Конференција за електронику, телекомуникације, рачунарство, аутоматику и нуклеарну технику, Етно село Станишићи, 08‐10.09.2021. године / Proceedings of Papers – 8th International Conference on Electrical, Electronic and Computing Engineering, IcETRAN 2021, Ethno willage Stanišići, Republic of Srpska, Bosnia and Herzegovina, 2021
T1  - A Mobile Robot Visual Perception System based on Deep Learning Approach
EP  - 572
SP  - 568
UR  - https://hdl.handle.net/21.15107/rcub_machinery_4233
ER  - 
@conference{
author = "Jokić, Aleksandar and Đokić, Lazar and Petrović, Milica and Miljković, Zoran",
year = "2021",
abstract = "In this paper, we present the novel mobile robot
perception system based on a deep learning framework. The
hardware subsystem consists of an Nvidia Jetson Nano
development board integrated with two parallelly positioned
Basler daA1600-60uc cameras, while the software subsystem is
based on the convolutional neural networks utilized for semantic
segmentation of the environment scene. A Fully Convolutional
neural Network (FCN) based on the ResNet18 backbone
architecture is utilized to provide accurate information about
machine tool models and background position in the image. FCN
model is trained on our custom-developed dataset of a laboratory
model of manufacturing environment and implemented on
mobile robot RAICO (Robot with Artificial Intelligence based
COgnition).",
publisher = "Belgrade : Društvo za ETRAN, Beograd : Akademska misao",
journal = "Зборник радова ‐ 65. Конференција за електронику, телекомуникације, рачунарство, аутоматику и нуклеарну технику, Етно село Станишићи, 08‐10.09.2021. године / Proceedings of Papers – 8th International Conference on Electrical, Electronic and Computing Engineering, IcETRAN 2021, Ethno willage Stanišići, Republic of Srpska, Bosnia and Herzegovina, 2021",
title = "A Mobile Robot Visual Perception System based on Deep Learning Approach",
pages = "572-568",
url = "https://hdl.handle.net/21.15107/rcub_machinery_4233"
}
Jokić, A., Đokić, L., Petrović, M.,& Miljković, Z.. (2021). A Mobile Robot Visual Perception System based on Deep Learning Approach. in Зборник радова ‐ 65. Конференција за електронику, телекомуникације, рачунарство, аутоматику и нуклеарну технику, Етно село Станишићи, 08‐10.09.2021. године / Proceedings of Papers – 8th International Conference on Electrical, Electronic and Computing Engineering, IcETRAN 2021, Ethno willage Stanišići, Republic of Srpska, Bosnia and Herzegovina, 2021
Belgrade : Društvo za ETRAN., 568-572.
https://hdl.handle.net/21.15107/rcub_machinery_4233
Jokić A, Đokić L, Petrović M, Miljković Z. A Mobile Robot Visual Perception System based on Deep Learning Approach. in Зборник радова ‐ 65. Конференција за електронику, телекомуникације, рачунарство, аутоматику и нуклеарну технику, Етно село Станишићи, 08‐10.09.2021. године / Proceedings of Papers – 8th International Conference on Electrical, Electronic and Computing Engineering, IcETRAN 2021, Ethno willage Stanišići, Republic of Srpska, Bosnia and Herzegovina, 2021. 2021;:568-572.
https://hdl.handle.net/21.15107/rcub_machinery_4233 .
Jokić, Aleksandar, Đokić, Lazar, Petrović, Milica, Miljković, Zoran, "A Mobile Robot Visual Perception System based on Deep Learning Approach" in Зборник радова ‐ 65. Конференција за електронику, телекомуникације, рачунарство, аутоматику и нуклеарну технику, Етно село Станишићи, 08‐10.09.2021. године / Proceedings of Papers – 8th International Conference on Electrical, Electronic and Computing Engineering, IcETRAN 2021, Ethno willage Stanišići, Republic of Srpska, Bosnia and Herzegovina, 2021 (2021):568-572,
https://hdl.handle.net/21.15107/rcub_machinery_4233 .

Application of metaheuristic optimization algorithms for image registration in mobile robot visual control

Đokić, Lazar; Jokić, Aleksandar; Petrović, Milica; Slavković, Nikola; Miljković, Zoran

(Univerzitet u Kragujevcu - Fakultet tehničkih nauka, Čačak, 2021)

TY  - JOUR
AU  - Đokić, Lazar
AU  - Jokić, Aleksandar
AU  - Petrović, Milica
AU  - Slavković, Nikola
AU  - Miljković, Zoran
PY  - 2021
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/3663
AB  - Visual Servoing (VS) of a mobile robot requires advanced digital image processing, and one of the techniques especially fitting for this complex task is Image Registration (IR). In general, IR involves the geometrical alignment of images, and it can be viewed as an optimization problem. Therefore, we propose Metaheuristic Optimization Algorithms (MOA) for IR in VS of a mobile robot. The comprehensive comparison study of three state-of-the-art MOA, namely the Slime Mould Algorithm (SMA), Harris Hawks Optimizer (HHO), and Whale Optimization Algorithm (WOA) is presented. The previously mentioned MOA used for IR are evaluated on 12 pairs of stereo images obtained by a mobile robot stereo vision system in a laboratory model of a manufacturing environment. The MATLAB software package is used for the implementation of the considered optimization algorithms. Acquired experimental results show that SMA outperforms HHO and WOA, while all three algorithms perform satisfactory alignment of images captured from various mobile robot poses.
PB  - Univerzitet u Kragujevcu - Fakultet tehničkih nauka, Čačak
T2  - Serbian Journal of Electrical Engineering
T1  - Application of metaheuristic optimization algorithms for image registration in mobile robot visual control
EP  - 170
IS  - 2
SP  - 155
VL  - 18
DO  - 10.2298/SJEE2102155D
ER  - 
@article{
author = "Đokić, Lazar and Jokić, Aleksandar and Petrović, Milica and Slavković, Nikola and Miljković, Zoran",
year = "2021",
abstract = "Visual Servoing (VS) of a mobile robot requires advanced digital image processing, and one of the techniques especially fitting for this complex task is Image Registration (IR). In general, IR involves the geometrical alignment of images, and it can be viewed as an optimization problem. Therefore, we propose Metaheuristic Optimization Algorithms (MOA) for IR in VS of a mobile robot. The comprehensive comparison study of three state-of-the-art MOA, namely the Slime Mould Algorithm (SMA), Harris Hawks Optimizer (HHO), and Whale Optimization Algorithm (WOA) is presented. The previously mentioned MOA used for IR are evaluated on 12 pairs of stereo images obtained by a mobile robot stereo vision system in a laboratory model of a manufacturing environment. The MATLAB software package is used for the implementation of the considered optimization algorithms. Acquired experimental results show that SMA outperforms HHO and WOA, while all three algorithms perform satisfactory alignment of images captured from various mobile robot poses.",
publisher = "Univerzitet u Kragujevcu - Fakultet tehničkih nauka, Čačak",
journal = "Serbian Journal of Electrical Engineering",
title = "Application of metaheuristic optimization algorithms for image registration in mobile robot visual control",
pages = "170-155",
number = "2",
volume = "18",
doi = "10.2298/SJEE2102155D"
}
Đokić, L., Jokić, A., Petrović, M., Slavković, N.,& Miljković, Z.. (2021). Application of metaheuristic optimization algorithms for image registration in mobile robot visual control. in Serbian Journal of Electrical Engineering
Univerzitet u Kragujevcu - Fakultet tehničkih nauka, Čačak., 18(2), 155-170.
https://doi.org/10.2298/SJEE2102155D
Đokić L, Jokić A, Petrović M, Slavković N, Miljković Z. Application of metaheuristic optimization algorithms for image registration in mobile robot visual control. in Serbian Journal of Electrical Engineering. 2021;18(2):155-170.
doi:10.2298/SJEE2102155D .
Đokić, Lazar, Jokić, Aleksandar, Petrović, Milica, Slavković, Nikola, Miljković, Zoran, "Application of metaheuristic optimization algorithms for image registration in mobile robot visual control" in Serbian Journal of Electrical Engineering, 18, no. 2 (2021):155-170,
https://doi.org/10.2298/SJEE2102155D . .
1

Visual Deep Learning-Based Mobile Robot Control: A Novel Weighted Fitness Function-Based Image Registration Model

Jokić, Aleksandar; Petrović, Milica; Kulesza, Z.; Miljković, Zoran

(Springer Science and Business Media Deutschland GmbH, 2021)

TY  - CONF
AU  - Jokić, Aleksandar
AU  - Petrović, Milica
AU  - Kulesza, Z.
AU  - Miljković, Zoran
PY  - 2021
UR  - https://machinery.mas.bg.ac.rs/handle/123456789/3649
AB  - The recent development of faster and more accurate deep learning models has enabled researchers to utilize the potential of deep learning in robotics. Convolutional neural networks used for the process of semantic segmentation are being applied to improve the traditional robotic tasks by adding an additional level of intelligence, through the execution of context-aware tasks. Having that in mind, visual servoing can now be performed in a completely new manner, by exploiting only semantic and geometric knowledge about the environment. To carry out visual servoing, the mathematical model of the error between the images generated at the current and the desired mobile robot pose (i.e. position and orientation) in the image space needs to be adequately defined. In this paper, we propose the novel mathematical model for the weighted fitness function evaluation, which is utilized for the image registration process within the visual servoing framework. By weighting the classes by their importance in the desired image, the convergence domain of the initial error in the visual servoing process can be greatly extended. The experimental evaluation is carried out on the mobile robot RAICO (Robot with Artificial Intelligence based COgnition), where it is shown that weighted fitness function enables more robust intelligent visual servoing systems with a lower possibility of failure, easier real-world implementation, and feasible object driven navigation.
PB  - Springer Science and Business Media Deutschland GmbH
C3  - Lecture Notes in Networks and Systems
T1  - Visual Deep Learning-Based Mobile Robot Control: A Novel Weighted Fitness Function-Based Image Registration Model
EP  - 752
SP  - 744
VL  - 233
DO  - 10.1007/978-3-030-75275-0_82
ER  - 
@conference{
author = "Jokić, Aleksandar and Petrović, Milica and Kulesza, Z. and Miljković, Zoran",
year = "2021",
abstract = "The recent development of faster and more accurate deep learning models has enabled researchers to utilize the potential of deep learning in robotics. Convolutional neural networks used for the process of semantic segmentation are being applied to improve the traditional robotic tasks by adding an additional level of intelligence, through the execution of context-aware tasks. Having that in mind, visual servoing can now be performed in a completely new manner, by exploiting only semantic and geometric knowledge about the environment. To carry out visual servoing, the mathematical model of the error between the images generated at the current and the desired mobile robot pose (i.e. position and orientation) in the image space needs to be adequately defined. In this paper, we propose the novel mathematical model for the weighted fitness function evaluation, which is utilized for the image registration process within the visual servoing framework. By weighting the classes by their importance in the desired image, the convergence domain of the initial error in the visual servoing process can be greatly extended. The experimental evaluation is carried out on the mobile robot RAICO (Robot with Artificial Intelligence based COgnition), where it is shown that weighted fitness function enables more robust intelligent visual servoing systems with a lower possibility of failure, easier real-world implementation, and feasible object driven navigation.",
publisher = "Springer Science and Business Media Deutschland GmbH",
journal = "Lecture Notes in Networks and Systems",
title = "Visual Deep Learning-Based Mobile Robot Control: A Novel Weighted Fitness Function-Based Image Registration Model",
pages = "752-744",
volume = "233",
doi = "10.1007/978-3-030-75275-0_82"
}
Jokić, A., Petrović, M., Kulesza, Z.,& Miljković, Z.. (2021). Visual Deep Learning-Based Mobile Robot Control: A Novel Weighted Fitness Function-Based Image Registration Model. in Lecture Notes in Networks and Systems
Springer Science and Business Media Deutschland GmbH., 233, 744-752.
https://doi.org/10.1007/978-3-030-75275-0_82
Jokić A, Petrović M, Kulesza Z, Miljković Z. Visual Deep Learning-Based Mobile Robot Control: A Novel Weighted Fitness Function-Based Image Registration Model. in Lecture Notes in Networks and Systems. 2021;233:744-752.
doi:10.1007/978-3-030-75275-0_82 .
Jokić, Aleksandar, Petrović, Milica, Kulesza, Z., Miljković, Zoran, "Visual Deep Learning-Based Mobile Robot Control: A Novel Weighted Fitness Function-Based Image Registration Model" in Lecture Notes in Networks and Systems, 233 (2021):744-752,
https://doi.org/10.1007/978-3-030-75275-0_82 . .
2