Designing a robot to follow a command from the analysis of the image received from the operator

Subject Areas : Journal of Simulation and Analysis of Novel Technologies in Mechanical Engineering

Majid Amiri ¹ , Shayan Farokhi Aleh Kouhi ² , Ahmad Keshavarzi ³

1 - Department of Mechanical Engineering, University of Malek-e-Ashtar, Isfahan, Iran
2 - Department of Mechanical Engineering, University of Shahid Mohajer, Isfahan, Iran.
3 - Department of Mechanical Engineering, Khomeinishahr Branch, Islamic Azad University, Isfahan, Iran

Received: 2023-08-27 Accepted : 2023-11-04 Published : 2023-09-01

Keywords: Digital image processing, Hand gesture recognition, Robot, MATLAB,

Abstract :

It is necessary to design a robot which can be operated without the physical presence of humans. The goal of this paper is to launch a robot that is in the control station far from the user. This can be achieved using a technique called “image processing”. One way to solve this problem is to insert commands on a wireless robot using hand gestures to develop a user-friendly interface. The motion detection system works in three stages including image capture, feature extraction, and algorithmic decision-making. Once the gesture is detected, a command signal is generated and sent to the microcontrollers. Then, they are sent to the robot to make it run in the desired direction. Robots, for one application, are used to operate in situations where human intervention is impossible. These robots have a microcontroller-based system called the pick-and-place arm. This mechatronic arm moves objects from a source location to the desired location. The process is controlled with a keyboard. These robots are equipped with RF cameras to record videos at 2.4 GHz. The user can watch the live video at the base station using a computer system. It is tested in the MAT software, and the video is processed in the DSP code simultaneously.

References:

[1] Ahmed, T. (2012). A neural network based real time hand gesture recognition system. International journal of computer applications, 59(4).
[2] Dhawan, A., & Honrao, V. (2013). Implementation of hand detection based techniques for human computer interaction. arXiv preprint arXiv:1312.7560.
[3] Kaura, H. K., Honrao, V., Patil, S., & Shetty, P. (2013). Gesture controlled robot using image processing. International Journal of Advanced Research in Artificial Intelligence, 2(5).
[4] Jain, M., Aditi, A. L., Khan, M. F., & Maurya, A. (2012). Wireless gesture control robot: an analysis. International Journal of Advanced Research in Computer and Communication Engineering, 1(10), 855-857.
[5] Swetha, N. (2013). Design and implementation of accelerometer based robot motion and speed control with obstacle detection. Int. J. Sci. Eng. Technol, 2, 749-755.
[6] MaruthiSagar, N. V., Kumar, D. S., & Geethanjali, N. (2014). MEMS based gesture controlled robot using wireless communication. International Journal of Engineering Trends and Technology, 14(4), 185-188.
[7] Khan, R. Z., & Ibraheem, N. A. (2012). Hand gesture recognition: a literature review. International journal of artificial Intelligence & Applications, 3(4), 161.
[8] Malima, Ozgur, & Cetin. (2006). A fast algorithm for vision-based hand gesture recognition for robot control. 2006 IEEE 14th Signal Processing and Communications Applications, 1-4.