Determining Position and Orientation of 6R Robot using Image Processing

Subject Areas : Mechanical Engineering

Amin Habibnejad Korayem ¹ , Ensieh Niyavarani ² , Saeed Rafee Nekoo ³ , Moharam Habibnejad ⁴

1 - Iran University of Science and Technology (IUST)
2 - Iran University of Science and Technology (IUST)
3 - Iran University of Science and Technology (IUST)
4 - Iran University of Science and Technology (IUST)

Received: 2017-04-01 Accepted : 2017-06-14 Published : 2018-03-01

Keywords: 6R Robot, Open CV, Localization, image processing, Stereo vision,

Abstract :

Stereo vision is one of the best image processing softwares to identify the environment of robot and allow its simultaneous process for providing three-dimensional measurement in an acceptable rate. On the one hand, vision measurement has simple structure and on the other hand it is independent from active machine or robot. Appropriate software and efficient programming could improve the performance with same hardware (cameras). In this paper, stereo vision robot localization is used and the main code was developed in open source computer vision (Open CV) environment. The mathematical relationship between the three-dimensional reference coordinates and the local coordinates for entire system are presented. The vision system is an independent unit consists of two high definition (HD) cameras, set in a rotary base. The application of this measurement provides the position and orientation of 6R robot to verify its current measurement system. Stereo vision improved the speed of the image processing in comparison with image processing of MATLAB Toolbox that led to online monitoring of trajectory. Experimental tests of the proposed method express the capability of stereo vision in practical operations as a supervisory section.

References:

[1]     Korayem, M. H., Nekoo, S. R., and Korayem, A. H., “Engineering Design of the Guidance System of the 6R Tele-robot based on DTMF”, International Journal of Advanced Design and Manufacturing Technology, Vol. 7, No. 3, 15 Nov. 2014, pp. 57–63.

[2]     Karami, N., Korayem, M. H., Shafei, A. M., and Nekoo, S. R., “Theoretical and Experimental Investigation of Dynamic Load Carrying Capacity of Flexible-Link Manipulator in Point-to-Point Motion”, Modares Mechanical Engineering, Vol. 14, No. 15, 2015, pp. 199-206. (In Persian)

[3]     Korayem, M. H., Irani, M., and Nekoo, S. R., “Analysis of Manipulators using SDRE: A Closed Loop Nonlinear Optimal Control Approach”, Journal of Sciatica Iranica, Transaction B: Mechanical Engineering, Vol. 17, No. 6, 2010, pp. 456–467.

[4]     Korayem, M. H., Irani, M., and Nekoo, S. R., “Motion Control and Dynamic Load Carrying Capacity of Mobile Robot via Nonlinear Optimal Feedback”, AMAEInternational Journal on Manufacturing and Material Science, Vol. 2, No. 1, 2012, pp. 16–21.

[5]     Korayem, M. H., Nekoo, S. R., and Abdollahi, F., “Hardware Implementation of a Closed Loop Controller on 6R Robot using ARM Microcontroller”, International Research Journal of Applied and Basic Sciences, Vol. 4, No. 8, 2013, pp. 2147–2158.

[6]     Korayem, M. H., Nekoo, S. R., “State-Dependent Differential Riccati Equation to Track Control of Time-Varying Systems with State and Control Nonlinearities”, ISA Transactions, Vol. 57, 2015, pp. 117–135.

[7]     Tucker, M., Perreira, M., and Nyman, D., “A Pose Measurement Sensor”, Proc of the Workshop on Robot Standards, Detroit, Michigan, June 1985, pp. 2.83-2.98.

[8]     Brown, L. B., “A Random-Path Laser Interferometer System”, In Proceedings of International Congress on Applications of Lasers and Electro-Optics, Nov. 1985.

[9]     Hantak, C., and Anselmo, L., “Metrics and Optimization Techniques for Registration of Color to Laser Range Scans”, In Third International Symposium on 3D Data Processing, Visualization, and Transmission, Jun. 2006, pp. 551-558.

[10]  Bradski, G., Kaehler, A., “Learning Open CV: Computer Vision with the Open CV Library”, O’Reilly Media, Inc., 2008.

[11]  Flandin, G., Chaumette, F., and Marchand, E., “Eye-in-Hand/Eye-to-Hand Cooperation for Visual Servoing”, In Proceedings of IEEE International Conference on Robotics and Automation, Vol. 3, 2000, pp. 2741-2746.

[12]  www.ovt.com

[13]  Korayem, M. H., Irani, M., and Nekoo, S. R., “Application of Stereo Vision and ARM Processor for Motion Control”, Interdisciplinary Mechatronics, 2013, pp. 483–499.