Abstract
A novel model predictive control scheme for constrained visual servoing is developed. The proposed method compensates the shortcomings of available MPC schemes in visual servoing and can be utilized for positioning robots in uncertain environments with internal and external constrains. The system model is designed by weighted conjugating of the well-known image-based and position-based approaches. The stability analysis of the control scheme is presented and by illustrating several simulations, the performance and robustness of proposed control structure is demonstrated.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data Availability
Not applicable.
References
Corke, P.I.: Visual Control of Robots: High-Performance Visual Servoing. Research Studies Press, Taunton (1996)
Hutchinson, S., Hager, G.D., Corke, P.I.: A tutorial on visual servo control. IEEE Trans. Robot. Autom. 12(5), 651–670 (1996)
Cho, H.: Opto-Mechatronic Systems Handbook: Techniques and Applications. CRC press, Boca Raton (2002)
Chaumette, F., Hutchinson, S.: Visual servo control. I. Basic approaches. IEEE Robot. Autom. Mag. 13(4), 82–90 (2006)
Malis, E., Chaumette, F., Boudet, S.: 2-1/2-D visual servoing. IEEE Trans. Robot. Autom. 15(2), 238–250 (1999)
Corke, P.I., Hutchinson, S.: A new partitioned approach to image-based visual servo control. IEEE Trans. Robot. Autom. 17(4), 507–515 (2001)
Conticelli, F., Allotta, B., Colombo, C.: Hybrid visual servoing: a combination of nonlinear control and linear vision. Robot. Auton. Syst. 29(4), 243–256 (1999)
Cervera, E., Del Pobil, A.P., Berry, F., Martinet, P.: Improving image-based visual servoing with three-dimensional features. Int. J. Robot. Res. 22(10–11), 821–839 (2003)
Kim, S., Oh, S.Y.: Hybrid position and image based visual servoing for mobile robots. J. Intell. Fuzzy Syst. 18(1), 73–82 (2007)
Richalet, J., Rault, A., Testud, J.L., Papon, J.: Model predictive heuristic control. Automatica. 14(5), 413–428 (1978)
Cutler, C.R., Ramaker, B.L.: Dynamic matrix control-A computer control algorithm. In: Proceedings of Joint Automatic Control Conference, p. 72, San Francisco, CA (1980)
Bemporad, A., Morari, M.: Robust Model Predictive Control: a Survey. Robustness in Identification and Control, pp. 207–226. Springer, London (1999)
Sauvée M., Poignet P., Dombre E., Courtial E.: Image based visual servoing through nonlinear model predictive control, In: Proceedings of the 45th IEEE Conference on Decision and Control, pp. 1776–1781. San Diego (2006)
Sauvée, M., Poignet, P., Dombre, E.: Ultrasound image-based visual servoing of a surgical instrument through nonlinear model predictive control. Int. J. Robot. Res. 27(1), 25–40 (2008)
Allibert, G., Courtial, E., Chaumette, F.: Predictive control for constrained image-based visual servoing. IEEE Trans. Robot. 26(5), 933–939 (2010)
Allibert, G., Courtial, E., Chaumette, F.: Visual Servoing Via Nonlinear Predictive Control, Visual Servoing via Advanced Numerical Methods, pp. 375–393. Springer, London (2010)
Le Flécher, E., Durand-Petiteville, A., Cadenat, V., Sentenac, T.: Visual predictive control of robotic arms with overlapping workspace. In: Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics (ICINCO 2019), pp. 130–137, Prague, Czeck Republic (2019)
Gao, J., Zhang, G., Wu, P., Zhao, X., Wang, T., Yan, W.: Model predictive visual servoing of fully-actuated underwater vehicles with a sliding mode disturbance observer. IEEE Access. 7, 25516–25526 (2019)
Qiu, Z., Hu, S., Liang, X.: Model predictive control for uncalibrated and constrained image-based visual servoing without joint velocity measurements. IEEE Access. 7, 73540–73554 (2019)
Paolillo, A., Lembono, T.S., Calinon, S.: A memory of motion for visual predictive control tasks. In: Proceedings of the International Conference on Robotics and Automation (ICRA 2020), pp. 9014–9020, Paris, France (2020)
Hafez, A.A., Cervera, E., Jawahar, C.V.: Hybrid visual servoing by boosting IBVS and PBVS. In: Proceedings of IEEE 3rd International Conference on Information and Communication Technologies: From Theory to Applications, pp. 1–6. Damascus, Syria (2008)
Henson, M.A.: Nonlinear model predictive control: current status and future directions. Comput. Chem. Eng. 23(2), 187–202 (1998)
Simon, D., Löfberg, J., Glad, T.: Nonlinear model predictive control using feedback linearization and local inner convex constraint approximations. In: Proceedings of the European Control Conference (ECC), pp. 2056–2061, Saint-Petersburg, Russia (2013)
Boyd, S., Vandenberghe, L.P.: Convex Optimization. Cambridge university press, Cambridge (2004)
Xu, Q., Dubljevic, S.: Linear model predictive control for transport-reaction processes. AICHE J. 63(7), 2644–2659 (2017)
Economou, C.G., Morari, M., Palsson, B.O.: Internal model control: extension to nonlinear system. Ind. Eng. Chem. Process Des. Dev. 25(2), 403–411 (1986)
Dönmez, E., Kocamaz, A.F., Dirik, M.: A vision-based real-time mobile robot controller design based on gaussian function for indoor environment. Arab. J. Sci. Eng. 43, 7127–7142 (2018)
Dönmez, E., Kocamaz, A.F., Dirik, M.: Design of mobile robot control infrastructure based on decision trees and adaptive potential area methods. Iranian Journal of Science and Technology, Transactions of Electrical Engineering. 44(1), 431–448 (2020)
Piepmeier, J.A., McMurray, G.V., Lipkin, H.: Uncalibrated dynamic visual servoing. IEEE Trans. Robot. Autom. 20(1), 143–147 (2004)
Hao, M., Deuflhard, P., Sun, Z., Fujii, M.: Model-free uncalibrated visual servoing using recursive least squares. J. Comput. 3(11), 42–50 (2008)
Mayne, D.Q., Rawlings, J.B., Rao, C.V., Scokaert, P.O.M.: Constrained model predictive control: stability and optimality. Automatica. 36(6), 789–814 (2000)
Liao, P., Mao, J.: Full Workspace Generation of Serial-link Manipulators by Deep Learning based Jacobian Estimation, arXiv preprint arXiv:1809.05020 (2018)
Saraiya, K., Israni, D., Goel, P.: Assessment of Visual Servoing Techniques for Target Localization, in: Proceedings of the 6th International Conference of Control, Dynamic Systems, and Robotics (CDSR’19) Ottawa, Canada (2019)
Corke, P.: Robotics, vision and control: fundamental algorithms in MATLAB, 2nd edition. Springer, London (2017)
Farah, W., Mercère, G., Van Wingerden, J.W., Poinot, T.: Quantification of model uncertainty for a state-space system. In: Proceedings of the International Symposium on Mathematical Theory of Networks and Systems (MTNS), pp. 1007–1012, Budapest, Hungary (2010)
Acknowledgments
This work was sponsored by National Sciences and Engineering Research Council of Canada (NSERC) through Discovery Grant #2017 − 06930.
Author information
Authors and Affiliations
Contributions
M. M. H. Fallah developed formulation and simulations, and authored the manuscript. F. J. Sharifi supervised M. M. H. Fallah in problem formulation and control development, and participated in the authorship of the manuscript.
Corresponding author
Ethics declarations
Conflicts of Interest/Competing Interests
None.
Code Availability
None.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Mohammad Hossein Fallah, M., Janabi-Sharifi, F. Conjugated Visual Predictive Control for Constrained Visual Servoing. J Intell Robot Syst 101, 33 (2021). https://doi.org/10.1007/s10846-020-01299-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10846-020-01299-6