The complex kinematic structure of a human thumb makes it difficult to capture and control the thumb motions. A further complication is that mapping the fingertip position alone leads to inadequate grasping postures for current robotic hands, many of which are equipped with tactile sensors on the volar side of the fingers. This paper aimed to use a data glove as the input device to teleoperate the thumb of a humanoid robotic hand. An experiment protocol was developed with only minimum hardware involved to compensate for the differences in kinematic structures between a robotic hand and a human hand. A nonlinear constrained-optimization formulation was proposed to map and calibrate the motion of a human thumb to that of a robotic thumb by minimizing the maximum errors (minimax algorithms) of fingertip position while subject to the constraint of the normals of the surfaces of the thumb and the index fingertips within a friction cone. The proposed approach could be extended to other teleoperation applications, where the master and slave devices differ in kinematic structure.
Issue Section:
Research Papers
References
1.
Goertz
, R.
, 1964
, “Manipulator Systems Development at ANL
,” 12th Conference on Remote Systems Technology, American Nuclear Society
, San Francisco, CA, pp. 117
–136
.2.
Zoppi
, M.
, Sieklicki
, W.
, and Molfino
, R.
, 2008
, “Design of a Microrobotic Wrist for Needle Laparoscopic Surgery
,” ASME J. Mech. Des.
, 130
(10
), p. 102306
.10.1115/1.29656083.
Li
, J.
, Zhang
, G.
, Müller
, A.
, and Wang
, S.
, 2013
, “A Family of Remote Center of Motion Mechanisms Based on Intersecting Motion Planes
,” ASME J. Mech. Des.
, 135
(9
), p. 091009
.10.1115/1.40248484.
Kuo
, C.-H.
, and Dai
, J. S.
, 2012
, “Kinematics of a Fully-Decoupled Remote Center-of-Motion Parallel Manipulator for Minimally Invasive Surgery
,” ASME J. Med. Dev.
, 6
(2
), p. 021008
.10.1115/1.40065415.
Dai
, J. S.
, 2010
, “Surgical Robotics and Its Development and Progress
,” Robotica
, 28
(2
), pp. 161
–161
.10.1017/S02635747099908776.
Verner
, M.
, Xi
, F.
, and Mechefske
, C.
, 2005
, “Optimal Calibration of Parallel Kinematic Machines
,” ASME J. Mech. Des.
, 127
(1
), pp. 62
–69
.10.1115/1.18284617.
Safaric
, R.
, Parkin
, R. M.
, Czarnecki
, C. A.
, and Calkin
, D. W.
, 2001
, “Virtual Environment for Telerobotics
,” Integr. Comput.-Aided Eng.
, 8
(2
), pp. 95
–104
.10.1145/2380116.23801398.
Bi
, Z. M.
, Lang
, S. Y. T.
, Zhang
, D.
, Orban
, P. E.
, and Verner
, M.
, 2006
, “Integrated Design Toolbox for Tripod-Based Parallel Kinematic Machines
,” ASME J. Mech. Des.
, 129
(8
), pp. 799
–807
.10.1115/1.27353409.
Bicchi
, A.
, Caiti
, A.
, Pallottino
, L.
, and Tonietti
, G.
, 2005
, “Online Robotic Experiments for Tele-Education at the University of Pisa
,” J. Rob. Syst.
, 22
(4
), pp. 217
–230
.10.1002/rob.2006110.
Kihonge
, J. N.
, Larochelle
, P. M.
, and Vance
, J. M.
, 2002
, “Spatial Mechanism Design in Virtual Reality With Networking
,” ASME J. Mech. Des.
, 124
(3
), pp. 435
–440
.10.1115/1.148136311.
Moosavian
, S. A. A.
, Kalantari
, A.
, Semsarilar
, H.
, Aboosaeedan
, E.
, and Mihankhah
, E.
, 2009
, “ResQuake: A Tele-Operative Rescue Robot
,” ASME J. Mech. Des.
, 131
(8
), p. 081005
.10.1115/1.317911712.
Springer
, S. L.
, and Ferrier
, N. J.
, 2002
, “Design and Control of a Force-Reflecting Haptic Interface for Teleoperational Grasping
,” ASME J. Mech. Des.
, 124
(2
), pp. 277
–283
.10.1115/1.147049313.
Snyman
, J. A.
, Duffy
, J.
, and du Plessis
, L. J.
, 1998
, “An Optimization Approach to the Determination of the Boundaries of Manipulator Workspaces
,” ASME J. Mech. Des.
, 122
(4
), pp. 447
–456
.10.1115/1.128938814.
Rahman
, T.
, Krouglicof
, N.
, and Lye
, L.
, 2012
, “Kinematic Synthesis of Nonspherical Orientation Manipulators: Maximization of Dexterous Regular Workspace by Multiple Response Optimization
,” ASME J. Mech. Des.
, 134
(7
), p. 071009
.10.1115/1.400683015.
Gan
, D.
, Tsagarakis
, N. G.
, Dai
, J. S.
, Caldwell
, D. G.
, and Seneviratne
, L.
, 2012
, “Stiffness Design for a Spatial Three Degrees of Freedom Serial Compliant Manipulator Based on Impact Configuration Decomposition
,” J. Mech. Rob.
, 5
(1
), p. 011002
.10.1115/1.400749216.
Zhang
, X.
, and Nelson
, C. A.
, 2011
, “Multiple-Criteria Kinematic Optimization for the Design of Spherical Serial Mechanisms Using Genetic Algorithms
,” ASME J. Mech. Des.
, 133
(1
), p. 011005
.10.1115/1.400313817.
Dai
, J. S.
, Wang
, D.
, and Cui
, L.
, 2009
, “Orientation and Workspace Analysis of the Multifingered Metamorphic Hand-Metahand
,” IEEE Trans. Rob.
, 25
(4
), pp. 942
–947
.10.1109/TRO.2009.201713818.
Cui
, L.
, and Dai
, J. S.
, 2011
, “Posture, Workspace, and Manipulability of the Metamorphic Multifingered Hand With an Articulated Palm
,” ASME J. Mech. Rob.
, 3
(2
), p. 021001
.10.1115/1.400341419.
Cui
, L.
, and Dai
, J. S.
, 2012
, “Reciprocity-Based Singular Value Decomposition for Inverse Kinematic Analysis of the Metamorphic Multifingered Hand
,” ASME J. Mech. Rob.
, 4
(3
), p. 034502
.10.1115/1.400618720.
Dai
, J. S.
, and Wang
, D.
, 2007
, “Geometric Analysis and Synthesis of the Metamorphic Robotic Hand
,” ASME J. Mech. Des.
, 129
(11
), pp. 1191
–1197
.10.1115/1.277157621.
Wei
, G.
, Dai
, J. S.
, Wang
, S.
, and Luo
, H.
, 2011
, “Kinematic Analysis and Prototype of a Metamorphic Anthropromorphic Hand With a Reconfigurable Palm
,” Int. J. Humanoid Rob.
, 8
(3
), pp. 459
–479
.10.1142/S021984361100253822.
Collins
, C. L.
, and Long
, G. L.
, 1995
, “The Singularity Analysis of an In-Parallel Hand Controller for Force-Reflected Teleoperation
,” IEEE Trans. Rob. Autom.
, 11
(5
), pp. 661
–669
.10.1109/70.46660023.
Zhang
, K.
, Fang
, Y.
, Dai
, J. S.
, and Fang
, H.
, 2010
, “Geometry and Constraint Analysis of the Three-Spherical Kinematic Chain Based Parallel Mechanism
,” J. Mech. Rob.
, 2
(3
), p. 031014
.10.1115/1.400178324.
Dipietro
, L.
, Sabatini
, A. M.
, and Dario
, P.
, 2008
, “A Survey of Glove-Based Systems and Their Applications
,” IEEE Trans. Syst. Man Cybern. Part C
, 38
(4
), pp. 461
–482
.10.1109/TSMCC.2008.92386225.
Fischer
, M.
, van der Smagt
, P.
, and Hirzinger
, G.
, 1998
, “Learning Techniques in a Dataglove Based Telemanipulation System for the DLR Hand
,” IEEE International Conference on Robotics and Automation
, IEEE Press, Leuven, Belgium, pp. 1603
–1608
.26.
Griffin
, W. B.
, Findley
, R. P.
, Turner
, M. L.
, and Cutkosky
, M. R.
, 2000
, “Calibration and Mapping of a Human Hand for Dexterous Telemanipulation
,” ASME International Mechanical Engineering Congress, ASME Press
, Orlando, FL
, pp. 1–8.27.
Rohling
, R. N.
, and Hollerbach
, J. M.
, 1993
, “Calibrating the Human Hand for Haptic Interfaces
,” Presence
, 2
(4
), pp. 281
–296
.28.
Hong
, J.
, and Tan
, X.
, 1989
, “Calibrating a VPL DataGlove for Teleoperating the Utah/MIT Hand
,” IEEE International Conference on Robotics and Automation
, IEEE Press, Scottsdale, AZ. pp. 1752
–1757
.29.
Wojtara
, T.
, Nonami
, K.
, Shao
, H.
, Yuasa
, R.
, Amano
, S.
, and Nobumoto
, Y.
, 2004
, “Master-Slave Hand System of Different Structures, Grasp Recognition by Neural Network and Grasp Mapping
,” Robotica
, 22
(4
), pp. 449
–454
.10.1017/S026357470400001330.
Chang
, L. Y.
, and Pollard
, N. S.
, 2007
, “Constrained Least-Squares Optimization for Robust Estimation of Center of Rotation
,” J. Biomech.
, 40
(6
), pp. 1392
–1400
.10.1016/j.jbiomech.2006.05.01031.
Chang
, L. Y.
, and Pollard
, N. S.
, 2007
, “Robust Estimation of Dominant Axis of Rotation
,” J. Biomech.
, 40
(12
), pp. 2707
–2715
.10.1016/j.jbiomech.2007.01.01032.
Diftler
, M. A.
, Culbert
, C. J.
, Ambrose
, R. O.
, Platt
, R.
, Jr., and Bluethmann
, W. J.
, 2003
, “Evolution of the NASA/DARPA Robonaut Control System
,” IEEE International Conference on Robotics and Automation
, IEEE Press, Taipei, pp. 2543
–2548
.33.
Napier
, J.
, 1956
, “The Prehensile Movements of the Human Hands
,” J. Bone Joint Surg.
, 38B
(4
), pp. 902
–913
.34.
Cutkosky
, M. R.
, and Kao
, I.
, 1989
, “Computing and Controlling Compliance of a Robotic Hand
,” IEEE Trans. Rob. Autom.
, 5
(2
), pp. 151
–165
.10.1109/70.8803635.
Cooney
, W.
, and Chao
, E.
, 1977
, “Biomechanical Analysis of Static Forces in the Thumb During Hand Function
,” J. Bone Joint Surg.
, 59
(1
), pp. 27
–36
.36.
Taylor
, C. L.
, and Schwarz
, R. J.
, 1995
, “The Anatomy and Mechanics of the Human Hand
,” Artif. Limbs
, 2
(2
), pp. 22
–35
.37.
Dai
, J. S.
, and Kerr
, D. R.
, 1996
, “Analysis of Force Distribution in Grasps Using Augmentation
,” Proc. Inst. Mech. Eng., Part C
, 210
(1
), pp. 15
–22
.10.1243/PIME_PROC_1996_210_165_0238.
Sanli
, S. G.
, Kizilkanat
, E. D.
, Boyan
, N.
, Ozsahin
, E. T.
, Bozkir
, M. G.
, Soames
, R.
, Erol
, H.
, and Oguz
, O.
, 2005
, “Stature Estimation Based on Hand Length and Foot Length
,” Clin. Anatomy
, 18
(8
), pp. 589
–596
.10.1002/ca.2014639.
40.
Santos
, V. J.
, and Valero-Cuevas
, F. J.
, 2006
, “Reported Anatomical Variability Naturally Leads to Multimodal Distributions of Denavit-Hartenberg Parameters for the Human Thumb
,” IEEE Trans. Biomed. Eng.
, 53
(2
), pp. 155
–163
.10.1109/TBME.2005.86253741.
Virtual Technologies
, 1992
, CyberGlove User's Manual
, Virtual Technologies, Oakland, MI.42.
Cooney
, M. P.
, Lucca
, M. J.
, Chao
, E. Y.
, and Linscheid
, R. L.
, 1981
, “The Kinesiology of the Thumb Trapeziometacarpal Joint
,” J. Bone Joint Surg.
, 63
(9
), pp. 1371
–1381
.43.
Hartenberg
, R. S.
, and Denavit
, J.
, 1964
, Kinematic Synthesis of Linkages
, McGraw-Hill, Inc.
, New York
.44.
Murray
, R. M.
, Li
, Z.
, and Sastry
, S. S.
, 1994
, A Mathematical Introduction to Robotic Manipulation
, CRC Press
, Boca Raton, FL
.45.
Li
, H.
, Trinkle
, J. C.
, and Li
, Z. X.
, 2000
, “Grasp Analysis as Linear Matrix Inequality Problems
,” IEEE Trans. Rob. Autom.
, 16
(6
), pp. 663
–674
.10.1109/70.89777846.
Johnson
, K. L.
, 1987
, Contact Mechanics
, Cambridge University Press, Cambridge, UK.
47.
Ghafoor
, A.
, Dai
, J. S.
, and Duffy
, J.
, 2000
, “Fine Motion Control Based on Constraint Criteria Under Pre-Loading Configurations
,” J. Rob. Syst.
, 17
(4
), pp. 171
–185
.10.1002/(SICI)1097-4563(200004)17:4<171::AID-ROB1>3.0.CO;2-648.
Bicchi
, A.
, and Kumar
, V.
, 2000
, “Robotic Grasping and Contact: A Review
,” IEEE International Conference on Robotics and Automation
, IEEE Press, San Francisco, pp. 348
–353
.49.
Howard
, W. S.
, and Kumar
, V.
, 1996
, “On the Stability of Grasped Objects
,” IEEE Trans. Rob. Autom.
, 12
(6
), pp. 904
–917
.10.1109/70.54477350.
Dietrich
, J.
, Hirzinger
, G.
, and Heindl
, J.
, 1999
, Multisensory Telerobotic Techniques
, Springer-Verlag
, Berlin, Germany.51.
Anil
, S. M.
, Bobby
, B.
, Rose
, M.
, Cynthia
, D. B.
, Er
, T.
, Jeff
, S.
, Kevin
, M.
, and Richard
, B.
, 2003
, “Using Registration, Calibration, and Robotics to Build a More Accurate Virtual Reality Simulation for Astronaut Training and Telemedicine
,” International Conference on Computer Graphics and Computer Vaclav Skala Union Agency, Vision Plzen-Bory
, Czech Republic
.52.
Ben-Haim
, Z.
, and Eldar
, Y. C.
, 2005
, “Minimax Estimators Dominating the Least-Squares Estimator
,” IEEE International Conference on Acoustics, Speech, and Signal Processing
, IEEE Press, Philadelphia, PA, Vol. 4, pp. 53–56.53.
Schmidt
, K.
, 1996
, “A Comparison of Minimax and Least Squares Estimators in Linear Regression With Polyhedral Prior Information
,” Acta Appl. Math.
, 43
(1
), pp. 127
–138
.10.1007/BF0004699354.
Kim
, D.
, Hilliges
, O.
, Izadi
, S.
, Butler
, A. D.
, Chen
, J.
, Oikonomidis
, I.
, and Olivier
, P.
, 2012
, “Digits: Freehand 3D Interactions Anywhere Using a Wrist-Worn Gloveless Sensor
,” 25th Annual ACM Symposium on User Interface Software and Technology, ACM
, Cambridge, MA
, pp. 167
–176
.10.1145/2380116.238013955.
Copyright © 2014 by ASME
You do not currently have access to this content.
