International Journal of Computer Science & Network Security

International Journal of Computer Science & Network Security (국제컴퓨터통신보호논문지학회)
권호 표지
DOI QR코드

DOI QR Code

B-COV:Bio-inspired Virtual Interaction for 3D Articulated Robotic Arm for Post-stroke Rehabilitation during Pandemic of COVID-19

  • Received : 2021.02.05
  • Published : 2021.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

The Coronavirus or COVID-19 is contagiousness virus that infected almost every single part of the world. This pandemic forced a major country did lockdown and stay at a home policy to reduce virus spread and the number of victims. Interactions between humans and robots form a popular subject of research worldwide. In medical robotics, the primary challenge is to implement natural interactions between robots and human users. Human communication consists of dynamic processes that involve joint attention and attracting each other. Coordinated care involves sharing among agents of behaviours, events, interests, and contexts in the world from time to time. The robotics arm is an expensive and complicated system because robot simulators are widely used instead of for rehabilitation purposes in medicine. Interaction in natural ways is necessary for disabled persons to work with the robot simulator. This article proposes a low-cost rehabilitation system by building an arm gesture tracking system based on a depth camera that can capture and interpret human gestures and use them as interactive commands for a robot simulator to perform specific tasks on the 3D block. The results show that the proposed system can help patients control the rotation and movement of the 3D arm using their hands. The pilot testing with healthy subjects yielded encouraging results. They could synchronize their actions with a 3D robotic arm to perform several repetitive tasks and exerting 19920 J of energy (kg.m2.S-2). The average of consumed energy mentioned before is in medium scale. Therefore, we relate this energy with rehabilitation performance as an initial stage and can be improved further with extra repetitive exercise to speed up the recovery process.

Keywords

Acknowledgement

This work was supported by the Deanship of Scientific Research (DSR) of King Abdulaziz University in Jeddah, Saudi Arabia, under grant no. 20539 and research code G:389-611-1439.

References

  1. Calin, A. Cantea, A. Dascalu, and C. Mihaiu, "Miraupper limb rehabilitation system using Microsoft Kinect," Studia Universitatis Babes-Bolyai, Informatica, vol. 56, no. 4, pp. 63-74, 2011.
  2. H. Mousavi Hondori and M. Khademi, "A Review on Technical and Clinical Impact of Microsoft Kinect on Physical Therapy and Rehabilitation," Journal of Medical Engineering, vol. 2014, p. 846514, 2014/12/11 2014. https://doi.org/10.1155/2014/846514
  3. F. Maliheh, B. Saeed, and M. Amir, "Motion Performance Measurement using the Microsoft Kinect Sensor," International Journal of Reliable and Quality E-Healthcare (IJRQEH), vol. 2, no. 4, pp. 28-37, 2013. https://doi.org/10.4018/ijrqeh.2013100103
  4. G. Dudek and M. Jenkin, Computational Principles of Mobile Robotics, Cambridge University Press. Cambridge University Press., 2010.
  5. H. Jeonghye, J. Miheon, P. Sungju, and K. Sungho, "The educational use of home robots for children," in ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005., 2005, pp. 378-383.
  6. A.H. Basori, "Emotion Walking for Humanoid Avatars Using Brain Signals," International Journal of Advanced Robotic Systems, vol. 10, no. 1, p. 29, 2013/01/01 2013. https://doi.org/10.5772/54764
  7. M. A. Ahmed and A. H. Basori, "The Influence of Beta Signal toward Emotion Classification for Facial Expression Control through EEG Sensors," Procedia - Social and Behavioral Sciences, vol. 97, pp. 730-736, 2013/11/06/ 2013. https://doi.org/10.1016/j.sbspro.2013.10.294
  8. N. N. Albaqami, K. H. Allehaibi, and A. H. Basori, "Augmenting pilgrim experience and safety with geolocation way finding and mobile Augmented Reality. International Journal of Computer Science and Network Security " International Journal of Computer Science and Network Security vol. 18, no. 2, pp. 23-32, 2018.
  9. A.H. Basori and A. Z. Qasim, "Extreme expression of sweating in 3D virtual human," Computers in Human Behavior, vol. 35, pp. 307-314, 2014/06/01/ 2014. https://doi.org/10.1016/j.chb.2014.03.013
  10. M. Riduwan, A. H. Basori, and F. Mohamed, "Finger-based Gestural Interaction for Exploration of 3D Heart Visualization," Procedia - Social and Behavioral Sciences, vol. 97, pp. 684-690, 2013/11/06/ 2013. https://doi.org/10.1016/j.sbspro.2013.10.288
  11. Y. A. Yusoff, A. H. Basori, and F. Mohamed, "Interactive Hand and Arm Gesture Control for 2D Medical Image and 3D Volumetric Medical Visualization," Procedia - Social and Behavioral Sciences, vol. 97, pp. 723-729, 2013/11/06/ 2013. https://doi.org/10.1016/j.sbspro.2013.10.293
  12. F. Tahavori, M. Alnowami, J. Jones, P. Elangovan, E. Donovan, and K. Wells, "Assessment of Microsoft Kinect technology (Kinect for Xbox and Kinect for windows) for patient monitoring during external beam radiotherapy," in 2013 IEEE Nuclear Science Symposium and Medical Imaging Conference (2013 NSS/MIC), 2013, pp. 1-5.
  13. Fossati, J. Gall, H. Grabner, X. Ren, and K. Konolige, 3D with Kinect,Consumer Depth Cameras for Computer Vision:Research Topics and Applications, Springer. Springer, 2011.
  14. M. Law et al., "Home and community occupational therapy for children and youth: a before and after study," (in eng), Canadian journal of occupational therapy. Revue canadienne d'ergotherapie, vol. 72, no. 5, pp. 289-97, Dec 2005. https://doi.org/10.1177/000841740507200505
  15. Abdullasim, N, Basori, A.H, Salam, M.S., Bade, A., Velocity Perception: Collision Handling Technique for Agent Avoidance Behavior, TELKOMNIKA, Vol.11, No.4, April 2013, DOI: 10.11591/telkomnika.v11i4.2599
  16. AlJahdali, H.M.A Basori, A.H. (2019) Emotional Contagion Driven of Parent-Child's Agents in Crowd during Panic Situation. International Journal of Computer Network and Information Security, Vol 19, No.1 2019, pp.261-266.
  17. Basori, A.H, AlJahdali, H.M.A (2018), "Performance Driven-biped Control for Animated Human Model with Motion Synthesis Data", Journal of Information Systems Engineering and Business Intelligence,Vol.4, No.2, 2018.
  18. R. Llorens, M. Alcaniz, C. Colomer, and M. D. Navarro, "Balance recovery through virtual stepping exercises using Kinect skeleton tracking: a follow-up study with chronic stroke patients," (in eng), Studies in health technology and informatics, vol. 181, pp. 108-12, 2012.
  19. F. Lorussi, N. Carbonaro, D. D. Rossi, and A. Tognetti, "A bi-articular model for scapular-humeral rhythm reconstruction through data from wearable sensors," Journal of NeuroEngineering and Rehabilitation, vol. 13, no. 1, p. 40, 2016/04/23 2016. https://doi.org/10.1186/s12984-016-0149-2
  20. Basori, A.H., Zuhair, Q.A (2014) "Extreme expression of sweating in 3D virtual human ", Computers In Human Behaviour, Vol 35, pp.307-314, Q1, ISI Indexed, June 2014, Impact Factor 3.4. https://doi.org/10.1016/j.chb.2014.03.013
  21. Ryden, H. J. Chizeck, S. N. Kosari, H. H. King, and B. Hannaford, "Using Kinect and a Haptic Interface for Implementation of Real-Time Virtual Fixture. In: Robotics Sciences and Systems," in Workshop on RGB-D: Advanced Reasoning with Depth Cameras, Los Angles, USA., 2011.
  22. N. Palade, "Autonomous stroke rehabilitation with Microsoft Kinect," KTH Computer Science and Communication, KTH Computer Science and Communication, 2013.
  23. L. Gallo, A. P. Placitelli, and M. Ciampi, "Controller-free exploration of medical image data: Experiencing the Kinect," in 2011 24th International Symposium on Computer-Based Medical Systems (CBMS), 2011, pp. 1-6.
  24. S. Huang et al., "Visual Odometry and Mapping for Autonomous Flight Using an RGB-D Camera," in Robotics Research : The 15th International Symposium ISRR, H. I. Christensen and O. Khatib, Eds. Cham: Springer International Publishing, 2017, pp. 235-252.
  25. J. Stowers, M. Hayes, and A. Bainbridge-Smith, "Altitude control of a quadrotor helicopter using depth map from Microsoft Kinect sensor," in 2011 IEEE International Conference on Mechatronics, 2011, pp. 358-362.
  26. Basori, A.H., Barukab, O.M. (2017) "Real Time Interactive Presentation Apparatus based on Depth Image Recognition", International Journal of Electrical and Computer Engineering (IJECE),Vol.7.No.3, June 2017.
  27. Basori, A.H., Almagrabi, A.O. (2017) "Towards Racing Gamification with Natural Interface for post stroke Rehabilitation", Computer Engineering and Applications Journal, Vol. 6(1), 2017.
  28. Basori, A.H, Al-Sharif, A.M, AL-Oufi, A.O, Almagrabi, A.O, Barukab, O.M. (2018) "Intelligence Context Aware Mobile Navigation using Augmented Reality Technology", Journal of Information Systems Engineering and Business Intelligence,Vol.4, No.1, 2018. http://dx.doi.org/10.20473/jisebi.4.1.65-72
  29. Basori, A.H, AlJahdali, H.M.A, Abdullah, O.S. (2017) "Forced-Driven Wet Cloth Simulation based on External Physical Dynamism", International Journal of Advanced Computer Science and Applications, Vol.8,No.11,2017,pp.572-581.
  30. R. E. Mayagoitia, A. V. Nene, and P. H. Veltink, "Accelerometer and rate gyroscope measurement of kinematics: an inexpensive alternative to optical motion analysis systems," (in eng), Journal of biomechanics, vol. 35, no. 4, pp. 537-42, Apr 2002. https://doi.org/10.1016/S0021-9290(01)00231-7
  31. G. Gioioso, G. Salvietti, M. Malvezzi, and D. Prattichizzo, "Mapping Synergies From Human to Robotic Hands With Dissimilar Kinematics: An Approach in the Object Domain," IEEE Transactions on Robotics, vol. 29, no. 4, pp. 825-837, 2013. https://doi.org/10.1109/TRO.2013.2252251
  32. K. Gerling, I. Livingston, L. Nacke, and R. Mandryk, "Full-body motion-based game interaction for older adults," presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Austin, Texas, USA, 2012. [Online]. Available: https://doi.org/10.1145/2207676.2208324.
  33. Basori, A.H, AlJahdali, H.M.A (2017) "TOUAR:Touchable Interface for Interactive Interaction in Augmented Reality Environment", Computer Engineering and Applications Journal, Vol. 6(2), 2017, PROQUEST indexed.
  34. Lange, C. Y. Chang, E. Suma, B. Newman, A. S. Rizzo, and M. Bolas, "Development and evaluation of low cost game-based balance rehabilitation tool using the Microsoft Kinect sensor," (in eng), Conference proceedings : Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Annual Conference, vol. 2011, pp. 1831-4, 2011.
  35. Basori, A.H., Almagrabi, A.O. (2018) Real Time Physical Force-Driven Hair Animation, International Journal of Computer Science and Network Security, VOL.18 No.10, October 2018, https://doi.org/10.5281/zenodo.2550645