It uses stretchable smart textile gloves powered by machine learning to capture complex hand movements and interactions with objects.

Machine Learning


  • Luo, Y. et al. Learning human-environment interactions using conformal tactile textiles. National Electron Four193–201 (2021).

    Article Google Scholar

  • Moin, A. et al. “Wearable Biosensing System with In-Sensor Adaptive Machine Learning for Hand Gesture Recognition” National Electron Four54–63 (2021).

    Article Google Scholar

  • Zhou, Z. et al. Sign language to speech translation using machine learning assisted stretchable sensor arrays. National Electron 3571–578 (2020).

    Article Google Scholar

  • Chen, W. et al., “A Survey on Wearable Hand Pose Estimation.” sensor 201074 (2020).

    Article Google Scholar

  • Glauser, O. et al. Interactive hand pose estimation using stretch-sensing soft gloves. ACM Trans. 3841 (2019).

  • Wang, M. et al. Gesture Recognition Using a Bio-Inspired Learning Architecture Integrating Visual and Somatosensory Data from Stretchable Sensors. National Electron 3563–570 (2020).

    Article Google Scholar

  • Zhu, M., Sun, Z., Lee, C. Soft modular glove with multimodal sensing and augmented tactile feedback enabled by material multifunctionality. ACS Nano 1614097–14110 (2022).

    Article Google Scholar

  • Hughes, J. et al. “A simple and inexpensive wearable glove with hybrid resistive pressure sensors for computational sensing, proprioception, and task identification.” Advanced Intelligence System 22000002 (2020).

    Article Google Scholar

  • Sun, Z., Zhu, M., Shan, X., Lee, C. Augmented haptic perception and haptic feedback ring as a human-machine interface for immersive interaction. National Communications 135224 (2022).

    Article Google Scholar

  • Sundaram, S. et al., “Learning human grasping characteristics using a scalable haptic glove.” Nature 569698–702 (2019).

    Article Google Scholar

  • Lei, Q. et al., “A Survey of Vision-Based Human Action Assessment Methods.” sensor 194129 (2019).

  • Wen, F., Zhang, Z., He, T., Lee, C. AI-enabled sign language recognition and two-way communication in VR space using triboelectric smart gloves. National Communications 125378 (2021).

    Article Google Scholar

  • Henderson, J. et al. “Review of Wearable Sensor-Based Health Monitoring Glove Devices for Rheumatoid Arthritis” sensor twenty one1576 (2021).

  • Hughes, J. & Iida, F. A multifunctional soft strain sensor for wearable physiological monitoring. sensor 183822 (2018).

    Article Google Scholar

  • Atiqur, MAR, Antar, A. & Shahid, O. Vision-based action understanding for assisted healthcare: a short review. Proceedings of the IEEE/CVF Computer Vision and Pattern Recognition (CVPR) Workshop1–11 (2019).

  • Yang, C. et al., “User Perspectives on Future Interactive Wearable Systems for Upper Limb Rehabilitation After Stroke: A Qualitative Study.” J. Neuroengineering Rehabilitation 201–10 (2023).

    Article Google Scholar

  • Moin, A. et al. An EMG gesture recognition system with flexible dense sensors and a brain-inspired high-dimensional classifier. IEEE International Symposium on Circuits and Systems (ISCAS)1–5 (2018).

  • Karunratanakul, K. et al. “Grasp Field: Learning Implicit Representations of Human Grasping.” International Conference on 3D Vision (3DV)333–344 (2020).

  • Smith, B. et al., “Constraining dense hand surface tracking with elasticity.” ACM Trans. 39219 (2020).

  • Xie, K. et al. Physics-based human motion estimation and synthesis from video. Proceedings of the IEEE/CVF International Conference on Computer Vision 11532–11541 (IEEE, 2021).

  • Jiang, L., Xia, H., Guo, C. A model-based system for real-time articulated hand tracking using a simple data glove and a depth camera. sensor 194680 (2019).

    Article Google Scholar

  • Guzov, V. et al. Human POSEitioning System (HPS): 3D human pose estimation and self-localization in large-scale scenes from body-worn sensors. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)4316–4327 (2021).

  • Ehsani, K. et al. “Let's Use Forces, Luke! Learn to Simulate Effects and Predict Physical Forces.” IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)13–19 (2020).

  • Ge, L. et al. 3D hand shape and pose estimation from a single RGB image. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 10833–10842 (IEEE, 2019).

  • Wu, E. et al. Back-hand-pose: 3D hand pose estimation using back deformation networks from a wrist-worn camera. UIST 2020—Proc. 33rd ACM User Interface Software and Technology Symposium 1147–1160 (ACM, 2020).

  • Kocabas, M., Athanasiou, N., Black, M. VIBE: Video Inference for Human Pose and Shape Estimation. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 5252–5262 (IEEE, 2020).

  • Hu, F. et al. FingerTrak: Continuous 3D tracking of hand silhouettes captured by a small wrist-worn thermal camera using deep learning. Proc. ACM Interact. Mob. Wearable Ubiquitous Technology Four1–24 (2020).

  • Cao, Z., Hidalgo, G., Simon, T., Wei, S., Sheikh, Y. OpenPose: Real-time multi-person 2D pose estimation using part affinity fields. IEEE Trans. Pattern Anal. Mach. Intell. 43172–186 (2021).

    Article Google Scholar

  • Si, Y. et al. Flexible Strain Sensors for Wearable Hand Gesture Recognition: From Devices to Systems. Advanced Intelligence System Four2100046 (2022).

    Article Google Scholar

  • Zhang, Q. et al. Dynamic modeling of hand-object interaction with tactile sensing. IEEE International Conference on Intelligent Robotics and Systems 2874–2881 (IEEE, 2021).

  • Wang, S. et al. A hand gesture recognition framework using Lie group based spatio-temporal recurrent networks with multiple hand-worn motion sensors. Information science 606722–741 (2022).

    Article Google Scholar

  • Deng, L. et al. Sen-Glove: A lightweight wearable glove with soft joint sensing for finger assistance. International Conference on Robotics and Automation (ICRA)5170–5175 (IEEE, 2022).

  • Pan, J. et al. “Hybrid Flexible Bimodal Sensing Wearable Glove System for Complex Hand Gesture Recognition” ACS Sense 64156–4166 (2021).

    Article Google Scholar

  • Liu, Y., Zhang, S. & Gowda, M. NeuroPose: 3D hand pose tracking using EMG wearables. Proceedings of the Web Conference (WWW 2021), 1471–1482 (2021).

  • Denz, R. et al. A high-precision, low-budget sensor glove for trajectory model learning. 2021 20th International Conference on Advanced Robotics, ICAR 2021 1109–1115 (2021).

  • Luo, Y. Discovering patterns of human-environment interaction using scalable functional textiles (Massachusetts Institute of Technology, 2020).

  • Côté-Allard, U. et al. Deep learning for electromyographic hand gesture signal classification using transfer learning. IEEE Trans. Neurorehabilitation Engineering 27760–771 (2019).

    Article Google Scholar

  • Zhang, W. et al., “Intelligent Knee Sleeve: A Real-Time Multimodal Dataset for 3D Lower Body Motion Estimation with Smart Textiles,” IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2023).

  • Luo, Y. et al. Intelligent Carpet: Estimating 3D Human Pose from Haptic Signals. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 11255–11265 (IEEE, 2021).

  • Zhou, L., Shen, W., Liu, Y. & Zhang, Y. A scalable, durable, and seamlessly integrated knitted fabric strain sensor for tracking human motion. Advanced Materials Technology 72200082 (2022).

    Article Google Scholar

  • Brahmbhatt, S. et al. ContactPose: A dataset of object contact and grasp hand poses. Computer Vision—ECCV 2020 12358361–378 (Springer, 2020).

  • Lei, X., Sun, L., Xia, Y. Reconstructing lost data for structural health monitoring using deep convolutional generative adversarial networks. Structural Health Monitor 202069–2087 (2021).

  • Soltanian, S. et al. “High-piezoresistive Nanofiber Sensors for Tactile and Epidermal Electronic Applications” Journal of Mat Research 30121–129 (2015).

  • Soltanian, S. et al. “Highly stretchable, sparsely metallized nanofiber webs as thin, transferable transparent conductors.” Advanced Energy Matter 31332–1337 (2013).

    Article Google Scholar

  • Konku-Asase, Y., Yaya, A. & Kan-Dapaah, K. Effect of hardening temperature on tensile properties and hardness of γ-Fe.2oh3 Reinforced PDMS nanocomposites. Advanced Materials Science and Engineering 2020, 6562373 (2020).

  • Liu, Z. et al. “Functionalized Fiber-Based Strain Sensors: A Path to Next-Generation Wearable Electronics.” Nano Micro Letter 1461 (2022).

  • Ho, D. et al. Multifunctional smart textronics using blow-spun nonwoven fabrics. Advanced Function Base 291900025 (2019).

    Article Google Scholar

  • Vu, C. & Kim, J. Highly sensitive electronic textile strain sensor enhanced by geometric processing for human monitoring. sensor 202383 (2020).

    Article Google Scholar

  • Tang, Z. et al. “Highly stretchable core-sheath fibers by wet spinning for wearable strain sensors” ACS Application Material Interface Ten6624–6635 (2018).

    Article Google Scholar

  • Gao, Y. et al. 3D Printed Coaxial Fibers for Integrated Wearable Sensor Skin. Advanced Materials Technology Four1900504 (2019).

    Article Google Scholar

  • Cai, G. et al. “Highly elastic sheath-core yarn for multifunctional wearable electronic devices” ACS Application Material Interface 1229717–29727 (2020).

    Google Academic

  • Xu, L. et al. Moisture-resistant graphene-dyed wool fabrics for strain sensing. ACS Application Material Interface 1213265–13274 (2020).

    Article Google Scholar

  • Tashakori, A. arvintashakori/SmartTextileGlove: v1.0.0. Zenod https://doi.org/10.5281/zenodo.10128938 (2023).



  • Source link

    Leave a Reply

    Your email address will not be published. Required fields are marked *