Perconti, P. & Plebe, A. Deep learning and cognitive science. Cognition 203, 104365. https://doi.org/10.1016/J.COGNITION.2020.104365 (2020).
Google Scholar
Turing, A. Intelligent machinery. B. Jack Copeland 395, 63 (2004).
Shin, H. I. et al. Deep learning-based quantitative analyses of spontaneous movements and their association with early neurological development in preterm infants. Sci. Rep. 12, 3138 (2022).
Google Scholar
Reich, S. et al. Novel ai driven approach to classify infant motor functions. Sci. Rep. 11, 9888 (2021).
Google Scholar
Prechtl, H. F. & Hopkins, B. Developmental transformations of spontaneous movements in early infancy. Early Hum. Dev. 14, 233–238. https://doi.org/10.1016/0378-3782(86)90184-2 (1986).
Google Scholar
Kelso, J. A. S. On the self-organizing origins of agency. Trends Cogn. Sci. 20, 490–499. https://doi.org/10.1016/j.tics.2016.04.004 (2016).
Google Scholar
Sheets-Johnstone, M. Agency: Phenomenological insights and dynamic complementarities. Hum. Psychol. 45, 1 (2017).
Rovee, C. K. & Rovee, D. T. Conjugate reinforcement of infant exploratory behavior. J. Exp. Child Psychol. 8, 33–39. https://doi.org/10.1016/0022-0965(69)90025-3 (1969).
Google Scholar
Rovee-Collier, C. K. & Gekoski, M. J. The economics of infancy: A review of conjugate reinforcement. Adv. Child Dev. Behav. 13, 195–255. https://doi.org/10.1016/S0065-2407(08)60348-1 (1979).
Google Scholar
Kelso, J. A. S. & Fuchs, A. The coordination dynamics of mobile conjugate reinforcement. Biol. Cybern. 110, 41–53. https://doi.org/10.1007/s00422-015-0676-0 (2016).
Google Scholar
Piaget, J. The origins of intelligence in children. (1952).
Bahrick, L. & Watson, J. Detection of intermodal proprioceptive-visual contingency as a potential basis of self-perception in infancy. Dev. Psychol. 5, 96 (1985).
van der Meer, A. L. Keeping the arm in the limelight: Advanced visual control of arm movements in neonates. Eur. J. Paediatr. Neurol. 1, 103–108 (1997).
Google Scholar
Gibson, E. J. & Adolph, K. E. The perceived self in infancy. Psychol. Inq. 3, 119–121. https://doi.org/10.1207/S15327965PLI0302_5 (1992).
Google Scholar
Watanabe, H., Homae, F. & Taga, G. Developmental emergence of self-referential and inhibition mechanisms of body movements underling felicitous behaviors. J. Exp. Psychol. Hum. Percept. Perform. 37, 1157–1173. https://doi.org/10.1037/A0021936 (2011).
Google Scholar
Aslin, R. Infant learning: Historical, conceptual, and methodological challenges. Wiley Online Library 19, 2–27. https://doi.org/10.1111/infa.12036 (2014).
Google Scholar
Zaadnoordijk, L., Otworowska, M., Kwisthout, J. & Hunnius, S. Can infants’ sense of agency be found in their behavior? insights from babybot simulations of the mobile-paradigm. Cognition 181, 58–64 (2018).
Google Scholar
Kelso, J. A. S. Multistability and metastability: Understanding dynamic coordination in the brain. Philos. Trans. R. Soc. B Biol. Sci. 367, 906–918. https://doi.org/10.1098/rstb.2011.0351 (2012).
Google Scholar
Fujihira, R. & Taga, G. Dynamical systems model of development of the action differentiation in early infancy: A requisite of physical agency. Biol. Cybern. 5, 1–13. https://doi.org/10.1007/s00422-023-00955 (2023).
Google Scholar
Sloan, A. T., Jones, N. A. & Kelso, J. A. S. Meaning from movement and stillness: Signatures of coordination dynamics reveal infant agency. Proc. Natl. Acad. Sci. 120, e2306732120 (2023).
Google Scholar
Thelen, E. & Fisher, D. M. From spontaneous to instrumental behavior: Kinematic analysis of movement changes during very early learning. Child Dev. 54, 129. https://doi.org/10.2307/1129869 (1983).
Google Scholar
Sargent, B., Schweighofer, N., Kubo, M. & Fetters, L. Infant exploratory learning: Influence on leg joint coordination. PLoS ONE 9, e91500. https://doi.org/10.1371/JOURNAL.PONE.0091500 (2014).
Google Scholar
Thelen, E., Kelso, J. A. S. & Fogel, A. Self-organizing systems and infant motor development. Dev. Rev. 7, 39–65 (1987).
Google Scholar
McCay, K. D., Ho, E. S. L., Marcroft, C. & Embleton, N. D. Establishing pose based features using histograms for the detection of abnormal infant movements. Science 2, 5469–5472. https://doi.org/10.1109/EMBC.2019.8857680 (2019).
Google Scholar
Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E. & Sheikh, Y. Openpose: Realtime multi-person 2d pose estimation using part affinity fields. IEEE Trans. Pattern Anal. Mach. Intell. 43, 172–186. https://doi.org/10.1109/TPAMI.2019.2929257 (2021).
Google Scholar
Hesse, N. et al. Computer vision for medical infant motion analysis: State of the art and rgb-d data set. Lecture Notes in Computer Science 11134 LNCS, 32–49, (2019). https://doi.org/10.1007/978-3-030-11024-6_3
Tsuji, T. et al. Markerless measurement and evaluation of general movements in infants. Sci. Rep. 10, 1422. https://doi.org/10.1038/s41598-020-57580-z (2020).
Google Scholar
Zhou, Y., Sun, X., Zha, Z.-J. & Zeng, W. Mict: Mixed 3d/2d convolutional tube for human action recognition. 449–458, (IEEE, 2018). https://doi.org/10.1109/CVPR.2018.00054
Liu, J., Rahmani, H., Akhtar, N. & Mian, A. Learning human pose models from synthesized data for robust rgb-d action recognition. Int. J. Comput. Vision 127, 1545–1564. https://doi.org/10.1007/s11263-019-01192-2 (2019).
Google Scholar
Luvizon, D. C., Picard, D. & Tabia, H. 2d/3d pose estimation and action recognition using multitask deep learning. 5137–5146, https://doi.org/10.1109/CVPR.2018.00539 (IEEE, 2018).
Sabour, S., Frosst, N. & Hinton, G. E. Dynamic routing between capsules. vol. 2017-Decem, 3857–3867, https://doi.org/10.48550/arxiv.1710.09829 (2017).
Hinton, G. E., Sabour, S. & Frosst, N. Matrix capsules with em routing. In International Conference on Learning Representations (2018).
Khodadadzadeh, M., Ding, X., Chaurasia, P. & Coyle, D. A hybrid capsule network for hyperspectral image classification. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 14, 11824–11839. https://doi.org/10.1109/JSTARS.2021.3126427 (2021).
Google Scholar
Aggarwal, J. & Xia, L. Human activity recognition from 3d data: A review. Pattern Recogn. Lett. 48, 70–80. https://doi.org/10.1016/j.patrec.2014.04.011 (2014).
Google Scholar
Talha, S. A. W., Hammouche, M., Ghorbel, E., Fleury, A. & Ambellouis, S. Features and classification schemes for view-invariant and real-time human action recognition. IEEE Trans. Cogn. Dev. Syst. 10, 894–902. https://doi.org/10.1109/TCDS.2018.2844279 (2018).
Google Scholar
Yan, S., Smith, J. S., Lu, W. & Zhang, B. Multibranch attention networks for action recognition in still images. IEEE Trans. Cogn. Dev. Syst. 10, 1116–1125. https://doi.org/10.1109/TCDS.2017.2783944 (2017).
Google Scholar
Ullah, A., Ahmad, J., Muhammad, K., Sajjad, M. & Baik, S. W. Action recognition in video sequences using deep bi-directional lstm with cnn features. IEEE Access 6, 1155–1166. https://doi.org/10.1109/ACCESS.2017.2778011 (2018).
Google Scholar
Nguyen-Thai, B. et al. A spatio-temporal attention-based model for infant movement assessment from videos. IEEE J. Biomed. Health Inform. 25, 3911–3920. https://doi.org/10.1109/JBHI.2021.3077957 (2021).
Google Scholar
Larsen, M. L. et al. The effect of gestational age on major neurodevelopmental disorders in preterm infants. Pediatric Res.https://doi.org/10.1038/s41390-021-01710-4 (2021).
Leo, M., Bernava, G. M., Carcagnì, P. & Distante, C. Video-based automatic baby motion analysis for early neurological disorder diagnosis: State of the art and future directions. Sensors 22, 866. https://doi.org/10.3390/s22030866 (2022).
Google Scholar
Adde, L. et al. Early prediction of cerebral palsy by computer-based video analysis of general movements: A feasibility study cpp cerebral palsy predictor gma general movement assessment. Wiley Online Library 52, 773–778. https://doi.org/10.1111/j.1469-8749.2010.03629.x (2010).
Google Scholar
Orlandi, S. et al. Detection of atypical and typical infant movements using computer-based video analysis. In 2018 40th annual international conference of the IEEE engineering in medicine and biology society (EMBC) 2018-July, 3598–3601, https://doi.org/10.1109/EMBC.2018.8513078 (2018).
Stahl, A. et al. An optical flow-based method to predict infantile cerebral palsy. IEEE Trans. Neural Syst. Rehabil. Eng. 20, 605–614. https://doi.org/10.1109/TNSRE.2012.2195030 (2012).
Google Scholar
Presti, L. L. & Cascia, M. L. 3d skeleton-based human action classification: A survey. Pattern Recogn. 53, 130–147. https://doi.org/10.1016/J.PATCOG.2015.11.019 (2016).
Google Scholar
Irshad, M. T., Nisar, M. A., Gouverneur, P., Rapp, M. & Grzegorzek, M. Ai approaches towards prechtl’s assessment of general movements: A systematic literature review. Sensors 20, 5321. https://doi.org/10.3390/s20185321 (2020).
Google Scholar
Wilson, R. B., Vangala, S., Elashoff, D., Safari, T. & Smith, B. A. Using wearable sensor technology to measure motion complexity in infants at high familial risk for autism spectrum disorder. Sensors 21, 616. https://doi.org/10.3390/s21020616 (2021).
Google Scholar
Yu, J. et al. Adaptive spatiotemporal representation learning for skeleton-based human action recognition. IEEE Trans. Cog. Dev. Syst. 2, 1–1. https://doi.org/10.1109/TCDS.2021.3131253 (2021).
Google Scholar
Sloan, A. T. Development of Infant Agency. Phd thesis, Florida Atlantic University (2022). Available at https://www.proquest.com/pagepdf/2668946050accountid=10902.
Liu, J., Shahroudy, A., Xu, D., Kot, A. C. & Wang, G. Skeleton-based action recognition using spatio-temporal lstm network with trust gates. IEEE Trans. Pattern Anal. Mach. Intell. 40, 3007–3021. https://doi.org/10.1109/TPAMI.2017.2771306 (2018).
Google Scholar
Li, S., Liu, W. & Ma, H. Attentive spatial-temporal summary networks for feature learning in irregular gait recognition. IEEE Trans. Multimedia 21, 2361–2375. https://doi.org/10.1109/TMM.2019.2900134 (2019).
Google Scholar
Fuchs, A. & Kelso, J. A. S. Coordination dynamics and synergetics: From finger movements to brain patterns and ballet dancing. Complex. Synerg. 2, 301–316 (2017).
Müller, S. C., Plath, P. J., Radons, G. & Fuchs, A. Complexity and synergetics. Complex. Syner. 1–421, https://doi.org/10.1007/978-3-319-64334-2 (2017).
Discovery of latent 3d keypoints via end-to-end geometric reasoning. In Advances in Neural Information Processing Systems 2018-December, 2059–2070, https://doi.org/10.48550/arxiv.1807.03146 (2018).
Güler, R. A., Neverova, N. & Kokkinos, I. Densepose: Dense human pose estimation in the wild. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 7297–7306, https://doi.org/10.48550/arxiv.1802.00434 (2018).
McCay, K. D. et al. Abnormal infant movements classification with deep learning on pose-based features. IEEE Access 8, 51582–51592. https://doi.org/10.1109/ACCESS.2020.2980269 (2020).
Google Scholar
Lempereur, M. et al. A new deep learning-based method for the detection of gait events in children with gait disorders: Proof-of-concept and concurrent validity. J. Biomech. 98, 109490. https://doi.org/10.1016/J.JBIOMECH.2019.109490 (2020).
Google Scholar
Cunningham, R., Sánchez, M. B., Butler, P. B., Southgate, M. J. & Loram, I. D. Fully automated image-based estimation of postural point-features in children with cerebral palsy using deep learning. R. Soc. Open Sci. 6, 639. https://doi.org/10.1098/RSOS.191011 (2019).
Google Scholar
Rueangsirarak, W., Zhang, J., Aslam, N., Ho, E. S. & Shum, H. P. Automatic musculoskeletal and neurological disorder diagnosis with relative joint displacement from human gait. IEEE Trans. Neural Syst. Rehabili. Eng. 26, 2387–2396. https://doi.org/10.1109/TNSRE.2018.2880871 (2018).
Google Scholar
Einspieler, C. & Prechtl, H. F. Prechtl’s assessment of general movements: A diagnostic tool for the functional assessment of the young nervous system. Ment. Retard. Dev. Disabil. Res. Rev. 11, 61–67 (2005).
Google Scholar
Campbell, S. K. Functional movement assessment with the test of infant motor performance. J. Perinatol. 41, 2385–2394 (2021).
Google Scholar
Chambers, C. et al. Computer vision to automatically assess infant neuromotor risk. IEEE Trans. Neural Syst. Rehabil. Eng. 28, 2431–2442 (2020).
Google Scholar
Moccia, S., Migliorelli, L., Carnielli, V. & Frontoni, E. Preterm infants’ pose estimation with spatio-temporal features. IEEE Trans. Biomed. Eng. 67, 2370–2380 (2019).
Google Scholar
Wu, Q., Xu, G., Zhang, S., Li, Y. & Wei, F. Human 3d pose estimation in a lying position by rgb-d images for medical diagnosis and rehabilitation. In 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) 5802–5805 (IEEE, 2020).
Groos, D., Adde, L., Støen, R., Ramampiaro, H. & Ihlen, E. A. Towards human-level performance on automatic pose estimation of infant spontaneous movements. Comput. Med. Imaging Gr. 95, 102012 (2022).
Google Scholar
Marchi, V. et al. Automated pose estimation captures key aspects of general movements at eight to 17 weeks from conventional videos. Acta Paediatr. 108, 1817–1824 (2019).
Google Scholar
McCay, K. D. et al. Abnormal infant movements classification with deep learning on pose-based features. IEEE Access 8, 51582–51592 (2020).
Google Scholar
Wu, Q. et al. A training-free infant spontaneous movement assessment method for cerebral palsy prediction based on videos. IEEE Trans. Neural Syst. Rehabil. Eng. 31, 1670–1679 (2023).
Google Scholar
Sakkos, D. et al. Identification of abnormal movements in infants: A deep neural network for body part-based prediction of cerebral palsy. IEEE Access 9, 94281–94292 (2021).
Google Scholar
Doi, H. et al. Prediction of autistic tendencies at 18 months of age via markerless video analysis of spontaneous body movements in 4-month-old infants. Sci. Rep. 12, 18045 (2022).
Google Scholar
Leo, M., Bernava, G. M., Carcagnì, P. & Distante, C. Video-based automatic baby motion analysis for early neurological disorder diagnosis: State of the art and future directions. Sensors 22, 866 (2022).
Google Scholar
Migliorelli, L., Moccia, S., Pietrini, R., Carnielli, V. P. & Frontoni, E. The babypose dataset. Data in brief 33, 106329 (2020).
Google Scholar
Hesse, N. et al. Computer vision for medical infant motion analysis: State of the art and rgb-d data set. In Proceedings of the European Conference on Computer Vision (ECCV) Workshops (2018).
Taylor, H. B. et al. Motor contingency learning and infants with spina bifida. J. Int. Neuropsychol. Soc. 19, 206–215 (2013).
Google Scholar
Kim, J. A. et al. Infants born preterm and infants born full-term generate more selective leg joint movement during the scaffolded mobile task. Infancy 26, 756–769 (2021).
Google Scholar
Emeli, V. & Howard, A. Towards practical deployment of a robotic mobile system for early detection of cerebral palsy in infants. In 2021 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO) 1–6 (IEEE, 2021).
Sargent, B., Kubo, M. & Fetters, L. Infant discovery learning and lower extremity coordination: Influence of prematurity. Phys. Occup. Ther. Ped. 38, 210–225 (2018).
Google Scholar
Chen, C.-Y., Harrison, T. & Heathcock, J. Infants with complex congenital heart diseases show poor short-term memory in the mobile paradigm at 3 months of age. Infant Behav. Dev. 40, 12–19 (2015).
Google Scholar
Heathcock, J. C., Bhat, A. N., Lobo, M. A. & Galloway, J. The performance of infants born preterm and full-term in the mobile paradigm: Learning and memory. Phys. Ther. 84, 808–821 (2004).
Google Scholar
Sargent, B. et al. In-home kicking-activated mobile task to motivate selective motor control of infants at high risk of cerebral palsy: A feasibility study. Phys. Ther. 100, 2217–2226 (2020).
Google Scholar
Duff, S. et al. Using contingent reinforcement to augment muscle activation after perinatal brachial plexus injury: A pilot study. Phys. Occup. Ther. Ped. 37, 555–565 (2017).
Google Scholar
Sloan, A. et al. Coordination dynamics meets active inference and artificial intelligence (cd + ai2): A multi-pronged approach to understanding the dynamics of brain and the emergence of conscious agency (2023). Society for Neuroscience; Conference date: 10-12-2023 Through 15-12-2023.
