Machine learning for micro- and nanorobots

Machine Learning


  • Jordan, M. I. & Mitchell, T. M. Machine learning: trends, perspectives and prospects. Science 349, 255–260 (2015).

    Article 
    MathSciNet 

    Google Scholar 

  • LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436–444 (2015).

    Article 

    Google Scholar 

  • Wang, F.-Y., Yang, J., Wang, X., Li, J. & Han, Q.-L. Chat with ChatGPT on industry 5.0: learning and decision-making for intelligent industries. IEEE/CAA J. Autom. Sin. 10, 831–834 (2023).

    Google Scholar 

  • Muhammad, K., Ullah, A., Lloret, J., Del Ser, J. & de Albuquerque, V. H. C. Deep learning for safe autonomous driving: current challenges and future directions. IEEE Trans. Intell. Transport. Syst. 22, 4316–4336 (2020).

    Article 

    Google Scholar 

  • Zhu, Z. & Zhao, H. A survey of deep RL and IL for autonomous driving policy learning. IEEE Trans. Intell. Transport. Syst. 23, 14043–14065 (2022).

    Article 

    Google Scholar 

  • Almalioglu, Y., Turan, M., Trigoni, N. & Markham, A. Deep learning-based robust positioning for all-weather autonomous driving. Nat. Mach. Intell. 4, 749–760 (2022).

    Article 

    Google Scholar 

  • Wang, H. et al. Scientific discovery in the age of artificial intelligence. Nature 620, 47–60 (2023).

    Article 

    Google Scholar 

  • Greener, J. G., Kandathil, S. M., Moffat, L. & Jones, D. T. A guide to machine learning for biologists. Nat. Rev. Mol. Cell Biol. 23, 40–55 (2022).

    Article 

    Google Scholar 

  • Miki, T. et al. Learning robust perceptive locomotion for quadrupedal robots in the wild. Sci. Robot. 7, eabk2822 (2022).

    Article 

    Google Scholar 

  • Ju, H., Juan, R., Gomez, R., Nakamura, K. & Li, G. Transferring policy of deep reinforcement learning from simulation to reality for robotics. Nat. Mach. Intell. 4, 1077–1087 (2022).

    Article 

    Google Scholar 

  • Iqbal, A., Gao, Y. & Gu, Y. Provably stabilizing controllers for quadrupedal robot locomotion on dynamic rigid platforms. IEEE/ASME Trans. Mechatronics 25, 2035–2044 (2020).

    Google Scholar 

  • Brunke, L. et al. Safe learning in robotics: from learning-based control to safe reinforcement learning. Annu. Rev. Control Robot. Auton. Syst. 5, 411–444 (2022).

    Article 

    Google Scholar 

  • Saeidi, H. et al. Autonomous robotic laparoscopic surgery for intestinal anastomosis. Sci. Robot. 7, eabj2908 (2022).

    Article 

    Google Scholar 

  • Niroui, F., Zhang, K., Kashino, Z. & Nejat, G. Deep reinforcement learning robot for search and rescue applications: exploration in unknown cluttered environments. IEEE Robot. Autom. Lett. 4, 610–617 (2019).

    Article 

    Google Scholar 

  • Yang, C., Yuan, K., Zhu, Q., Yu, W. & Li, Z. Multi-expert learning of adaptive legged locomotion. Sci. Robot. 5, eabb2174 (2020).

    Article 

    Google Scholar 

  • Nelson, B. J., Kaliakatsos, I. K. & Abbott, J. J. Microrobots for minimally invasive medicine. Annu. Rev. Biomed. Eng. 12, 55–85 (2010).

    Article 

    Google Scholar 

  • Ceylan, H., Yasa, I. C., Kilic, U., Hu, W. & Sitti, M. Translational prospects of untethered medical microrobots. Prog. Biomed. Eng. 1, 012002 (2019).

    Article 

    Google Scholar 

  • Schmidt, C. K., Medina-Sánchez, M., Edmondson, R. J. & Schmidt, O. G. Engineering microrobots for targeted cancer therapies from a medical perspective. Nat. Commun. 11, 5618 (2020).

    Article 

    Google Scholar 

  • Demir, S. O. et al. Task space adaptation via the learning of gait controllers of magnetic soft millirobots. Int. J. Robot. Res. 40, 1331–1351 (2021).

    Article 

    Google Scholar 

  • Yang, Y., Bevan, M. A. & Li, B. Efficient navigation of colloidal robots in an unknown environment via deep reinforcement learning. Adv. Intell. Syst. 2, 1900106 (2020).

    Article 

    Google Scholar 

  • Yang, L. et al. Autonomous environment-adaptive microrobot swarm navigation enabled by deep learning-based real-time distribution planning. Nat. Mach. Intell. 4, 480–493 (2022).

    Article 

    Google Scholar 

  • Purcell, E. M. Life at low Reynolds number. Am. J. Phys. 45, 3–11 (1977).

    Article 

    Google Scholar 

  • Xu, S., Liu, J., Yang, C., Wu, X. & Xu, T. A learning-based stable servo control strategy using broad learning system applied for microrobotic control. IEEE Trans. Cybern. 52, 13727–13737 (2021).

    Article 

    Google Scholar 

  • Colabrese, S., Gustavsson, K., Celani, A. & Biferale, L. Flow navigation by smart microswimmers via reinforcement learning. Phys. Rev. Lett. 118, 158004 (2017).

    Article 

    Google Scholar 

  • Verma, S., Novati, G. & Koumoutsakos, P. Efficient collective swimming by harnessing vortices through deep reinforcement learning. Proc. Natl Acad. Sci. USA 115, 5849–5854 (2018).

    Article 

    Google Scholar 

  • El Khiyati, Z., Chesneaux, R., Giraldi, L. & Bec, J. Steering undulatory micro-swimmers in a fluid flow through reinforcement learning. Eur. Phys. J. E 46, 43 (2023).

    Article 

    Google Scholar 

  • Palagi, S. et al. Structured light enables biomimetic swimming and versatile locomotion of photoresponsive soft microrobots. Nat. Mater. 15, 647–653 (2016).

    Article 

    Google Scholar 

  • Ebrahimi, N. et al. Magnetic actuation methods in bio/soft robotics. Adv. Funct. Mater. 31, 2005137 (2021).

    Article 

    Google Scholar 

  • Hu, W., Lum, G. Z., Mastrangeli, M. & Sitti, M. Small-scale soft-bodied robot with multimodal locomotion. Nature 554, 81–85 (2018).

    Article 

    Google Scholar 

  • Huang, H.-W. et al. Adaptive locomotion of artificial microswimmers. Sci. Adv. 5, eaau1532 (2019).

    Article 

    Google Scholar 

  • Du, X. et al. Reconfiguration, camouflage and color-shifting for bioinspired adaptive hydrogel-based millirobots. Adv. Funct. Mater. 30, 1909202 (2020).

    Article 

    Google Scholar 

  • Fan, X., Sun, M., Sun, L. & Xie, H. Ferrofluid droplets as liquid microrobots with multiple deformabilities. Adv. Funct. Mater. 30, 2000138 (2020).

    Article 

    Google Scholar 

  • Jang, B. et al. Undulatory locomotion of magnetic multilink nanoswimmers. Nano Lett. 15, 4829–4833 (2015).

    Article 

    Google Scholar 

  • Xie, H. et al. Reconfigurable magnetic microrobot swarm: multimode transformation, locomotion and manipulation. Sci. Robot. 4, eaav8006 (2019).

    Article 

    Google Scholar 

  • Yu, J. et al. Active generation and magnetic actuation of microrobotic swarms in bio-fluids. Nat. Commun. 10, 5631 (2019).

    Article 

    Google Scholar 

  • Yang, L. et al. A survey on swarm microrobotics. IEEE Trans. Robot. 38, 1531–1551 (2021).

    Article 

    Google Scholar 

  • Law, J. et al. Microrobotic swarms for selective embolization. Sci. Adv. 8, eabm5752 (2022).

    Article 

    Google Scholar 

  • Felfoul, O. et al. Magneto-aerotactic bacteria deliver drug-containing nanoliposomes to tumour hypoxic regions. Nat. Nanotechnol. 11, 941–947 (2016).

    Article 

    Google Scholar 

  • Aziz, A. et al. Medical imaging of microrobots: toward in vivo applications. ACS Nano 14, 10865–10893 (2020).

    Article 

    Google Scholar 

  • Dorigo, M., Theraulaz, G. & Trianni, V. Reflections on the future of swarm robotics. Sci. Robot. 5, eabe4385 (2020).

    Article 

    Google Scholar 

  • Rubenstein, M., Cornejo, A. & Nagpal, R. Programmable self-assembly in a thousand-robot swarm. Science 345, 795–799 (2014).

    Article 

    Google Scholar 

  • Yu, J. et al. Adaptive pattern and motion control of magnetic microrobotic swarms. IEEE Trans. Robot. 38, 1552–1570 (2021).

    Article 

    Google Scholar 

  • Abpeikar, S., Kasmarik, K., Tran, P. V. & Garratt, M. Transfer learning for autonomous recognition of swarm behaviour in UGVs. In Proc. Australasian Joint Conference on Artificial Intelligence 531–542 (Springer, 2022).

  • Kim, H., Cheang, U. K., Rogowski, L. W. & Kim, M. J. Motion planning of particle based microrobots for static obstacle avoidance. J. Micro Bio Robot. 14, 41–49 (2018).

    Article 

    Google Scholar 

  • Yang, L., Zhang, Y., Wang, Q., Chan, K.-F. & Zhang, L. Automated control of magnetic spore-based microrobot using fluorescence imaging for targeted delivery with cellular resolution. IEEE Trans. Autom. Sci. Eng. 17, 490–501 (2019).

    Article 

    Google Scholar 

  • Meng, K. et al. Motion planning and robust control for the endovascular navigation of a microrobot. IEEE Trans. Industr. Inform. 16, 4557–4566 (2019).

    Article 

    Google Scholar 

  • Fan, Q., Cui, G., Zhao, Z. & Shen, J. Obstacle avoidance for microrobots in simulated vascular environment based on combined path planning. IEEE Robot. Autom. Lett. 7, 9794–9801 (2022).

    Article 

    Google Scholar 

  • Ni, Y. et al. Data-driven navigation of ferromagnetic soft continuum robots based on machine learning. Adv. Intell. Syst. 5, 2200167 (2023).

    Article 

    Google Scholar 

  • Wang, B. et al. Endoscopy-assisted magnetic navigation of biohybrid soft microrobots with rapid endoluminal delivery and imaging. Sci. Robot. 6, eabd2813 (2021).

    Article 
    MathSciNet 

    Google Scholar 

  • Marturi, N., Tamadazte, B., Dembélé, S. & Piat, N. Image-guided nanopositioning scheme for SEM. IEEE Trans. Autom. Sci. Eng. 15, 45–56 (2016).

    Article 

    Google Scholar 

  • Bergeles, C., Kratochvil, B. E. & Nelson, B. J. Visually servoing magnetic intraocular microdevices. IEEE Trans. Robot. 28, 798–809 (2012).

    Article 

    Google Scholar 

  • Minaee, S. et al. Image segmentation using deep learning: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 44, 3523–3542 (2021).

    Google Scholar 

  • Golestanian, R., Liverpool, T. & Ajdari, A. Designing phoretic micro- and nano-swimmers. New J. Phys. 9, 126 (2007).

    Article 

    Google Scholar 

  • Jia, Y., Hou, X., Wang, Z. & Hu, X. Machine learning boosts the design and discovery of nanomaterials. ACS Sustain. Chem. Eng. 9, 6130–6147 (2021).

    Article 

    Google Scholar 

  • Rosen, A. S. et al. Machine learning the quantum-chemical properties of metal-organic frameworks for accelerated materials discovery. Matter 4, 1578–1597 (2021).

    Article 

    Google Scholar 

  • Réda, C., Kaufmann, E. & Delahaye-Duriez, A. Machine learning applications in drug development. Comput. Struct. Biotechnol. J. 18, 241–252 (2020).

    Article 

    Google Scholar 

  • Liao, T. et al. Data-efficient learning of morphology and controller for a microrobot. In Proc. 2019 International Conference on Robotics and Automation (ICRA) 2488–2494 (IEEE, 2019).

  • Zeng, M., Yuan, S., Huang, D. & Cheng, Z. Accelerated design of catalytic water-cleaning nanomotors via machine learning. ACS Appl. Mater. Interfaces 11, 40099–40106 (2019).

    Article 

    Google Scholar 

  • Lloyd, P. et al. A learnt approach for the design of magnetically actuated shape forming soft tentacle robots. IEEE Robot. Autom. Lett. 5, 3937–3944 (2020).

    Article 

    Google Scholar 

  • Wang, L. et al. Evolutionary design of magnetic soft continuum robots. Proc. Natl Acad. Sci. USA 118, e2021922118 (2021).

    Article 

    Google Scholar 

  • Kim, Y. et al. Telerobotic neurovascular interventions with magnetic manipulation. Sci. Robot. 7, eabg9907 (2022).

    Article 

    Google Scholar 

  • Abbott, J. J., Diller, E. & Petruska, A. J. Magnetic methods in robotics. Annu. Rev. Control Robot. Auton. Syst. 3, 57–90 (2020).

    Article 

    Google Scholar 

  • Mohanty, S., Khalil, I. S. & Misra, S. Contactless acoustic micro/nano manipulation: a paradigm for next generation applications in life sciences. Proc. R. Soc. A 476, 20200621 (2020).

    Article 

    Google Scholar 

  • Palagi, S., Singh, D. P. & Fischer, P. Light-controlled micromotors and soft microrobots. Adv. Opt. Mater. 7, 1900370 (2019).

    Article 

    Google Scholar 

  • Gao, W., Pei, A. & Wang, J. Water-driven micromotors. ACS Nano 6, 8432–8438 (2012).

    Article 

    Google Scholar 

  • Martel, S. Bacterial microsystems and microrobots. Biomed. Microdevices 14, 1033–1045 (2012).

    Article 

    Google Scholar 

  • Yu, R. et al. Modeling electromagnetic navigation systems for medical applications using random forests and artificial neural networks. In Proc. 2020 IEEE International Conference on Robotics and Automation (ICRA) 9251–9256 (IEEE, 2020).

  • Li, J., Esteban-Fernández de Ávila, B., Gao, W., Zhang, L. & Wang, J. Micro/nanorobots for biomedicine: delivery, surgery, sensing and detoxification. Sci. Robot. 2, eaam6431 (2017).

    Article 

    Google Scholar 

  • Caciagli, A., Baars, R. J., Philipse, A. P. & Kuipers, B. W. Exact expression for the magnetic field of a finite cylinder with arbitrary uniform magnetization. J. Magn. Magn. Mater. 456, 423–432 (2018).

    Article 

    Google Scholar 

  • Son, D., Dong, X. & Sitti, M. A simultaneous calibration method for magnetic robot localization and actuation systems. IEEE Trans. Robot. 35, 343–352 (2018).

    Article 

    Google Scholar 

  • Petruska, A. J., Edelmann, J. & Nelson, B. J. Model-based calibration for magnetic manipulation. IEEE Trans. Magn. 53, 1–6 (2017).

    Article 

    Google Scholar 

  • Spantideas, S. T., Giannopoulos, A. E., Kapsalis, N. C. & Capsalis, C. N. A deep learning method for modeling the magnetic signature of spacecraft equipment using multiple magnetic dipoles. IEEE Magn. Lett. 12, 1–5 (2021).

    Article 

    Google Scholar 

  • Charreyron, S. L. et al. Modeling electromagnetic navigation systems. IEEE Trans. Robot. 37, 1009–1021 (2021).

    Article 

    Google Scholar 

  • Ahmed, D. et al. Bioinspired acousto-magnetic microswarm robots with upstream motility. Nat. Mach. Intell. 3, 116–124 (2021).

    Article 

    Google Scholar 

  • Marzo, A. & Drinkwater, B. W. Holographic acoustic tweezers. Proc. Natl Acad. Sci. USA 116, 84–89 (2019).

    Article 

    Google Scholar 

  • Marzo, A. et al. Holographic acoustic elements for manipulation of levitated objects. Nat. Commun. 6, 8661 (2015).

    Article 

    Google Scholar 

  • Melde, K., Mark, A. G., Qiu, T. & Fischer, P. Holograms for acoustics. Nature 537, 518–522 (2016).

    Article 

    Google Scholar 

  • Zhong, C., Jia, Y., Jeong, D. C., Guo, Y. & Liu, S. AcousNet: a deep learning based approach to dynamic 3D holographic acoustic field generation from phased transducer array. IEEE Robot. Autom. Lett. 7, 666–673 (2021).

    Article 

    Google Scholar 

  • Zhong, C. et al. Real-time acoustic holography with physics-based deep learning for robotic manipulation. In Proc. IEEE Transactions on Automation Science and Engineering 1–10 (IEEE, 2023).

  • Aleyev, Y. G. Nekton (Springer, 2012).

  • Daghooghi, M. & Borazjani, I. The hydrodynamic advantages of synchronized swimming in a rectangular pattern. Bioinspir. Biomim. 10, 056018 (2015).

    Article 

    Google Scholar 

  • Meir, Y. et al. Efficient shallow learning as an alternative to deep learning. Sci. Rep. 13, 5423 (2023).

    Article 

    Google Scholar 

  • von Rohr, A., Trimpe, S., Marco, A., Fischer, P. & Palagi, S. Gait learning for soft microrobots controlled by light fields. In Proc. 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 6199–6206 (IEEE, 2018).

  • Yang, B. et al. Learning flexible and reusable locomotion primitives for a microrobot. IEEE Robot. Autom. Lett. 3, 1904–1911 (2018).

    Article 

    Google Scholar 

  • Schneider, E. & Stark, H. Optimal steering of a smart active particle. Europhys. Lett. 127, 64003 (2019).

    Article 

    Google Scholar 

  • Qin, K., Zou, Z., Zhu, L. & Pak, O. S. Reinforcement learning of a multi-link swimmer at low Reynolds numbers. Phys. Fluids 35, 032003 (2023).

    Article 

    Google Scholar 

  • Tsang, A. C. H., Tong, P. W., Nallan, S. & Pak, O. S. Self-learning how to swim at low Reynolds number. Phys. Rev. Fluids 5, 074101 (2020).

    Article 

    Google Scholar 

  • Abdi, H. & Pishkenari, H. N. Self-learning swimming of a three-disk microrobot in a viscous and stochastic environment using reinforcement learning. Eng. Appl. Artif. Intell. 123, 106188 (2023).

    Article 

    Google Scholar 

  • Yu, H. et al. Deep-reinforcement-learning-based self-organization of freely undulatory swimmers. Phys. Rev. E 105, 045105 (2022).

    Article 
    MathSciNet 

    Google Scholar 

  • Zou, Z., Liu, Y., Young, Y.-N., Pak, O. S. & Tsang, A. C. Gait switching and targeted navigation of microswimmers via deep reinforcement learning. Commun. Phys. 5, 158 (2022).

    Article 

    Google Scholar 

  • Salehizadeh, M. & Diller, E. D. Path planning and tracking for an underactuated two-microrobot system. IEEE Robot. Autom. Lett. 6, 2674–2681 (2021).

    Article 

    Google Scholar 

  • Yang, Y., Bevan, M. A. & Li, B. Hierarchical planning with deep reinforcement learning for 3D navigation of microrobots in blood vessels. Adv. Intell. Syst. 4, 2200168 (2022).

    Article 

    Google Scholar 

  • Alageshan, J. K., Verma, A. K., Bec, J. & Pandit, R. Machine learning strategies for path-planning microswimmers in turbulent flows. Phys. Rev. E 101, 043110 (2020).

    Article 

    Google Scholar 

  • Biferale, L., Bonaccorso, F., Buzzicotti, M., Clark Di Leoni, P. & Gustavsson, K. Zermeloas problem: optimal point-to-point navigation in 2D turbulent flows using reinforcement learning. Chaos 29, 103138 (2019).

    Article 
    MathSciNet 

    Google Scholar 

  • Banerjee, A. G., Rajasekaran, K. & Parsa, B. A step toward learning to control tens of optically actuated microrobots in three dimensions. In Proc. 2018 IEEE 14th International Conference on Automation Science and Engineering (CASE) 1460–1465 (IEEE, 2018).

  • Jiang, J., Yang, L. & Zhang, L. DQN-based on-line path planning method for automatic navigation of miniature robots. In Proc. 2023 IEEE International Conference on Robotics and Automation (ICRA) 5407–5413 (IEEE, 2023).

  • Cenev, Z., Venäläinen, J., Sariola, V. & Zhou, Q. Object tracking in robotic micromanipulation by supervised ensemble learning classifier. In Proc. 2016 International Conference on Manipulation, Automation and Robotics at Small Scales (MARSS) 1–5 (IEEE, 2016).

  • Pane, S., Faoro, G., Sinibaldi, E., Iacovacci, V. & Menciassi, A. Ultrasound acoustic phase analysis enables robotic visual-servoing of magnetic microrobots. IEEE Trans. Robot. 38, 1571–1582 (2022).

    Article 

    Google Scholar 

  • Nguyen, K. T. et al. Guide-wired helical microrobot for percutaneous revascularization in chronic total occlusion in-vivo validation. IEEE Trans. Biomed. Eng. 68, 2490–2498 (2020).

    Article 

    Google Scholar 

  • Dahmen, C., Belharet, K., Folio, D., Ferreira, A. & Fatikow, S. MRI-based dynamic tracking of an untethered ferromagnetic microcapsule navigating in liquid. Int. J. Optomechatronics 10, 73–96 (2016).

    Article 

    Google Scholar 

  • Go, G. et al. Multifunctional microrobot with real-time visualization and magnetic resonance imaging for chemoembolization therapy of liver cancer. Sci. Adv. 8, eabq8545 (2022).

    Article 

    Google Scholar 

  • Tiryaki, M. E. & Sitti, M. Magnetic resonance imaging-based tracking and navigation of submillimeter-scale wireless magnetic robots. Adv. Intell. Syst. 4, 2100178 (2022).

    Article 

    Google Scholar 

  • Wu, Z. et al. A microrobotic system guided by photoacoustic computed tomography for targeted navigation in intestines in vivo. Sci. Robot. 4, eaax0613 (2019).

    Article 

    Google Scholar 

  • Marturi, N., Tamadazte, B., Dembélé, S. & Piat, N. Image-guided nanopositioning scheme for sem. IEEE Trans. Autom. Sci. Eng. 15, 45–56 (2018).

    Article 

    Google Scholar 

  • Zhang, D. et al. Data-driven microscopic pose and depth estimation for optical microrobot manipulation. ACS Photonics 7, 3003–3014 (2020).

    Article 

    Google Scholar 

  • Tiryaki, M. E., Demir, S. O. & Sitti, M. Deep learning-based 3D magnetic microrobot tracking using 2D MR images. IEEE Robot. Autom. Lett. 7, 6982–6989 (2022).

    Article 

    Google Scholar 

  • Bae, J. P., Yoon, S., Vania, M. & Lee, D. Three dimensional microrobot tracking using learning-based system. Int. J. Control Autom. Syst. 18, 21–28 (2020).

    Article 

    Google Scholar 

  • Ren, Y. et al. Machine learning-based real-time localization and automatic trapping of multiple microrobots in optical tweezer. In Proc. 2022 International Conference on Manipulation, Automation and Robotics at Small Scales (MARSS) 1–6 (IEEE, 2022).

  • Botros, K., Alkhatib, M., Folio, D. & Ferreira, A. Fully automatic and real-time microrobot detection and tracking based on ultrasound imaging using deep learning. In Proc. 2022 International Conference on Robotics and Automation (ICRA) 9763–9768 (IEEE, 2022).

  • Liu, X. et al. Capsule robot pose and mechanism state detection in ultrasound using attention-based hierarchical deep learning. Sci. Rep. 12, 21130 (2022).

    Article 

    Google Scholar 

  • Zhu, K. & Zhang, T. Deep reinforcement learning based mobile robot navigation: a review. Tsinghua Sci. Technol. 26, 674–691 (2021).

    Article 

    Google Scholar 

  • Behrens, M. R. & Ruder, W. C. Smart magnetic microrobots learn to swim with deep reinforcement learning. Adv. Intell. Syst. 4, 2200023 (2022).

    Article 

    Google Scholar 

  • Muiños-Landin, S., Fischer, A., Holubec, V. & Cichos, F. Reinforcement learning with artificial microswimmers. Sci. Robot. 6, eabd9285 (2021).

    Article 

    Google Scholar 

  • Yang, Z. et al. SerpenBot, a laser driven locomotive microrobot for dry environments using learning control. In Proc. 2022 International Conference on Manipulation, Automation and Robotics at Small Scales (MARSS) 1–6 (IEEE, 2022).

  • Schrage, M., Medany, M. & Ahmed, D. Ultrasound microrobots with reinforcement learning. Adv. Mater. Technol. 8, 2201702 (2023).

    Article 

    Google Scholar 

  • Yang, Y., Bevan, M. A. & Li, B. Micro/nano motor navigation and localization via deep reinforcement learning. Adv. Theory Simulations 3, 2000034 (2020).

    Article 

    Google Scholar 

  • Laurent, G. Online learning for micro-object manipulation. In Markov Decision Processes in Artificial Intelligence (eds Sigaud, O. & Buffet, O.) 361–374 (Wiley, 2013).

  • Abe, T., Oh-hara, S. & Ukita, Y. Integration of deep reinforcement learning to simple microfluidic system toward intelligent control: demonstration of simultaneous microbeads manipulation. Sens. Actuators B Chem. 397, 134636 (2023).

    Article 

    Google Scholar 

  • Zhang, D. et al. Micro-object pose estimation with sim-to-real transfer learning using small dataset. Commun. Phys. 5, 80 (2022).

    Article 

    Google Scholar 

  • Botros, K., Alkhatib, M., Folio, D. & Ferreira, A. USMicroMagSet: using deep learning analysis to benchmark the performance of microrobots in ultrasound images. IEEE Robot. Autom. Lett. 8, 3254–3261 (2023).

    Article 

    Google Scholar 

  • Dijk, T. V. & Croon, G. D. How do neural networks see depth in single images? In Proc. IEEE/CVF International Conference on Computer Vision 2183–2191 (IEEE, 2019).

  • Yu, Y. et al. White-box transformers via sparse rate reduction. Adv. Neural Inf. Process. Syst. 36, 9422–9457 (2023).

    Google Scholar 

  • Lai, X. et al. LISA: reasoning segmentation via large language model. Preprint at https://arxiv.org/abs/2308.00692 (2023).

  • Garattoni, L. & Birattari, M. Autonomous task sequencing in a robot swarm. Sci. Robot. 3, eaat0430 (2018).

    Article 

    Google Scholar 

  • Bousmalis, K. et al. RoboCat: a self-improving foundation agent for robotic manipulation. Preprint at https://arxiv.org/abs/2306.11706 (2023).

  • Singh, I. et al. ProgPrompt: generating situated robot task plans using large language models. In Proc. 2023 IEEE International Conference on Robotics and Automation (ICRA) 11523–11530 (IEEE, 2023).

  • Nelson, B. J., Gervasoni, S., Chiu, P. W., Zhang, L. & Zemmar, A. Magnetically actuated medical robots: an in vivo perspective. Proc. IEEE 110, 1028–1037 (2022).

    Article 

    Google Scholar 



  • Source link

    Leave a Reply

    Your email address will not be published. Required fields are marked *