{"id":1937,"date":"2024-10-02T07:00:03","date_gmt":"2024-10-02T05:00:03","guid":{"rendered":"https:\/\/neuro-x.epfl.ch\/en\/news\/modeling-the-minutia-of-motor-manipulation-with-ai-3\/"},"modified":"2024-12-10T17:23:17","modified_gmt":"2024-12-10T15:23:17","slug":"modeling-the-minutia-of-motor-manipulation-with-ai-3","status":"publish","type":"news","link":"https:\/\/neuro-x.epfl.ch\/en\/news\/modeling-the-minutia-of-motor-manipulation-with-ai-3\/","title":{"rendered":"Modeling the minutia of motor manipulation with AI"},"content":{"rendered":"<\/p>\n<p>In neuroscience and biomedical engineering, accurately modeling the complex movements of the human hand has long been a significant challenge. Current models often struggle to capture the intricate interplay between the brain's motor commands and the physical actions of muscles and tendons. This gap not only hinders scientific progress but also limits the development of effective neuroprosthetics aimed at restoring hand function for those with limb loss or paralysis.<\/p>\n<p>EPFL professor Alexander Mathis and his team have developed an AI-driven approach that significantly advances our understanding of these complex motor functions. The team used a creative machine learning strategy that combined curriculum-based reinforcement learning with detailed biomechanical simulations.<\/p>\n<blockquote class=\"blockquote\">\n<p>We\u2019re diving deep into the core principles of human motor control.<\/p>\n<footer class=\"blockquote-footer\">Alexander Mathis<\/footer>\n<\/blockquote>\n<p>Mathis's research presents a detailed, dynamic, and anatomically accurate model of hand movement that takes direct inspiration from the way humans learn intricate motor skills. This research not only won the MyoChallenge at the <a href=\"https:\/\/sites.google.com\/view\/myochallenge\">NeurIPS conference in 2022<\/a>, but the results have also been <a href=\"https:\/\/www.cell.com\/neuron\/fulltext\/S0896-6273(24)00650-0\">published in the journal <em>Neuron<\/em><\/a>.<\/p>\n<p><strong>Virtually controlling Baoding balls<\/strong><br \/> \u201cWhat excites me most about this research is that we\u2019re diving deep into the core principles of human motor control\u2014something that\u2019s been a mystery for so long. We\u2019re not just building models; we\u2019re uncovering the fundamental mechanics of how the brain and muscles work together\u201d says Mathis.<\/p>\n<p>The NeurIPS challenge by Meta motivated the EPFL team to find a new approach to a technique in AI known as reinforcement learning. The task was to build an AI that precisely manipulate two Baoding balls\u2014each controlled by 39 muscles in a highly coordinated manner. This seemingly simple task is extraordinarily difficult to replicate virtually, given the complex dynamics of hand movements, including muscle synchronization and balance maintenance.<\/p>\n<p>In this highly competitive environment, three graduate students\u2014Alberto Chiappa from Alexander Mathis\u2019 group, Pablo Tano and Nisheet Patel from Alexandre Pouget\u2019s group at the University of Geneva\u2014outperformed their rivals by a significant margin. Their AI model achieved a 100% success rate in the first phase of the competition, surpassing the closest competitor. Even in the more challenging second phase, their model showed its strength in ever more difficult situations and maintained a commanding lead to win the competition.<\/p>\n<p><strong>Breaking the tasks down in smaller parts \u2013 and repeat them<\/strong><br \/> \u201cTo win, we took inspiration from how humans learn sophisticated skills in a process known as part-to-whole training in sports science,\u201d says Mathis. This part-to-whole approach inspired the curriculum learning method used in the AI model, where the complex task of controlling hand movements was broken down into smaller, manageable parts.<\/p>\n<p>\u201cTo overcome the limitations of current machine learning models, we applied a method called curriculum learning. After 32 stages and nearly 400 hours of training, we successfully trained a neural network to accurately control a realistic model of the human hand,\u201d says Alberto Chiappa.<\/p>\n<p>A key reason for the model\u2019s success is its ability to recognize and use basic, repeatable movement patterns, known as motor primitives. In an exciting scientific twist, this approach to learning behavior could inform neuroscience about the brain\u2019s role is in determining how motor primitives are learned to master new tasks. This intricate interplay between the brain and muscle manipulation points to how challenging it can be to build machines and prosthetics that truly mimic human movement.<\/p>\n<p>\u201cYou need a large degree of movement and a model that resembles a human brain to accomplish a variety of everyday tasks. Even if each task can be broken down into smaller parts, each task needs a different set of these motor primitives to be done well,\u201d says Mathis.<\/p>\n<\/p>\n<p><strong>Harness AI in the exploration and understanding of biological systems<\/strong><\/p>\n<blockquote class=\"blockquote\">\n<p>This research gives us a solid scientific foundation that reinforces our strategy.<\/p>\n<footer class=\"blockquote-footer\">Silvestro Micera<\/footer>\n<\/blockquote>\n<p>Silvestro Micera, a leading researcher in neuroprosthetics at EPFL\u2019s Neuro X Institute and collaborator with Mathis, highlights the critical importance of this research for understanding the future potential and the current limits of even the most advanced prosthetics. \u201cWhat we really miss right now is a deeper understanding of how finger movement and grasping motor control are achieved. This work goes exactly in this very important direction,\u201d Micera notes. \u201cWe know how important it is to connect the prosthesis to the nervous system, and this research gives us a solid scientific foundation that reinforces our strategy.\u201d<\/p>\n<\/p>\n<div style=\"background:#eeeeee;border:1px solid #cccccc;padding:5px 10px\">\n<div style=\"border:1pt solid windowtext;padding:1pt 4pt;text-align:start\">\n<p>Abigail Ingster, a bachelor student at the time of the competition and recipient of <a href=\"https:\/\/www.epfl.ch\/education\/bachelor\/enhanced-learning-programs\/summer-in-the-lab-internship-program\/\">EPFL's Summer in the Lab<\/a>fellowship, played a pivotal role in analyzing the policy. With her fellowship supporting hands-on research experience, Abigail worked closely with PhD student Alberto Chiappa and Prof. Mathis to delve into the intricate workings of the AI\u2019s learned policy.<\/p>\n<\/p><\/div>\n<\/p><\/div>\n","protected":false},"featured_media":2096,"template":"","project":[],"faculty":[],"public":[],"themes":[],"news-category":[23],"class_list":["post-1937","news","type-news","status-publish","has-post-thumbnail","hentry","news-category-research"],"_links":{"self":[{"href":"https:\/\/neuro-x.epfl.ch\/en\/wp-json\/wp\/v2\/news\/1937","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/neuro-x.epfl.ch\/en\/wp-json\/wp\/v2\/news"}],"about":[{"href":"https:\/\/neuro-x.epfl.ch\/en\/wp-json\/wp\/v2\/types\/news"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/neuro-x.epfl.ch\/en\/wp-json\/wp\/v2\/media\/2096"}],"wp:attachment":[{"href":"https:\/\/neuro-x.epfl.ch\/en\/wp-json\/wp\/v2\/media?parent=1937"}],"wp:term":[{"taxonomy":"project","embeddable":true,"href":"https:\/\/neuro-x.epfl.ch\/en\/wp-json\/wp\/v2\/project?post=1937"},{"taxonomy":"faculty","embeddable":true,"href":"https:\/\/neuro-x.epfl.ch\/en\/wp-json\/wp\/v2\/faculty?post=1937"},{"taxonomy":"public","embeddable":true,"href":"https:\/\/neuro-x.epfl.ch\/en\/wp-json\/wp\/v2\/public?post=1937"},{"taxonomy":"themes","embeddable":true,"href":"https:\/\/neuro-x.epfl.ch\/en\/wp-json\/wp\/v2\/themes?post=1937"},{"taxonomy":"news-category","embeddable":true,"href":"https:\/\/neuro-x.epfl.ch\/en\/wp-json\/wp\/v2\/news-category?post=1937"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}