{"id":7324,"date":"2021-09-02T23:34:10","date_gmt":"2021-09-02T21:34:10","guid":{"rendered":"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/"},"modified":"2021-09-02T23:34:10","modified_gmt":"2021-09-02T21:34:10","slug":"hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications","status":"publish","type":"events","link":"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/","title":{"rendered":"Hybrid Physics Colloquium: Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications"},"content":{"rendered":"<section class=\"wp-block-unilux-blocks-free-section section\"><div class=\"container xl:max-w-screen-xl\"><p><strong>Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications<\/strong><\/p><p><strong>Abstract:<\/strong><\/p><p>The surprising flexibility and undeniable empirical success of machine learning algorithms has inspired many theoretical explanations for the efficacy of neural networks. Here, I will briefly introduce one perspective that provides not only asymptotic guarantees of trainability and accuracy in high-dimensional learning problems but also provides some prescriptions and design principles for learning. Bolstered by the favorable scaling of these algorithms in high dimensional problems, I will turn to the problem of variational high dimensional PDEs. From the perspective of an applied mathematician, these problems typically appear hopeless; they are not only high-dimensional but also dominated by rare events. However, with neural networks in the toolkit, at least the dimensionality is somewhat less intimidating. I will describe an algorithm that combines stochastic gradient descent with importance sampling to optimize a function representation of the solution. Finally, I will provide numerical evidence of the power and limitations of this approach.<\/p><p><strong>Bio:<\/strong><\/p><p>Grant Rotskoff studies the nonequilibrium dynamics of living matter with a particular focus on self-organization from the molecular to the cellular scale. His work involves developing theoretical and computational tools that can probe and predict the properties of physical systems driven away from equilibrium. Recently, he has focused on characterizing and designing physically accurate machine learning techniques for biophysical modeling. Prior to his current position, Grant was a James S. McDonnell Fellow working at the Courant Institute of Mathematical Sciences at New York University. He completed his Ph.D. at the University of California, Berkeley in the Biophysics graduate group supported by an NSF Graduate Research Fellowship. His thesis, which was advised by Phillip Geissler and Gavin Crooks, developed theoretical tools for understanding non-equilibrium control of the small, fluctuating systems, such as those encountered in molecular biophysics. He also worked on coarse-grained models of the hydrophobic effect and self-assembly. Grant received an S.B. in Mathematics from the University of Chicago, where he became interested in biophysics as an undergraduate while working on free energy methods for large-scale molecular dynamics simulations.<\/p><\/div><\/section>","protected":false},"excerpt":{"rendered":"<p>Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications<\/p>\n","protected":false},"author":0,"featured_media":7325,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","format":"standard","meta":{"featured_image_focal_point":[],"show_featured_caption":false,"ulux_newsletter_groups":"","uluxPostTitle":"","uluxPrePostTitle":"","_trash_the_other_posts":false,"_price":"","_stock":"","_tribe_ticket_header":"","_tribe_default_ticket_provider":"","_tribe_ticket_capacity":"0","_ticket_start_date":"","_ticket_end_date":"","_tribe_ticket_show_description":"","_tribe_ticket_show_not_going":false,"_tribe_ticket_use_global_stock":"","_tribe_ticket_global_stock_level":"","_global_stock_mode":"","_global_stock_cap":"","_tribe_rsvp_for_event":"","_tribe_ticket_going_count":"","_tribe_ticket_not_going_count":"","_tribe_tickets_list":"[]","_tribe_ticket_has_attendee_info_fields":false,"event_start_date":"2021-09-22 16:00:00","event_end_date":"2021-09-22 17:00:00","event_speaker_name":"Talk by Assistant Professor Grant Rotskoff, invited by Dr. Matteo Polettini","event_speaker_link":"","event_is_online":false,"event_location":"Campus Limpertsberg, B\u00e2timent des Sciences, BS 0.03","event_street":"","event_location_link":"","event_zip_code":"","event_city":"","event_country":"LU"},"events-topic":[315],"events-type":[],"organisation":[80],"authorship":[],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v22.3 (Yoast SEO v22.3) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Hybrid Physics Colloquium: Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications - FSTM events I Uni.lu<\/title>\n<meta name=\"description\" content=\"Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Hybrid Physics Colloquium: Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications\" \/>\n<meta property=\"og:description\" content=\"Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/\" \/>\n<meta property=\"og:site_name\" content=\"FSTM EN\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/fstm.uni.lu\/\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/4\/2026\/03\/03111650\/FSTM_SM-Profile_1600x1600px-scaled.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"2560\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/\",\"url\":\"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/\",\"name\":\"Hybrid Physics Colloquium: Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications - FSTM events I Uni.lu\",\"isPartOf\":{\"@id\":\"https:\/\/www.uni.lu\/fstm-en\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/4\/2021\/09\/hybrid_physics_colloquium_mean_field_dynamics_in_neural_networks_implications_for_generalization_and_applications.jpg\",\"datePublished\":\"2021-09-02T21:34:10+00:00\",\"dateModified\":\"2021-09-02T21:34:10+00:00\",\"description\":\"Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications\",\"breadcrumb\":{\"@id\":\"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/#primaryimage\",\"url\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/4\/2021\/09\/hybrid_physics_colloquium_mean_field_dynamics_in_neural_networks_implications_for_generalization_and_applications.jpg\",\"contentUrl\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/4\/2021\/09\/hybrid_physics_colloquium_mean_field_dynamics_in_neural_networks_implications_for_generalization_and_applications.jpg\",\"width\":800,\"height\":600},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.uni.lu\/en\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Faculty of Science, Technology and Medicine\",\"item\":\"https:\/\/www.uni.lu\/fstm-en\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Events\",\"item\":\"https:\/\/www.uni.lu\/fstm-en\/events\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Hybrid Physics Colloquium: Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.uni.lu\/fstm-en\/#website\",\"url\":\"https:\/\/www.uni.lu\/fstm-en\/\",\"name\":\"FSTM\",\"description\":\"Faculty of Science, Technology and Medicine I Uni.lu\",\"publisher\":{\"@id\":\"https:\/\/www.uni.lu\/fstm-en\/#organization\"},\"alternateName\":\"Faculty of Science, Technology and Medicine I University of Luxembourg\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.uni.lu\/fstm-en\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.uni.lu\/fstm-en\/#organization\",\"name\":\"FSTM - University of Luxembourg I Uni.lu\",\"alternateName\":\"Faculty of Science, Technology and Medicine\",\"url\":\"https:\/\/www.uni.lu\/fstm-en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/www.uni.lu\/fstm-en\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/4\/2026\/03\/03111650\/FSTM_SM-Profile_1600x1600px-scaled.jpg\",\"contentUrl\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/4\/2026\/03\/03111650\/FSTM_SM-Profile_1600x1600px-scaled.jpg\",\"width\":2560,\"height\":2560,\"caption\":\"FSTM - University of Luxembourg I Uni.lu\"},\"image\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/4\/2026\/04\/24144328\/20200609-Belval-Campus_Henri-Goergen-23.jpg\",\"sameAs\":[\"https:\/\/www.facebook.com\/fstm.uni.lu\/\",\"https:\/\/www.linkedin.com\/showcase\/fstm-uni-lu\"],\"email\":\"communication@uni.lu\",\"telephone\":\"+3524666441\",\"address\":{\"@type\":\"PostalAddress\",\"streetAddress\":\"2, place de l\u2019Universit\u00e9\",\"addressLocality\":\"Esch-sur-Alzette\",\"postalCode\":\"4365\",\"addressCountry\":\"LU\"},\"description\":\"Faculty of Science, Technology and Medicine I Uni.lu\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Hybrid Physics Colloquium: Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications - FSTM events I Uni.lu","description":"Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/","og_locale":"en_GB","og_type":"article","og_title":"Hybrid Physics Colloquium: Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications","og_description":"Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications","og_url":"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/","og_site_name":"FSTM EN","article_publisher":"https:\/\/www.facebook.com\/fstm.uni.lu\/","og_image":[{"width":2560,"height":2560,"url":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/4\/2026\/03\/03111650\/FSTM_SM-Profile_1600x1600px-scaled.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Estimated reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/","url":"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/","name":"Hybrid Physics Colloquium: Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications - FSTM events I Uni.lu","isPartOf":{"@id":"https:\/\/www.uni.lu\/fstm-en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/#primaryimage"},"image":{"@id":"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/#primaryimage"},"thumbnailUrl":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/4\/2021\/09\/hybrid_physics_colloquium_mean_field_dynamics_in_neural_networks_implications_for_generalization_and_applications.jpg","datePublished":"2021-09-02T21:34:10+00:00","dateModified":"2021-09-02T21:34:10+00:00","description":"Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications","breadcrumb":{"@id":"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/#primaryimage","url":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/4\/2021\/09\/hybrid_physics_colloquium_mean_field_dynamics_in_neural_networks_implications_for_generalization_and_applications.jpg","contentUrl":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/4\/2021\/09\/hybrid_physics_colloquium_mean_field_dynamics_in_neural_networks_implications_for_generalization_and_applications.jpg","width":800,"height":600},{"@type":"BreadcrumbList","@id":"https:\/\/www.uni.lu\/fstm-en\/events\/hybrid-physics-colloquium-mean-field-dynamics-in-neural-networks-implications-for-generalization-and-applications\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.uni.lu\/en"},{"@type":"ListItem","position":2,"name":"Faculty of Science, Technology and Medicine","item":"https:\/\/www.uni.lu\/fstm-en\/"},{"@type":"ListItem","position":3,"name":"Events","item":"https:\/\/www.uni.lu\/fstm-en\/events\/"},{"@type":"ListItem","position":4,"name":"Hybrid Physics Colloquium: Mean-Field Dynamics in Neural Networks: Implications for Generalization and Applications"}]},{"@type":"WebSite","@id":"https:\/\/www.uni.lu\/fstm-en\/#website","url":"https:\/\/www.uni.lu\/fstm-en\/","name":"FSTM","description":"Faculty of Science, Technology and Medicine I Uni.lu","publisher":{"@id":"https:\/\/www.uni.lu\/fstm-en\/#organization"},"alternateName":"Faculty of Science, Technology and Medicine I University of Luxembourg","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.uni.lu\/fstm-en\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/www.uni.lu\/fstm-en\/#organization","name":"FSTM - University of Luxembourg I Uni.lu","alternateName":"Faculty of Science, Technology and Medicine","url":"https:\/\/www.uni.lu\/fstm-en\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.uni.lu\/fstm-en\/#\/schema\/logo\/image\/","url":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/4\/2026\/03\/03111650\/FSTM_SM-Profile_1600x1600px-scaled.jpg","contentUrl":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/4\/2026\/03\/03111650\/FSTM_SM-Profile_1600x1600px-scaled.jpg","width":2560,"height":2560,"caption":"FSTM - University of Luxembourg I Uni.lu"},"image":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/4\/2026\/04\/24144328\/20200609-Belval-Campus_Henri-Goergen-23.jpg","sameAs":["https:\/\/www.facebook.com\/fstm.uni.lu\/","https:\/\/www.linkedin.com\/showcase\/fstm-uni-lu"],"email":"communication@uni.lu","telephone":"+3524666441","address":{"@type":"PostalAddress","streetAddress":"2, place de l\u2019Universit\u00e9","addressLocality":"Esch-sur-Alzette","postalCode":"4365","addressCountry":"LU"},"description":"Faculty of Science, Technology and Medicine I Uni.lu"}]}},"_links":{"self":[{"href":"https:\/\/www.uni.lu\/fstm-en\/wp-json\/wp\/v2\/events\/7324"}],"collection":[{"href":"https:\/\/www.uni.lu\/fstm-en\/wp-json\/wp\/v2\/events"}],"about":[{"href":"https:\/\/www.uni.lu\/fstm-en\/wp-json\/wp\/v2\/types\/events"}],"replies":[{"embeddable":true,"href":"https:\/\/www.uni.lu\/fstm-en\/wp-json\/wp\/v2\/comments?post=7324"}],"version-history":[{"count":0,"href":"https:\/\/www.uni.lu\/fstm-en\/wp-json\/wp\/v2\/events\/7324\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.uni.lu\/fstm-en\/wp-json\/wp\/v2\/media\/7325"}],"wp:attachment":[{"href":"https:\/\/www.uni.lu\/fstm-en\/wp-json\/wp\/v2\/media?parent=7324"}],"wp:term":[{"taxonomy":"events-topic","embeddable":true,"href":"https:\/\/www.uni.lu\/fstm-en\/wp-json\/wp\/v2\/events-topic?post=7324"},{"taxonomy":"events-type","embeddable":true,"href":"https:\/\/www.uni.lu\/fstm-en\/wp-json\/wp\/v2\/events-type?post=7324"},{"taxonomy":"organisation","embeddable":true,"href":"https:\/\/www.uni.lu\/fstm-en\/wp-json\/wp\/v2\/organisation?post=7324"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}