{"id":2261,"date":"2023-03-29T11:40:14","date_gmt":"2023-03-29T09:40:14","guid":{"rendered":"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/"},"modified":"2023-03-29T11:40:14","modified_gmt":"2023-03-29T09:40:14","slug":"machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks","status":"publish","type":"events","link":"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/","title":{"rendered":"Machine Learning Seminar meeting: Learning scientific simulations with aggregation and attention-based neural networks"},"content":{"rendered":"

Abstract:<\/strong><\/p>

Deep learning approaches are being increasingly used for accelerating scientific simulations, however, they fail to perform efficiently as the size and complexity of the problem increases. In this talk, we introduce a novel geometric deep-learning framework for performing supervised learning on graph-structured data. Our approach is based on the Multi-Channel Aggregation (MAg) operation, which efficiently handles non-linear regression tasks on graph-structured data. The MAg operation is combined with our novel clique-based graph pooling layers to create a graph U-Net, named MAgNET, which is both robust and able to handle arbitrary complex meshes. Importantly, MAgNET scales efficiently with problem size. We evaluate the performance of MAgNET against Perceiver IO, a state-of-the-art attention-based neural network architecture from the same family of architectures as ChatGPT.<\/p>

Saurabh Deshpande<\/strong> is a doctoral researcher at the Department of Engineering in the Faculty of Science, Technology and Medicine of the University of Luxembourg. His research is focused on the development of novel scalable deep learning techniques for their applications in computational mechanics and computer vision.<\/p>

\u00a0<\/p>

The Machine Learning Seminar<\/strong> is a regular weekly seminar series aiming to harbour presentations of fundamental and methodological advances in data science and machine learning as well as to discuss application areas presented by domain specialists. The uniqueness of the seminar series lies in its attempt to extract common denominators between domain areas and to challenge existing methodologies. The focus is thus on theory and applications to a wide range of domains, including Computational Physics and Engineering, Computational Biology and Life Sciences, Computational Behavioural and Social Sciences. More information about the ML Seminar, together with video recordings from past meetings you will find here: https:\/\/legato-team.eu\/seminars\/<\/a><\/p><\/div><\/section>","protected":false},"excerpt":{"rendered":"","protected":false},"author":0,"featured_media":2262,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","format":"standard","meta":{"featured_image_focal_point":[],"show_featured_caption":false,"ulux_newsletter_groups":"","uluxPostTitle":"","uluxPrePostTitle":"","_trash_the_other_posts":false,"_price":"","_stock":"","_tribe_ticket_header":"","_tribe_default_ticket_provider":"","_tribe_ticket_capacity":"0","_ticket_start_date":"","_ticket_end_date":"","_tribe_ticket_show_description":"","_tribe_ticket_show_not_going":false,"_tribe_ticket_use_global_stock":"","_tribe_ticket_global_stock_level":"","_global_stock_mode":"","_global_stock_cap":"","_tribe_rsvp_for_event":"","_tribe_ticket_going_count":"","_tribe_ticket_not_going_count":"","_tribe_tickets_list":"[]","_tribe_ticket_has_attendee_info_fields":false,"event_start_date":"2023-04-26 10:00:00","event_end_date":"2023-04-26 11:00:00","event_speaker_name":"Saurabh Deshpande (Faculty of Science, Technology and Medicine; University of Luxembourg)","event_speaker_link":"","event_is_online":false,"event_location":"Fully virtual (contact Dr. Jakub Lengiewicz to register)","event_street":"","event_location_link":"","event_zip_code":"","event_city":"","event_country":"LU"},"events-topic":[302],"events-type":[],"organisation":[42,24],"authorship":[],"acf":[],"yoast_head":"\nMachine Learning Seminar meeting: Learning scientific simulations with aggregation and attention-based neural networks - FSTM I Uni.lu<\/title>\n<meta name=\"description\" content=\"Abstract:Deep learning approaches are being increasingly used for accelerating scientific simulations, however, they fail to perform efficiently as the\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Machine Learning Seminar meeting: Learning scientific simulations with aggregation and attention-based neural networks\" \/>\n<meta property=\"og:description\" content=\"Abstract:Deep learning approaches are being increasingly used for accelerating scientific simulations, however, they fail to perform efficiently as the\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/\" \/>\n<meta property=\"og:site_name\" content=\"FSTM FR\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/fstm.uni.lu\/\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/20\/2026\/03\/03111744\/FSTM_SM-Profile_1600x1600px-scaled.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"2560\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/\",\"url\":\"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/\",\"name\":\"Machine Learning Seminar meeting: Learning scientific simulations with aggregation and attention-based neural networks - FSTM I Uni.lu\",\"isPartOf\":{\"@id\":\"https:\/\/www.uni.lu\/fstm-fr\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/20\/2023\/03\/machine_learning_seminar_meeting_learning_scientific_simulations_with_aggregation_and_attention_based_neural_networks.png\",\"datePublished\":\"2023-03-29T09:40:14+00:00\",\"dateModified\":\"2023-03-29T09:40:14+00:00\",\"description\":\"Abstract:Deep learning approaches are being increasingly used for accelerating scientific simulations, however, they fail to perform efficiently as the\",\"breadcrumb\":{\"@id\":\"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/#primaryimage\",\"url\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/20\/2023\/03\/machine_learning_seminar_meeting_learning_scientific_simulations_with_aggregation_and_attention_based_neural_networks.png\",\"contentUrl\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/20\/2023\/03\/machine_learning_seminar_meeting_learning_scientific_simulations_with_aggregation_and_attention_based_neural_networks.png\",\"width\":1024,\"height\":1024},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.uni.lu\/fr\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Facult\u00e9 des Sciences, des Technologies et de M\u00e9decine\",\"item\":\"https:\/\/www.uni.lu\/fstm-fr\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Events\",\"item\":\"https:\/\/www.uni.lu\/fstm-fr\/events\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Machine Learning Seminar meeting: Learning scientific simulations with aggregation and attention-based neural networks\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.uni.lu\/fstm-fr\/#website\",\"url\":\"https:\/\/www.uni.lu\/fstm-fr\/\",\"name\":\"FSTM\",\"description\":\"Facult\u00e9 des Sciences, des Technologies et de M\u00e9decine I Uni.lu\",\"publisher\":{\"@id\":\"https:\/\/www.uni.lu\/fstm-fr\/#organization\"},\"alternateName\":\"Facult\u00e9 des Sciences, des Technologies et de M\u00e9decine I Universit\u00e9 du Luxembourg\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.uni.lu\/fstm-fr\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.uni.lu\/fstm-fr\/#organization\",\"name\":\"FSTM - Universit\u00e9 du Luxembourg I Uni.lu\",\"alternateName\":\"Facult\u00e9 des Sciences, des Technologies et de M\u00e9decine\",\"url\":\"https:\/\/www.uni.lu\/fstm-fr\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/www.uni.lu\/fstm-fr\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/20\/2026\/03\/03111744\/FSTM_SM-Profile_1600x1600px-scaled.jpg\",\"contentUrl\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/20\/2026\/03\/03111744\/FSTM_SM-Profile_1600x1600px-scaled.jpg\",\"width\":2560,\"height\":2560,\"caption\":\"FSTM - Universit\u00e9 du Luxembourg I Uni.lu\"},\"image\":{\"@id\":\"https:\/\/www.uni.lu\/fstm-fr\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/fstm.uni.lu\/\",\"https:\/\/www.linkedin.com\/showcase\/fstm-uni-lu\"]}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Machine Learning Seminar meeting: Learning scientific simulations with aggregation and attention-based neural networks - FSTM I Uni.lu","description":"Abstract:Deep learning approaches are being increasingly used for accelerating scientific simulations, however, they fail to perform efficiently as the","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/","og_locale":"fr_FR","og_type":"article","og_title":"Machine Learning Seminar meeting: Learning scientific simulations with aggregation and attention-based neural networks","og_description":"Abstract:Deep learning approaches are being increasingly used for accelerating scientific simulations, however, they fail to perform efficiently as the","og_url":"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/","og_site_name":"FSTM FR","article_publisher":"https:\/\/www.facebook.com\/fstm.uni.lu\/","og_image":[{"width":2560,"height":2560,"url":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/20\/2026\/03\/03111744\/FSTM_SM-Profile_1600x1600px-scaled.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Dur\u00e9e de lecture estim\u00e9e":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/","url":"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/","name":"Machine Learning Seminar meeting: Learning scientific simulations with aggregation and attention-based neural networks - FSTM I Uni.lu","isPartOf":{"@id":"https:\/\/www.uni.lu\/fstm-fr\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/#primaryimage"},"image":{"@id":"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/#primaryimage"},"thumbnailUrl":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/20\/2023\/03\/machine_learning_seminar_meeting_learning_scientific_simulations_with_aggregation_and_attention_based_neural_networks.png","datePublished":"2023-03-29T09:40:14+00:00","dateModified":"2023-03-29T09:40:14+00:00","description":"Abstract:Deep learning approaches are being increasingly used for accelerating scientific simulations, however, they fail to perform efficiently as the","breadcrumb":{"@id":"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/"]}]},{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/#primaryimage","url":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/20\/2023\/03\/machine_learning_seminar_meeting_learning_scientific_simulations_with_aggregation_and_attention_based_neural_networks.png","contentUrl":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/20\/2023\/03\/machine_learning_seminar_meeting_learning_scientific_simulations_with_aggregation_and_attention_based_neural_networks.png","width":1024,"height":1024},{"@type":"BreadcrumbList","@id":"https:\/\/www.uni.lu\/fstm-fr\/events\/machine-learning-seminar-meeting-learning-scientific-simulations-with-aggregation-and-attention-based-neural-networks\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.uni.lu\/fr"},{"@type":"ListItem","position":2,"name":"Facult\u00e9 des Sciences, des Technologies et de M\u00e9decine","item":"https:\/\/www.uni.lu\/fstm-fr\/"},{"@type":"ListItem","position":3,"name":"Events","item":"https:\/\/www.uni.lu\/fstm-fr\/events\/"},{"@type":"ListItem","position":4,"name":"Machine Learning Seminar meeting: Learning scientific simulations with aggregation and attention-based neural networks"}]},{"@type":"WebSite","@id":"https:\/\/www.uni.lu\/fstm-fr\/#website","url":"https:\/\/www.uni.lu\/fstm-fr\/","name":"FSTM","description":"Facult\u00e9 des Sciences, des Technologies et de M\u00e9decine I Uni.lu","publisher":{"@id":"https:\/\/www.uni.lu\/fstm-fr\/#organization"},"alternateName":"Facult\u00e9 des Sciences, des Technologies et de M\u00e9decine I Universit\u00e9 du Luxembourg","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.uni.lu\/fstm-fr\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"fr-FR"},{"@type":"Organization","@id":"https:\/\/www.uni.lu\/fstm-fr\/#organization","name":"FSTM - Universit\u00e9 du Luxembourg I Uni.lu","alternateName":"Facult\u00e9 des Sciences, des Technologies et de M\u00e9decine","url":"https:\/\/www.uni.lu\/fstm-fr\/","logo":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/www.uni.lu\/fstm-fr\/#\/schema\/logo\/image\/","url":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/20\/2026\/03\/03111744\/FSTM_SM-Profile_1600x1600px-scaled.jpg","contentUrl":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/20\/2026\/03\/03111744\/FSTM_SM-Profile_1600x1600px-scaled.jpg","width":2560,"height":2560,"caption":"FSTM - Universit\u00e9 du Luxembourg I Uni.lu"},"image":{"@id":"https:\/\/www.uni.lu\/fstm-fr\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/fstm.uni.lu\/","https:\/\/www.linkedin.com\/showcase\/fstm-uni-lu"]}]}},"_links":{"self":[{"href":"https:\/\/www.uni.lu\/fstm-fr\/wp-json\/wp\/v2\/events\/2261"}],"collection":[{"href":"https:\/\/www.uni.lu\/fstm-fr\/wp-json\/wp\/v2\/events"}],"about":[{"href":"https:\/\/www.uni.lu\/fstm-fr\/wp-json\/wp\/v2\/types\/events"}],"replies":[{"embeddable":true,"href":"https:\/\/www.uni.lu\/fstm-fr\/wp-json\/wp\/v2\/comments?post=2261"}],"version-history":[{"count":0,"href":"https:\/\/www.uni.lu\/fstm-fr\/wp-json\/wp\/v2\/events\/2261\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.uni.lu\/fstm-fr\/wp-json\/wp\/v2\/media\/2262"}],"wp:attachment":[{"href":"https:\/\/www.uni.lu\/fstm-fr\/wp-json\/wp\/v2\/media?parent=2261"}],"wp:term":[{"taxonomy":"events-topic","embeddable":true,"href":"https:\/\/www.uni.lu\/fstm-fr\/wp-json\/wp\/v2\/events-topic?post=2261"},{"taxonomy":"events-type","embeddable":true,"href":"https:\/\/www.uni.lu\/fstm-fr\/wp-json\/wp\/v2\/events-type?post=2261"},{"taxonomy":"organisation","embeddable":true,"href":"https:\/\/www.uni.lu\/fstm-fr\/wp-json\/wp\/v2\/organisation?post=2261"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}