{"id":8205,"date":"2020-02-17T13:51:39","date_gmt":"2020-02-17T12:51:39","guid":{"rendered":"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/"},"modified":"2020-02-17T13:51:39","modified_gmt":"2020-02-17T12:51:39","slug":"research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models","status":"publish","type":"events","link":"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/","title":{"rendered":"Research Seminar: Perturbation Validation: A New Heuristic to Validate Machine Learning Models"},"content":{"rendered":"<section class=\"wp-block-unilux-blocks-free-section section\"><div class=\"container xl:max-w-screen-xl\"><p>This talk introduces Perturbation Validation (PV), a new technique to validate machine learning models. PV does not rely on test data. Instead, it perturbs training data labels, re-trains the model against the perturbed data, then uses the consequent training accuracy decrease rate to assess model relevance. This is also different from traditional statistical approaches, which make judgements based on original training accuracy. We evaluated PV on\u00a010 real-world data sets and 6 synthetic data sets.<\/p><p>Our results demonstrate that PV is more discriminating about model fit than existing validation approaches and it accords well with widely-held intuitions concerning the properties of a good model fit measurement. We also show that the complement of PV and existing validations allow us to disentangle some of the issues present in the recently debated apparent paradox\u00a0\u00bb that high capacity, potentially overfitted\u00a0\u00bb models may nevertheless, exhibit good generalisation ability.<\/p><p><strong>Jie Zhang<\/strong> is a research fellow at CREST, UCL, working with Prof. Mark Harman. She got her PhD degree at Peking University in 2018. She won the 2016 MSRA Fellowship, the Top-ten Research Excellence Award of EECS, Peking University, and the 2015 National Scholarship. She is the co-chair of ASE SRC 2019 and Mutation 2020, and the program committee member of FSE 2020, ISSTA 2020, ASE 2020, 2019. Her major research interests are software testing and machine learning testing.<\/p><p><a href=\"https:\/\/sites.google.com\/view\/jie-zhang\/home\" target=\"_self\" title=\"\" rel=\"noopener\">Homepage<\/a><\/p><\/div><\/section>","protected":false},"excerpt":{"rendered":"","protected":false},"author":0,"featured_media":8206,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","format":"standard","meta":{"featured_image_focal_point":[],"show_featured_caption":false,"ulux_newsletter_groups":"","uluxPostTitle":"","uluxPrePostTitle":"","_trash_the_other_posts":false,"_price":"","_stock":"","_tribe_ticket_header":"","_tribe_default_ticket_provider":"","_tribe_ticket_capacity":"0","_ticket_start_date":"","_ticket_end_date":"","_tribe_ticket_show_description":"","_tribe_ticket_show_not_going":false,"_tribe_ticket_use_global_stock":"","_tribe_ticket_global_stock_level":"","_global_stock_mode":"","_global_stock_cap":"","_tribe_rsvp_for_event":"","_tribe_ticket_going_count":"","_tribe_ticket_not_going_count":"","_tribe_tickets_list":"[]","_tribe_ticket_has_attendee_info_fields":false,"event_start_date":"2020-03-02 14:00:00","event_end_date":"2020-03-02 15:00:00","event_speaker_name":"Jie Zhang, UCL","event_speaker_link":"","event_is_online":false,"event_location":"Room E004\r\nJFK Building\r\n29 Avenue J.F. Kennedy\r\nL-1855 Kirchberg","event_street":"","event_location_link":"","event_zip_code":"","event_city":"","event_country":"LU"},"events-topic":[],"events-type":[],"organisation":[184,226],"authorship":[],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v22.3 (Yoast SEO v22.3) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Research Seminar: Perturbation Validation: A New Heuristic to Validate Machine Learning Models - Universit\u00e9 du Luxembourg<\/title>\n<meta name=\"description\" content=\"This talk introduces Perturbation Validation (PV), a new technique to validate machine learning models. PV does not rely on test data. Instead, it\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Research Seminar: Perturbation Validation: A New Heuristic to Validate Machine Learning Models\" \/>\n<meta property=\"og:description\" content=\"This talk introduces Perturbation Validation (PV), a new technique to validate machine learning models. PV does not rely on test data. Instead, it\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/\" \/>\n<meta property=\"og:site_name\" content=\"UNI FR\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/uni.lu\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/11\/2026\/03\/03120045\/UNIV_SM-Profile_1600x1600px-scaled.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"2560\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/\",\"url\":\"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/\",\"name\":\"Research Seminar: Perturbation Validation: A New Heuristic to Validate Machine Learning Models - Universit\u00e9 du Luxembourg\",\"isPartOf\":{\"@id\":\"https:\/\/www.uni.lu\/fr\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/11\/2020\/02\/research_seminar_perturbation_validation_a_new_heuristic_to_validate_machine_learning_models.jpg\",\"datePublished\":\"2020-02-17T12:51:39+00:00\",\"dateModified\":\"2020-02-17T12:51:39+00:00\",\"description\":\"This talk introduces Perturbation Validation (PV), a new technique to validate machine learning models. PV does not rely on test data. Instead, it\",\"breadcrumb\":{\"@id\":\"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/#primaryimage\",\"url\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/11\/2020\/02\/research_seminar_perturbation_validation_a_new_heuristic_to_validate_machine_learning_models.jpg\",\"contentUrl\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/11\/2020\/02\/research_seminar_perturbation_validation_a_new_heuristic_to_validate_machine_learning_models.jpg\",\"width\":800,\"height\":600},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.uni.lu\/fr\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Events\",\"item\":\"https:\/\/www.uni.lu\/fr\/events\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Research Seminar: Perturbation Validation: A New Heuristic to Validate Machine Learning Models\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.uni.lu\/fr\/#website\",\"url\":\"https:\/\/www.uni.lu\/fr\/\",\"name\":\"Uni.lu\",\"description\":\"Universit\u00e9 du Luxembourg\",\"publisher\":{\"@id\":\"https:\/\/www.uni.lu\/fr\/#organization\"},\"alternateName\":\"Universit\u00e9 du Luxembourg\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.uni.lu\/fr\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.uni.lu\/fr\/#organization\",\"name\":\"Universit\u00e9 du Luxembourg\",\"alternateName\":\"Uni.lu\",\"url\":\"https:\/\/www.uni.lu\/fr\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/www.uni.lu\/fr\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/11\/2026\/03\/03120045\/UNIV_SM-Profile_1600x1600px-scaled.jpg\",\"contentUrl\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/11\/2026\/03\/03120045\/UNIV_SM-Profile_1600x1600px-scaled.jpg\",\"width\":2560,\"height\":2560,\"caption\":\"Universit\u00e9 du Luxembourg\"},\"image\":\"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/11\/2026\/04\/24120552\/20200609-Belval-Campus_Henri-Goergen-23.jpg\",\"sameAs\":[\"https:\/\/www.facebook.com\/uni.lu\",\"https:\/\/www.linkedin.com\/school\/university-of-luxembourg\/\",\"https:\/\/www.instagram.com\/uni.lu\",\"https:\/\/www.youtube.com\/@uni_lu\",\"https:\/\/en.wikipedia.org\/wiki\/University_of_Luxembourg\"],\"email\":\"communication@uni.lu\",\"telephone\":\"+352 46 66 44 1\",\"address\":{\"@type\":\"PostalAddress\",\"streetAddress\":\"2, place de l\u2019Universit\u00e9\",\"addressLocality\":\"Esch-sur-Alzette\",\"postalCode\":\"4365\",\"addressCountry\":\"LU\"},\"description\":\"Universit\u00e9 du Luxembourg\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Research Seminar: Perturbation Validation: A New Heuristic to Validate Machine Learning Models - Universit\u00e9 du Luxembourg","description":"This talk introduces Perturbation Validation (PV), a new technique to validate machine learning models. PV does not rely on test data. Instead, it","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/","og_locale":"fr_FR","og_type":"article","og_title":"Research Seminar: Perturbation Validation: A New Heuristic to Validate Machine Learning Models","og_description":"This talk introduces Perturbation Validation (PV), a new technique to validate machine learning models. PV does not rely on test data. Instead, it","og_url":"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/","og_site_name":"UNI FR","article_publisher":"https:\/\/www.facebook.com\/uni.lu","og_image":[{"width":2560,"height":2560,"url":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/11\/2026\/03\/03120045\/UNIV_SM-Profile_1600x1600px-scaled.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Dur\u00e9e de lecture estim\u00e9e":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/","url":"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/","name":"Research Seminar: Perturbation Validation: A New Heuristic to Validate Machine Learning Models - Universit\u00e9 du Luxembourg","isPartOf":{"@id":"https:\/\/www.uni.lu\/fr\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/#primaryimage"},"image":{"@id":"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/#primaryimage"},"thumbnailUrl":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/11\/2020\/02\/research_seminar_perturbation_validation_a_new_heuristic_to_validate_machine_learning_models.jpg","datePublished":"2020-02-17T12:51:39+00:00","dateModified":"2020-02-17T12:51:39+00:00","description":"This talk introduces Perturbation Validation (PV), a new technique to validate machine learning models. PV does not rely on test data. Instead, it","breadcrumb":{"@id":"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/"]}]},{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/#primaryimage","url":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/11\/2020\/02\/research_seminar_perturbation_validation_a_new_heuristic_to_validate_machine_learning_models.jpg","contentUrl":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/11\/2020\/02\/research_seminar_perturbation_validation_a_new_heuristic_to_validate_machine_learning_models.jpg","width":800,"height":600},{"@type":"BreadcrumbList","@id":"https:\/\/www.uni.lu\/fr\/events\/research-seminar-perturbation-validation-a-new-heuristic-to-validate-machine-learning-models\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.uni.lu\/fr\/"},{"@type":"ListItem","position":2,"name":"Events","item":"https:\/\/www.uni.lu\/fr\/events\/"},{"@type":"ListItem","position":3,"name":"Research Seminar: Perturbation Validation: A New Heuristic to Validate Machine Learning Models"}]},{"@type":"WebSite","@id":"https:\/\/www.uni.lu\/fr\/#website","url":"https:\/\/www.uni.lu\/fr\/","name":"Uni.lu","description":"Universit\u00e9 du Luxembourg","publisher":{"@id":"https:\/\/www.uni.lu\/fr\/#organization"},"alternateName":"Universit\u00e9 du Luxembourg","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.uni.lu\/fr\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"fr-FR"},{"@type":"Organization","@id":"https:\/\/www.uni.lu\/fr\/#organization","name":"Universit\u00e9 du Luxembourg","alternateName":"Uni.lu","url":"https:\/\/www.uni.lu\/fr\/","logo":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/www.uni.lu\/fr\/#\/schema\/logo\/image\/","url":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/11\/2026\/03\/03120045\/UNIV_SM-Profile_1600x1600px-scaled.jpg","contentUrl":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/11\/2026\/03\/03120045\/UNIV_SM-Profile_1600x1600px-scaled.jpg","width":2560,"height":2560,"caption":"Universit\u00e9 du Luxembourg"},"image":"https:\/\/www.uni.lu\/wp-content\/uploads\/sites\/11\/2026\/04\/24120552\/20200609-Belval-Campus_Henri-Goergen-23.jpg","sameAs":["https:\/\/www.facebook.com\/uni.lu","https:\/\/www.linkedin.com\/school\/university-of-luxembourg\/","https:\/\/www.instagram.com\/uni.lu","https:\/\/www.youtube.com\/@uni_lu","https:\/\/en.wikipedia.org\/wiki\/University_of_Luxembourg"],"email":"communication@uni.lu","telephone":"+352 46 66 44 1","address":{"@type":"PostalAddress","streetAddress":"2, place de l\u2019Universit\u00e9","addressLocality":"Esch-sur-Alzette","postalCode":"4365","addressCountry":"LU"},"description":"Universit\u00e9 du Luxembourg"}]}},"_links":{"self":[{"href":"https:\/\/www.uni.lu\/fr\/wp-json\/wp\/v2\/events\/8205"}],"collection":[{"href":"https:\/\/www.uni.lu\/fr\/wp-json\/wp\/v2\/events"}],"about":[{"href":"https:\/\/www.uni.lu\/fr\/wp-json\/wp\/v2\/types\/events"}],"replies":[{"embeddable":true,"href":"https:\/\/www.uni.lu\/fr\/wp-json\/wp\/v2\/comments?post=8205"}],"version-history":[{"count":0,"href":"https:\/\/www.uni.lu\/fr\/wp-json\/wp\/v2\/events\/8205\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.uni.lu\/fr\/wp-json\/wp\/v2\/media\/8206"}],"wp:attachment":[{"href":"https:\/\/www.uni.lu\/fr\/wp-json\/wp\/v2\/media?parent=8205"}],"wp:term":[{"taxonomy":"events-topic","embeddable":true,"href":"https:\/\/www.uni.lu\/fr\/wp-json\/wp\/v2\/events-topic?post=8205"},{"taxonomy":"events-type","embeddable":true,"href":"https:\/\/www.uni.lu\/fr\/wp-json\/wp\/v2\/events-type?post=8205"},{"taxonomy":"organisation","embeddable":true,"href":"https:\/\/www.uni.lu\/fr\/wp-json\/wp\/v2\/organisation?post=8205"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}