diff --git a/docs/_sources/pages/Front_page.md.txt b/docs/_sources/pages/Front_page.md.txt index ddd80fc..7938168 100644 --- a/docs/_sources/pages/Front_page.md.txt +++ b/docs/_sources/pages/Front_page.md.txt @@ -1,6 +1,6 @@ # FAIR Universe - HiggsML Uncertainty Challenge -## Introduction +## Introduction This NeurIPS 2024 Machine Learning competition is one of the first to strongly emphasise mastering uncertainties in the input training dataset and outputting credible confidence intervals. This challenge explores uncertainty-aware AI techniques for High Energy Physics (HEP). @@ -13,9 +13,9 @@ There are several information sources regarding the FAIR Universe - HiggsML Unce * [Codabench](https://www.codabench.org/competitions/2977/): This serves as the platform to submit entries to the competition. -* [Tutorial Slides](https://fair-universe.lbl.gov/tutorials/Higgs_Uncertainty_Challenge-Codabench_Tutorial.pdf) : These slides will help you register and submit a sample dummy submission. +* [Tutorial Slides](https://fair-universe.lbl.gov/tutorials/Higgs_Uncertainty_Challenge-Codabench_Tutorial.pdf) : These slides will help you register and submit a sample dummy submission. -* Download the [training data](https://www.codabench.org/datasets/download/b9e59d0a-4db3-4da4-b1f8-3f609d1835b2/) if you you want to experiment with the data on your local machines. +* Download the [Training Data (6.5 GB)](https://www.codabench.org/datasets/download/b9e59d0a-4db3-4da4-b1f8-3f609d1835b2/) if you you want to experiment with the data on your local machines. * [Documentation](https://fair-universe.lbl.gov/docs/): This contains detailed information about the [science behind the challenge](https://fair-universe.lbl.gov/docs/pages/overview.html#problem-setting), the [specifics of the data](https://fair-universe.lbl.gov/docs/pages/data.html), and [documents the code](https://fair-universe.lbl.gov/docs/rst_source/modules.html) used to facilitate the evaluation of the competition. It also describes the [evaluation metric](https://fair-universe.lbl.gov/docs/pages/evaluation.html) @@ -42,7 +42,7 @@ This competition allows code submissions. Participants are strongly encouraged t - Sascha Diefenbacher - Steven Farrell - Wahid Bhimji -- Jordan Dudley +- Jordan Dudley ### University of Washington - Elham E Khoda diff --git a/docs/_sources/pages/data.md.txt b/docs/_sources/pages/data.md.txt index c6fb55e..d213b5f 100644 --- a/docs/_sources/pages/data.md.txt +++ b/docs/_sources/pages/data.md.txt @@ -103,7 +103,7 @@ These variables are derived from the primary varibales with the help of `derived ## How to get Public Data? -Download the [Neurips_Public_data_26_08_2024](https://www.codabench.org/datasets/download/b9e59d0a-4db3-4da4-b1f8-3f609d1835b2/) +Download the [Neurips_Public_data_26_08_2024 (6.5 GB)](https://www.codabench.org/datasets/download/b9e59d0a-4db3-4da4-b1f8-3f609d1835b2/) or use the following command to download using terminal ``` diff --git a/docs/_sources/pages/evaluation.md.txt b/docs/_sources/pages/evaluation.md.txt index 3aa046d..e730427 100644 --- a/docs/_sources/pages/evaluation.md.txt +++ b/docs/_sources/pages/evaluation.md.txt @@ -16,6 +16,16 @@ Not every uncertainty quantification method is able to return a full likelihood **Methods that a central value and Gaussian uncertainty**: Define $\hat \mu_{16} = \hat \mu - \Delta \hat \mu$ and $\hat \mu_{84} = \hat \mu + \Delta \hat \mu$. If the underlying assumption of a symmetrical uncertainty made by the Gaussian uncertainty is given, this should contain 68.27% of the probability, since the 1 standard deviation region of a Gaussian distribution contains 68.27% of the probability mass. +## Submission requirements + +Participants’ submissions must consist of a zip file containing a `model.py` file (which must not be inside a directory), and it can contain any other necessary files (eg, a pre-trained model). The `model.py` file must define a `Model` class which must satisfy the following criteria. +1. The `Model` class must accept two arguments, `get_train_set` and `systematics`, when it is initialized. The `get_train_set` argument will receive a callable which, when called, will return the public dataset. The `systematics` argument will receive a callable which can be used to apply the systematic effects (adjusting weights and primary features, computing derived features, and applying post-selection cuts) to a dataset. +1. The `Model` class must have a `fit` method, which will be called once when the submission is being evaluated. This method can be used prepare the model for inference. We encourage participants to submit models which have already been trained, as there is limited compute time for each submission to be evaluated. +1. The `Model` class must have a `predict` method which must accept a test dataset and return the results as a dictionary containing four items: `”mu_hat”`: the predicted value of mu, `”delta_mu_hat”`: the uncertainty in the predicted value of mu, `”p16”`: the lower bound of the 16th percentile of mu, and `”p84”`: the upper bound of the 84th percentile of mu. + +## Hardware description + +Throughout the competition, participants’ submissions will be run on either the Perlmutter supercomputer at NERSC or an alternative workstation at LBNL, but they will only be run on Perlmutter for the final evaluation. When running on Perlmutter, submissions will have one node assigned, which consists of 1 AMD EPYC 7763 CPU, 256GB of RAM, and 4 NVIDIA A100 GPUs with 40GB of memory each (https://docs.nersc.gov/systems/perlmutter/architecture/#gpu-nodes). The alternative workstation consists of 1 Intel(R) Xeon(R) Gold 6148 CPU, 376GB of RAM, and 3 Tesla V100-SXM2-16GB GPUs available. On either system, participants’ submissions will be allotted 2 hours to complete evaluation on all of the pseudoexperiments (10 sets of 100 pseudoexperiments each for the initial phase, and 10 sets of 1000 pseudoexperiments for the final phase). These pseudoexperiments will be parallelized in the following way. Each participants’ `Model.fit()` will be run once, and then each of the pseudoexperiments will be run by one of many parallel workers, with each worker calling `Model.predict()` once. There will be 30 parallel workers when running on Perlmutter. This will be reduced to 10 parallel workers when running on the alternative workstation. ## Scoring diff --git a/docs/_sources/pages/terms.md.txt b/docs/_sources/pages/terms.md.txt index bf38ebe..b6cea5d 100644 --- a/docs/_sources/pages/terms.md.txt +++ b/docs/_sources/pages/terms.md.txt @@ -14,10 +14,7 @@ This challenge is for educational purposes only and no prizes are granted. It is To ensure proper representation and verification of your affiliation with an organization in our competition, please adhere to the following guidelines -#### Profile Affiliation - -Ensure that your Codabench profile includes your current organizational affiliation. This helps in verifying your credentials and associating your contributions with the correct institution. - -#### Registration Requirements - -Use your organization-issued email address to register for the competition. This will help us confirm that you are officially associated with the organization and prevent unauthorized entries. \ No newline at end of file +- Ensure that your Codabench profile includes your current organizational affiliation. This helps in verifying your credentials and associating your contributions with the correct institution. +- If participants are freelancers they should provide brief details (via email to fair-universe@lbl.gov) of their freelance operation, any supporting URL, and their country of residence. +- Use your organization-issued email address to register for the competition. This will help us confirm that you are officially associated with the organization and prevent unauthorized entries. +- Registration is not required to access the dataset that is provided on the “Data” tab. We encourage the use of the dataset for research. In the event that a participant who is not eligible for submission via codabench according to the conditions above, can demonstrate a successful method on the challenge task we encourage them to contact the organizers for attribution and potential inclusion in the final competition stage if possible. \ No newline at end of file diff --git a/docs/pages/Front_page.html b/docs/pages/Front_page.html index c7fe0ec..c33b127 100644 --- a/docs/pages/Front_page.html +++ b/docs/pages/Front_page.html @@ -93,7 +93,7 @@

Introduction

  • Codabench: This serves as the platform to submit entries to the competition.

  • Tutorial Slides : These slides will help you register and submit a sample dummy submission.

    • -

  • Download the training data if you you want to experiment with the data on your local machines.

    • +

  • Download the Training Data (6.5 GB) if you you want to experiment with the data on your local machines.

  • Documentation: This contains detailed information about the science behind the challenge, the specifics of the data, and documents the code used to facilitate the evaluation of the competition. It also describes the evaluation metric

  • Github Repo: This hosts the code for testing submissions, as well as the starting kit notebook. The starting kit is also available on Google Colab

  • White Paper: This serves as a full breakdown of the competition in detail

    • diff --git a/docs/pages/data.html b/docs/pages/data.html index b18461a..268debc 100644 --- a/docs/pages/data.html +++ b/docs/pages/data.html @@ -305,7 +305,7 @@

    Preselection Cuts

    How to get Public Data?

    -

    Download the Neurips_Public_data_26_08_2024

    +

    Download the Neurips_Public_data_26_08_2024 (6.5 GB)

    or use the following command to download using terminal

    wget -O public_data.zip https://www.codabench.org/datasets/download/b9e59d0a-4db3-4da4-b1f8-3f609d1835b2/
    diff --git a/docs/pages/evaluation.html b/docs/pages/evaluation.html index d76e40d..0a9d837 100644 --- a/docs/pages/evaluation.html +++ b/docs/pages/evaluation.html @@ -10,7 +10,6 @@ - @@ -57,6 +56,8 @@
  • Constructing the Interval
    • +
  • Submission requirements
    • +
  • Hardware description
  • Scoring
    • @@ -107,6 +108,19 @@

    Constructing the Interval\(\hat \mu_{16} = \hat \mu - \Delta \hat \mu\) and \(\hat \mu_{84} = \hat \mu + \Delta \hat \mu\). If the underlying assumption of a symmetrical uncertainty made by the Gaussian uncertainty is given, this should contain 68.27% of the probability, since the 1 standard deviation region of a Gaussian distribution contains 68.27% of the probability mass.

    +
    +

    Submission requirements

    +

    Participants’ submissions must consist of a zip file containing a model.py file (which must not be inside a directory), and it can contain any other necessary files (eg, a pre-trained model). The model.py file must define a Model class which must satisfy the following criteria.

    +
      +

    1. The Model class must accept two arguments, get_train_set and systematics, when it is initialized. The get_train_set argument will receive a callable which, when called, will return the public dataset. The systematics argument will receive a callable which can be used to apply the systematic effects (adjusting weights and primary features, computing derived features, and applying post-selection cuts) to a dataset.

      2. +

    2. The Model class must have a fit method, which will be called once when the submission is being evaluated. This method can be used prepare the model for inference. We encourage participants to submit models which have already been trained, as there is limited compute time for each submission to be evaluated.

      3. +

    3. The Model class must have a predict method which must accept a test dataset and return the results as a dictionary containing four items: ”mu_hat”: the predicted value of mu, ”delta_mu_hat”: the uncertainty in the predicted value of mu, ”p16”: the lower bound of the 16th percentile of mu, and ”p84”: the upper bound of the 84th percentile of mu.

      4. +
    +
    +
    +

    Hardware description

    +

    Throughout the competition, participants’ submissions will be run on either the Perlmutter supercomputer at NERSC or an alternative workstation at LBNL, but they will only be run on Perlmutter for the final evaluation. When running on Perlmutter, submissions will have one node assigned, which consists of 1 AMD EPYC 7763 CPU, 256GB of RAM, and 4 NVIDIA A100 GPUs with 40GB of memory each (https://docs.nersc.gov/systems/perlmutter/architecture/#gpu-nodes). The alternative workstation consists of 1 Intel(R) Xeon(R) Gold 6148 CPU, 376GB of RAM, and 3 Tesla V100-SXM2-16GB GPUs available. On either system, participants’ submissions will be allotted 2 hours to complete evaluation on all of the pseudoexperiments (10 sets of 100 pseudoexperiments each for the initial phase, and 10 sets of 1000 pseudoexperiments for the final phase). These pseudoexperiments will be parallelized in the following way. Each participants’ Model.fit() will be run once, and then each of the pseudoexperiments will be run by one of many parallel workers, with each worker calling Model.predict() once. There will be 30 parallel workers when running on Perlmutter. This will be reduced to 10 parallel workers when running on the alternative workstation.

    +

    Scoring

    The score consist of two parts, the interval width and the coverage:

    @@ -156,4 +170,4 @@

    Scoring - + \ No newline at end of file diff --git a/docs/pages/terms.html b/docs/pages/terms.html index 7dc2a59..8e60e7a 100644 --- a/docs/pages/terms.html +++ b/docs/pages/terms.html @@ -96,14 +96,12 @@

    Disqualification Terms

    Participant Affiliation Guidelines

    To ensure proper representation and verification of your affiliation with an organization in our competition, please adhere to the following guidelines

    -
    -

    Profile Affiliation

    -

    Ensure that your Codabench profile includes your current organizational affiliation. This helps in verifying your credentials and associating your contributions with the correct institution.

    -
    -
    -

    Registration Requirements

    -

    Use your organization-issued email address to register for the competition. This will help us confirm that you are officially associated with the organization and prevent unauthorized entries.

    -
    +
      +

    • Ensure that your Codabench profile includes your current organizational affiliation. This helps in verifying your credentials and associating your contributions with the correct institution.

      • +

    • If participants are freelancers they should provide brief details (via email to fair-universe@lbl.gov) of their freelance operation, any supporting URL, and their country of residence.

      • +

    • Use your organization-issued email address to register for the competition. This will help us confirm that you are officially associated with the organization and prevent unauthorized entries.

      • +

    • Registration is not required to access the dataset that is provided on the “Data” tab. We encourage the use of the dataset for research. In the event that a participant who is not eligible for submission via codabench according to the conditions above, can demonstrate a successful method on the challenge task we encourage them to contact the organizers for attribution and potential inclusion in the final competition stage if possible.

      • +

    diff --git a/docs/rst_source/Appendix.html b/docs/rst_source/Appendix.html index e39b7d0..ba50f71 100644 --- a/docs/rst_source/Appendix.html +++ b/docs/rst_source/Appendix.html @@ -96,6 +96,8 @@

    Appendix
  • Evaluation
    • diff --git a/docs/rst_source/score.html b/docs/rst_source/score.html index ea589ff..d9d0a7a 100644 --- a/docs/rst_source/score.html +++ b/docs/rst_source/score.html @@ -210,7 +210,7 @@
    -save_figure(mu, p16s, p84s, set=0, true_mu=None)
    +save_figure(mu, p16s, p84s, true_mu=None, set=0)

    Save the figure of the mu distribution.

    Args:
      diff --git a/docs/searchindex.js b/docs/searchindex.js index e015e22..2b81b1d 100644 --- a/docs/searchindex.js +++ b/docs/searchindex.js @@ -1 +1 @@ -Search.setIndex({"alltitles": {"1. Building Templates": [[3, "building-templates"], [21, "building-templates"]], "1. Machine Learning:": [[3, "machine-learning"], [21, "machine-learning"]], "2. Fitting Procedure": [[3, "fitting-procedure"], [21, "fitting-procedure"]], "2. Statistical Analysis:": [[3, "statistical-analysis"], [21, "statistical-analysis"]], "Appendix": [[10, null]], "Boosted_Decision_Tree module": [[11, null]], "ChaLearn": [[1, "chalearn"]], "Challenge target: Estimation of \\mu and uncertainty": [[6, "challenge-target-estimation-of-mu-and-uncertainty"]], "Constructing the Interval": [[5, "constructing-the-interval"]], "Contact": [[1, "contact"]], "Core Modules:": [[0, null]], "Core modules": [[18, null]], "Credits": [[1, "credits"]], "Data": [[4, null]], "Datasets module": [[12, null]], "Derived Features": [[4, "derived-features"]], "Derived_quantities module": [[13, null]], "Disqualification Terms": [[9, "disqualification-terms"]], "Dummy Sample Submission": [[8, "dummy-sample-submission"]], "Evaluation": [[5, null]], "Example Breakdown": [[3, "example-breakdown"], [21, "example-breakdown"]], "Example: Statistical-Only and 1-Systematic Case Analysis": [[3, null], [21, "example-statistical-only-and-1-systematic-case-analysis"]], "FAIR Universe - HiggsML Uncertainty Challenge": [[1, null]], "Features in the data": [[4, "features-in-the-data"]], "Getting Started": [[2, null]], "Higgs Signal:": [[4, "higgs-signal"]], "How to get Public Data?": [[4, "how-to-get-public-data"]], "How to join this challenge?": [[1, "how-to-join-this-challenge"]], "How to run it": [[3, "how-to-run-it"], [21, "how-to-run-it"]], "Indices and tables": [[0, "indices-and-tables"]], "Ingestion Program": [[16, null]], "Ingestion module": [[14, null]], "Ingestion_parallel module": [[15, null]], "Introduction": [[1, "introduction"], [6, "introduction"]], "Key Details:": [[3, "key-details"], [21, "key-details"]], "Lawrence Berkeley National Laboratory": [[1, "lawrence-berkeley-national-laboratory"]], "Machine Learning: Classifier Training": [[3, "machine-learning-classifier-training"], [21, "machine-learning-classifier-training"]], "Model One Syst": [[17, null]], "Overview": [[6, null]], "Pages:": [[0, null]], "Participant Affiliation Guidelines": [[9, "participant-affiliation-guidelines"]], "Prefix-less variables": [[4, "prefix-less-variables"]], "Preselection Cuts": [[4, "preselection-cuts"]], "Primary Features": [[4, "primary-features"]], "Prizes": [[7, null]], "Problem Overview": [[3, "problem-overview"], [21, "problem-overview"]], "Problem Setting": [[6, "problem-setting"]], "Profile Affiliation": [[9, "profile-affiliation"]], "Quantiles Score": [[5, "quantiles-score"]], "Registration Requirements": [[9, "registration-requirements"]], "Score module": [[19, null]], "Scoring": [[5, "scoring"]], "Scoring Program": [[20, null]], "Simple One Syst Model": [[21, null]], "Simple Stat Only Model": [[22, null]], "Starting Kit": [[8, "starting-kit"]], "Starting Kit and Sample Submission": [[8, null]], "Statistical Analysis: Signal Strength Extraction": [[3, "statistical-analysis-signal-strength-extraction"], [21, "statistical-analysis-signal-strength-extraction"]], "Statistical_Analysis module": [[23, null]], "Steps:": [[3, "steps"], [21, "steps"]], "Systematics module": [[24, null]], "Terms and Conditions": [[9, null]], "UC Irvine": [[1, "uc-irvine"]], "University of Washington": [[1, "university-of-washington"]], "Universit\u00e9 Paris-Saclay": [[1, "universite-paris-saclay"]], "Visualization module": [[25, null]], "Welcome to FAIR Universe HEP Challenge\u2019s documentation!": [[0, null]], "With Conda :": [[2, "with-conda"]], "With Docker": [[2, "with-docker"]], "Workflow Overview": [[3, "workflow-overview"], [21, "workflow-overview"]], "Z boson Background:": [[4, "z-boson-background"]], "\u26a0\ufe0f Note:": [[2, "note"], [8, "note"]], "\u2b07\ufe0f Dummy Sample Submission": [[8, "id1"]]}, "docnames": ["index", "pages/Front_page", "pages/Local_setup", "pages/advanced_example", "pages/data", "pages/evaluation", "pages/overview", "pages/prizes", "pages/starting_kit", "pages/terms", "rst_source/Appendix", "rst_source/boosted_decision_tree", "rst_source/datasets", "rst_source/derived_quantities", "rst_source/ingestion", "rst_source/ingestion_parallel", "rst_source/ingestion_program", "rst_source/model_one_syst", "rst_source/modules", "rst_source/score", "rst_source/scoring_program", "rst_source/simple_one_syst_model", "rst_source/simple_stat_only_model", "rst_source/statistical_analysis", "rst_source/systematics", "rst_source/visualization"], "envversion": {"sphinx": 63, "sphinx.domains.c": 3, "sphinx.domains.changeset": 1, "sphinx.domains.citation": 1, "sphinx.domains.cpp": 9, "sphinx.domains.index": 1, "sphinx.domains.javascript": 3, "sphinx.domains.math": 2, "sphinx.domains.python": 4, "sphinx.domains.rst": 2, "sphinx.domains.std": 2}, "filenames": ["index.rst", "pages/Front_page.md", "pages/Local_setup.md", "pages/advanced_example.md", "pages/data.md", "pages/evaluation.md", "pages/overview.md", "pages/prizes.md", "pages/starting_kit.md", "pages/terms.md", "rst_source/Appendix.rst", "rst_source/boosted_decision_tree.rst", "rst_source/datasets.rst", "rst_source/derived_quantities.rst", "rst_source/ingestion.rst", "rst_source/ingestion_parallel.rst", "rst_source/ingestion_program.rst", "rst_source/model_one_syst.rst", "rst_source/modules.rst", "rst_source/score.rst", "rst_source/scoring_program.rst", "rst_source/simple_one_syst_model.rst", "rst_source/simple_stat_only_model.rst", "rst_source/statistical_analysis.rst", "rst_source/systematics.rst", "rst_source/visualization.rst"], "indexentries": {"all_bkg_weight_norm() (in module systematics)": [[24, "systematics.all_bkg_weight_norm", false]], "alpha_function() (simple_one_syst_model.statistical_analysis.statisticalanalysis method)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis.alpha_function", false]], "balance_set() (in module simple_one_syst_model.model)": [[17, "simple_one_syst_model.model.balance_set", false]], "boosteddecisiontree (class in simple_one_syst_model.boosted_decision_tree)": [[11, "simple_one_syst_model.boosted_decision_tree.BoostedDecisionTree", false]], "calcul_int() (in module derived_quantities)": [[13, "derived_quantities.calcul_int", false]], "calculate_saved_info() (in module simple_stat_only_model.model)": [[22, "simple_stat_only_model.model.calculate_saved_info", false]], "calculate_saved_info() (simple_one_syst_model.statistical_analysis.statisticalanalysis method)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis.calculate_saved_info", false]], "compute_mu() (in module simple_stat_only_model.model)": [[22, "simple_stat_only_model.model.compute_mu", false]], "compute_mu() (simple_one_syst_model.statistical_analysis.statisticalanalysis method)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis.compute_mu", false]], "compute_result() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.compute_result", false]], "compute_result() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.compute_result", false]], "compute_scores() (score.scoring method)": [[19, "score.Scoring.compute_scores", false]], "correlation_plots() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.correlation_plots", false]], "custom_pretty_print() (in module visualization)": [[25, "visualization.custom_pretty_print", false]], "data (class in datasets)": [[12, "datasets.Data", false]], "dataset_visualise (class in visualization)": [[25, "visualization.Dataset_visualise", false]], "datasets": [[12, "module-datasets", false]], "delete_train_set() (datasets.data method)": [[12, "datasets.Data.delete_train_set", false]], "der_data() (in module derived_quantities)": [[13, "derived_quantities.DER_data", false]], "derived_quantities": [[13, "module-derived_quantities", false]], "diboson_bkg_weight_norm() (in module systematics)": [[24, "systematics.diboson_bkg_weight_norm", false]], "event_vise_syst() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.event_vise_syst", false]], "event_vise_syst_arrow() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.event_vise_syst_arrow", false]], "examine_dataset() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.examine_dataset", false]], "f_del_der() (in module derived_quantities)": [[13, "derived_quantities.f_del_DER", false]], "f_der_deltaeta_jet_jet() (in module derived_quantities)": [[13, "derived_quantities.f_DER_deltaeta_jet_jet", false]], "f_der_deltar_had_lep() (in module derived_quantities)": [[13, "derived_quantities.f_DER_deltar_had_lep", false]], "f_der_lep_eta_centrality() (in module derived_quantities)": [[13, "derived_quantities.f_DER_lep_eta_centrality", false]], "f_der_mass_jet_jet() (in module derived_quantities)": [[13, "derived_quantities.f_DER_mass_jet_jet", false]], "f_der_mass_transverse_met_lep() (in module derived_quantities)": [[13, "derived_quantities.f_DER_mass_transverse_met_lep", false]], "f_der_mass_vis() (in module derived_quantities)": [[13, "derived_quantities.f_DER_mass_vis", false]], "f_der_met_phi_centrality() (in module derived_quantities)": [[13, "derived_quantities.f_DER_met_phi_centrality", false]], "f_der_prodeta_jet_jet() (in module derived_quantities)": [[13, "derived_quantities.f_DER_prodeta_jet_jet", false]], "f_der_pt_h() (in module derived_quantities)": [[13, "derived_quantities.f_DER_pt_h", false]], "f_der_pt_ratio_lep_had() (in module derived_quantities)": [[13, "derived_quantities.f_DER_pt_ratio_lep_had", false]], "f_der_pt_tot() (in module derived_quantities)": [[13, "derived_quantities.f_DER_pt_tot", false]], "f_der_sum_pt() (in module derived_quantities)": [[13, "derived_quantities.f_DER_sum_pt", false]], "fit() (simple_one_syst_model.boosted_decision_tree.boosteddecisiontree method)": [[11, "simple_one_syst_model.boosted_decision_tree.BoostedDecisionTree.fit", false]], "fit() (simple_one_syst_model.model.model method)": [[17, "simple_one_syst_model.model.Model.fit", false]], "fit() (simple_stat_only_model.model.model method)": [[22, "simple_stat_only_model.model.Model.fit", false]], "fit_submission() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.fit_submission", false]], "fit_submission() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.fit_submission", false]], "get_bootstrapped_dataset() (in module systematics)": [[24, "systematics.get_bootstrapped_dataset", false]], "get_duration() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.get_duration", false]], "get_duration() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.get_duration", false]], "get_syst_train_set() (datasets.data method)": [[12, "datasets.Data.get_syst_train_set", false]], "get_systematics_dataset() (in module systematics)": [[24, "systematics.get_systematics_dataset", false]], "get_test_set() (datasets.data method)": [[12, "datasets.Data.get_test_set", false]], "get_train_set() (datasets.data method)": [[12, "datasets.Data.get_train_set", false]], "histogram_dataset() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.histogram_dataset", false]], "histogram_syst() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.histogram_syst", false]], "ingestion": [[14, "module-ingestion", false]], "ingestion (class in ingestion)": [[14, "ingestion.Ingestion", false]], "ingestion (class in ingestion_parallel)": [[15, "ingestion_parallel.Ingestion", false]], "ingestion_parallel": [[15, "module-ingestion_parallel", false]], "init_submission() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.init_submission", false]], "init_submission() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.init_submission", false]], "load() (simple_one_syst_model.boosted_decision_tree.boosteddecisiontree method)": [[11, "simple_one_syst_model.boosted_decision_tree.BoostedDecisionTree.load", false]], "load() (simple_one_syst_model.statistical_analysis.statisticalanalysis method)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis.load", false]], "load_ingestion_duration() (score.scoring method)": [[19, "score.Scoring.load_ingestion_duration", false]], "load_ingestion_results() (score.scoring method)": [[19, "score.Scoring.load_ingestion_results", false]], "load_test_set() (datasets.data method)": [[12, "datasets.Data.load_test_set", false]], "load_train_set() (datasets.data method)": [[12, "datasets.Data.load_train_set", false]], "load_train_set() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.load_train_set", false]], "load_train_set() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.load_train_set", false]], "mae_score() (score.scoring method)": [[19, "score.Scoring.MAE_score", false]], "make_unweighted_set() (in module systematics)": [[24, "systematics.make_unweighted_set", false]], "model (class in simple_one_syst_model.model)": [[17, "simple_one_syst_model.model.Model", false]], "model (class in simple_stat_only_model.model)": [[22, "simple_stat_only_model.model.Model", false]], "module": [[11, "module-simple_one_syst_model.boosted_decision_tree", false], [12, "module-datasets", false], [13, "module-derived_quantities", false], [14, "module-ingestion", false], [15, "module-ingestion_parallel", false], [17, "module-simple_one_syst_model.model", false], [19, "module-score", false], [22, "module-simple_stat_only_model.model", false], [23, "module-simple_one_syst_model.statistical_analysis", false], [24, "module-systematics", false], [25, "module-visualization", false]], "mom4_manipulate() (in module systematics)": [[24, "systematics.mom4_manipulate", false]], "neurips2024_public_dataset() (in module datasets)": [[12, "datasets.Neurips2024_public_dataset", false]], "pair_plots() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.pair_plots", false]], "pair_plots_syst() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.pair_plots_syst", false]], "plot_stacked_histogram() (simple_one_syst_model.statistical_analysis.statisticalanalysis method)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis.plot_stacked_histogram", false]], "postprocess() (in module systematics)": [[24, "systematics.postprocess", false]], "predict() (simple_one_syst_model.boosted_decision_tree.boosteddecisiontree method)": [[11, "simple_one_syst_model.boosted_decision_tree.BoostedDecisionTree.predict", false]], "predict() (simple_one_syst_model.model.model method)": [[17, "simple_one_syst_model.model.Model.predict", false]], "predict() (simple_stat_only_model.model.model method)": [[22, "simple_stat_only_model.model.Model.predict", false]], "predict_submission() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.predict_submission", false]], "predict_submission() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.predict_submission", false]], "quantiles_score() (score.scoring method)": [[19, "score.Scoring.Quantiles_Score", false]], "repeat_rows_by_weight() (in module systematics)": [[24, "systematics.repeat_rows_by_weight", false]], "rmse_score() (score.scoring method)": [[19, "score.Scoring.RMSE_score", false]], "roc_curve_wrapper() (in module visualization)": [[25, "visualization.roc_curve_wrapper", false]], "save() (simple_one_syst_model.boosted_decision_tree.boosteddecisiontree method)": [[11, "simple_one_syst_model.boosted_decision_tree.BoostedDecisionTree.save", false]], "save() (simple_one_syst_model.statistical_analysis.statisticalanalysis method)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis.save", false]], "save_duration() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.save_duration", false]], "save_duration() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.save_duration", false]], "save_figure() (score.scoring method)": [[19, "score.Scoring.save_figure", false]], "save_result() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.save_result", false]], "save_result() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.save_result", false]], "score": [[19, "module-score", false]], "scoring (class in score)": [[19, "score.Scoring", false]], "simple_one_syst_model.boosted_decision_tree": [[11, "module-simple_one_syst_model.boosted_decision_tree", false]], "simple_one_syst_model.model": [[17, "module-simple_one_syst_model.model", false]], "simple_one_syst_model.statistical_analysis": [[23, "module-simple_one_syst_model.statistical_analysis", false]], "simple_stat_only_model.model": [[22, "module-simple_stat_only_model.model", false]], "stacked_histogram() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.stacked_histogram", false]], "start_timer() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.start_timer", false]], "start_timer() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.start_timer", false]], "statisticalanalysis (class in simple_one_syst_model.statistical_analysis)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis", false]], "stop_timer() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.stop_timer", false]], "stop_timer() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.stop_timer", false]], "systematics": [[24, "module-systematics", false]], "systematics() (in module systematics)": [[24, "systematics.systematics", false]], "train_test_split() (in module simple_one_syst_model.model)": [[17, "simple_one_syst_model.model.train_test_split", false]], "train_test_split() (in module simple_stat_only_model.model)": [[22, "simple_stat_only_model.model.train_test_split", false]], "ttbar_bkg_weight_norm() (in module systematics)": [[24, "systematics.ttbar_bkg_weight_norm", false]], "visualization": [[25, "module-visualization", false]], "visualize_coverage() (in module visualization)": [[25, "visualization.visualize_coverage", false]], "visualize_fit() (simple_one_syst_model.statistical_analysis.statisticalanalysis method)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis.visualize_fit", false]], "visualize_scatter() (in module visualization)": [[25, "visualization.visualize_scatter", false]]}, "objects": {"": [[12, 0, 0, "-", "datasets"], [13, 0, 0, "-", "derived_quantities"], [14, 0, 0, "-", "ingestion"], [15, 0, 0, "-", "ingestion_parallel"], [19, 0, 0, "-", "score"], [24, 0, 0, "-", "systematics"], [25, 0, 0, "-", "visualization"]], "datasets": [[12, 1, 1, "", "Data"], [12, 3, 1, "", "Neurips2024_public_dataset"]], "datasets.Data": [[12, 2, 1, "", "delete_train_set"], [12, 2, 1, "", "get_syst_train_set"], [12, 2, 1, "", "get_test_set"], [12, 2, 1, "", "get_train_set"], [12, 2, 1, "", "load_test_set"], [12, 2, 1, "", "load_train_set"]], "derived_quantities": [[13, 3, 1, "", "DER_data"], [13, 3, 1, "", "calcul_int"], [13, 3, 1, "", "f_DER_deltaeta_jet_jet"], [13, 3, 1, "", "f_DER_deltar_had_lep"], [13, 3, 1, "", "f_DER_lep_eta_centrality"], [13, 3, 1, "", "f_DER_mass_jet_jet"], [13, 3, 1, "", "f_DER_mass_transverse_met_lep"], [13, 3, 1, "", "f_DER_mass_vis"], [13, 3, 1, "", "f_DER_met_phi_centrality"], [13, 3, 1, "", "f_DER_prodeta_jet_jet"], [13, 3, 1, "", "f_DER_pt_h"], [13, 3, 1, "", "f_DER_pt_ratio_lep_had"], [13, 3, 1, "", "f_DER_pt_tot"], [13, 3, 1, "", "f_DER_sum_pt"], [13, 3, 1, "", "f_del_DER"]], "ingestion": [[14, 1, 1, "", "Ingestion"]], "ingestion.Ingestion": [[14, 2, 1, "", "compute_result"], [14, 2, 1, "", "fit_submission"], [14, 2, 1, "", "get_duration"], [14, 2, 1, "", "init_submission"], [14, 2, 1, "", "load_train_set"], [14, 2, 1, "", "predict_submission"], [14, 2, 1, "", "save_duration"], [14, 2, 1, "", "save_result"], [14, 2, 1, "", "start_timer"], [14, 2, 1, "", "stop_timer"]], "ingestion_parallel": [[15, 1, 1, "", "Ingestion"]], "ingestion_parallel.Ingestion": [[15, 2, 1, "", "compute_result"], [15, 2, 1, "", "fit_submission"], [15, 2, 1, "", "get_duration"], [15, 2, 1, "", "init_submission"], [15, 2, 1, "", "load_train_set"], [15, 2, 1, "", "predict_submission"], [15, 2, 1, "", "save_duration"], [15, 2, 1, "", "save_result"], [15, 2, 1, "", "start_timer"], [15, 2, 1, "", "stop_timer"]], "score": [[19, 1, 1, "", "Scoring"]], "score.Scoring": [[19, 2, 1, "", "MAE_score"], [19, 2, 1, "", "Quantiles_Score"], [19, 2, 1, "", "RMSE_score"], [19, 2, 1, "", "compute_scores"], [19, 2, 1, "", "load_ingestion_duration"], [19, 2, 1, "", "load_ingestion_results"], [19, 2, 1, "", "save_figure"]], "simple_one_syst_model": [[11, 0, 0, "-", "boosted_decision_tree"], [17, 0, 0, "-", "model"], [23, 0, 0, "-", "statistical_analysis"]], "simple_one_syst_model.boosted_decision_tree": [[11, 1, 1, "", "BoostedDecisionTree"]], "simple_one_syst_model.boosted_decision_tree.BoostedDecisionTree": [[11, 2, 1, "", "fit"], [11, 2, 1, "", "load"], [11, 2, 1, "", "predict"], [11, 2, 1, "", "save"]], "simple_one_syst_model.model": [[17, 1, 1, "", "Model"], [17, 3, 1, "", "balance_set"], [17, 3, 1, "", "train_test_split"]], "simple_one_syst_model.model.Model": [[17, 2, 1, "", "fit"], [17, 2, 1, "", "predict"]], "simple_one_syst_model.statistical_analysis": [[23, 1, 1, "", "StatisticalAnalysis"]], "simple_one_syst_model.statistical_analysis.StatisticalAnalysis": [[23, 2, 1, "", "alpha_function"], [23, 2, 1, "", "calculate_saved_info"], [23, 2, 1, "", "compute_mu"], [23, 2, 1, "", "load"], [23, 2, 1, "", "plot_stacked_histogram"], [23, 2, 1, "", "save"], [23, 2, 1, "", "visualize_fit"]], "simple_stat_only_model": [[22, 0, 0, "-", "model"]], "simple_stat_only_model.model": [[22, 1, 1, "", "Model"], [22, 3, 1, "", "calculate_saved_info"], [22, 3, 1, "", "compute_mu"], [22, 3, 1, "", "train_test_split"]], "simple_stat_only_model.model.Model": [[22, 2, 1, "", "fit"], [22, 2, 1, "", "predict"]], "systematics": [[24, 3, 1, "", "all_bkg_weight_norm"], [24, 3, 1, "", "diboson_bkg_weight_norm"], [24, 3, 1, "", "get_bootstrapped_dataset"], [24, 3, 1, "", "get_systematics_dataset"], [24, 3, 1, "", "make_unweighted_set"], [24, 3, 1, "", "mom4_manipulate"], [24, 3, 1, "", "postprocess"], [24, 3, 1, "", "repeat_rows_by_weight"], [24, 3, 1, "", "systematics"], [24, 3, 1, "", "ttbar_bkg_weight_norm"]], "visualization": [[25, 1, 1, "", "Dataset_visualise"], [25, 3, 1, "", "custom_pretty_print"], [25, 3, 1, "", "roc_curve_wrapper"], [25, 3, 1, "", "visualize_coverage"], [25, 3, 1, "", "visualize_scatter"]], "visualization.Dataset_visualise": [[25, 2, 1, "", "correlation_plots"], [25, 2, 1, "", "event_vise_syst"], [25, 2, 1, "", "event_vise_syst_arrow"], [25, 2, 1, "", "examine_dataset"], [25, 2, 1, "", "histogram_dataset"], [25, 2, 1, "", "histogram_syst"], [25, 2, 1, "", "pair_plots"], [25, 2, 1, "", "pair_plots_syst"], [25, 2, 1, "", "stacked_histogram"]]}, "objnames": {"0": ["py", "module", "Python module"], "1": ["py", "class", "Python class"], "2": ["py", "method", "Python method"], "3": ["py", "function", "Python function"]}, "objtypes": {"0": "py:module", "1": "py:class", "2": "py:method", "3": "py:function"}, "terms": {"": [3, 5, 6, 9, 16, 21], "0": [3, 4, 5, 6, 12, 17, 19, 21, 22, 24, 25], "000": 7, "001": 19, "1": [0, 2, 4, 5, 6, 12, 16, 18, 24, 25], "10": [3, 4, 5, 21, 23, 25], "100": [3, 5, 16, 21, 25], "1000": 5, "1298f0a8": 2, "13": [4, 12], "14th": 7, "15": [3, 21], "150": [3, 21], "1500": 7, "16": 5, "16th": [17, 19, 22], "1d": 6, "1e": 19, "2": [2, 4, 5, 7, 12, 17, 22, 25], "20": 24, "2012": 6, "2014": [0, 1], "2024": [1, 7, 12], "20gev": 4, "25": 25, "26": 24, "26gev": 4, "27": [5, 6], "3": [2, 3, 4, 5, 12, 19, 21], "30": 25, "31415": [14, 15, 24], "3f609d1835b2": 4, "4": [2, 5, 13], "42": [17, 22], "4da4": 4, "4db3": 4, "5": [3, 4, 12, 21], "500": 7, "5gb": 0, "6": [0, 3, 21], "68": [5, 6], "8": [4, 12], "84": 5, "84th": [17, 19, 22], "A": [3, 6, 12, 17, 19, 21, 22, 23, 25], "By": 12, "For": [0, 3, 5, 12, 19, 21, 24], "If": [2, 3, 5, 12, 17, 21, 22], "In": [5, 6, 7, 8, 9], "It": [0, 1, 3, 6, 8, 9, 16, 21], "NOT": 4, "Not": 5, "One": [0, 6, 18], "The": [0, 1, 2, 3, 4, 5, 6, 7, 8, 11, 12, 14, 15, 17, 19, 21, 22, 23, 24, 25], "There": [0, 1, 6], "These": [0, 1, 4], "To": [2, 8, 9, 12, 16], "_": 4, "__file__": 8, "__test_set": 12, "__train_set": 12, "_print": 19, "abl": 5, "about": [0, 1, 2, 4, 6, 25], "absenc": 6, "absolut": [4, 13, 19], "abspath": 8, "accordingli": 24, "account": [3, 21], "accuraci": 6, "ad": 17, "add": 6, "addit": [4, 6, 7, 9, 24], "address": 9, "adher": 9, "advanc": [0, 1], "advantag": 2, "advic": 4, "after": [4, 24], "against": 6, "agre": 7, "ai": [0, 1], "aim": 6, "aishik": 1, "algorithm": 6, "all": [2, 3, 4, 7, 9, 13, 21, 24, 25], "all_bkg_weight_norm": 24, "allow": [1, 4, 8, 9], "alpha": [3, 21, 23], "alpha_funct": [3, 21, 23], "alpha_list": 23, "alpha_nam": 23, "alpha_rang": 23, "alreadi": 12, "also": [0, 1, 6, 8], "an": [0, 1, 2, 4, 5, 6, 9, 12], "analys": 6, "analysi": [0, 1, 9, 17, 18, 23], "analyz": [3, 4, 21], "angl": 4, "ani": [4, 6, 9], "announc": 1, "answer": 6, "appli": [3, 4, 6, 21, 24], "applic": [1, 3, 21], "approach": 6, "approxim": 8, "ar": [0, 1, 2, 3, 4, 5, 6, 8, 9, 12, 21, 24], "archiv": 8, "arg": [11, 13, 14, 15, 17, 19, 23, 24, 25], "arrai": [11, 19, 23, 24], "ask": 6, "associ": 9, "assum": 2, "assumpt": 5, "atla": [4, 6, 12], "atribut": [17, 19], "attribut": [11, 12, 14, 15, 23, 25], "automat": 0, "avail": [0, 1, 2, 6], "averag": 5, "avoid": 19, "awar": [0, 1], "award": 7, "azimuth": 4, "b": [3, 21, 25], "b1f8": 4, "b9e59d0a": 4, "background": [0, 1, 3, 6, 10, 12, 17, 21, 23, 24], "background_fit": 23, "badzipfil": 12, "balanc": [17, 22], "balance_set": 17, "bar": [4, 12], "base": [3, 5, 6, 11, 12, 14, 15, 17, 19, 21, 22, 23, 25], "bash": 2, "becaus": [3, 21], "been": [4, 7], "befor": [3, 6, 21], "beforehand": [3, 21], "behind": [0, 1], "being": 6, "below": [2, 3, 6, 21], "benjamin": 1, "best": [0, 1, 5], "beta": [6, 23], "between": [3, 4, 6, 13, 19, 21, 25], "beyond": 0, "bhimji": 1, "bia": 6, "bigger": 12, "bin": [2, 3, 6, 21, 23, 25], "bkg": [3, 16, 21], "bkg_scale": [3, 6, 12, 21, 24], "block": 12, "bool": 17, "boost": 11, "boosted_decision_tre": [0, 3, 18, 21], "boosteddecisiontre": 11, "bootstrap": 24, "boson": [0, 1, 6, 10, 12], "both": [3, 6, 21], "bound": [17, 22], "boundari": 1, "breakdown": [0, 1], "browser": 2, "build": 6, "built": [3, 21], "bunch": 4, "c": 5, "calcul": [5, 13, 17, 22, 23], "calcul_int": 13, "calculate_saved_info": [0, 3, 18, 21, 22, 23], "calibr": [0, 1], "call": 9, "callabl": 17, "can": [0, 1, 2, 3, 6, 8, 12, 16, 17, 21, 22], "cap": 4, "care": 6, "case": [0, 8, 18], "cdot": [3, 21], "center": [4, 12], "central": [4, 5, 13], "cern": [6, 7], "chakkappai": 1, "chalearn": 9, "challeng": [2, 3, 4, 5, 7, 8, 9, 21, 24], "chang": [4, 6, 8, 9], "channel": [1, 6], "chareg": 4, "charg": 4, "check": 2, "checkout": 2, "chieh": 1, "chosen": [3, 21], "chou": 1, "chri": 1, "class": [8, 11, 12, 14, 15, 17, 19, 22, 23, 25], "classifi": [6, 11], "clean": 13, "click": [0, 1, 8], "clone": 2, "close": 6, "closer": [4, 12], "cm": 6, "codabench": [0, 1, 4, 9], "code": [0, 1, 8, 9, 12, 16], "coeffici": [3, 21], "coefficient_list": 23, "coher": 6, "colab": [0, 1, 8], "collect": 4, "collid": 6, "collis": [4, 6, 12], "color": 25, "column": [13, 25], "com": [2, 8], "combin": 23, "come": 4, "command": [2, 4, 16], "competit": [0, 1, 5, 7, 8, 9, 16, 19], "complet": 2, "complic": 6, "compon": [3, 6, 13, 21], "composit": 6, "comput": [14, 15, 17, 19, 22], "compute_mu": [0, 3, 18, 21, 22, 23], "compute_result": [14, 15], "compute_scor": [19, 20], "concern": [0, 1], "condit": [7, 24], "confid": [0, 1, 5, 6], "confirm": 9, "consid": [4, 6, 25], "consist": 5, "constrain": 6, "constraint": [3, 21], "construct": 6, "consult": 6, "contain": [0, 1, 2, 5, 12, 13, 17, 22, 23, 24, 25], "content": 19, "contest": 9, "context": [0, 1], "contribut": 9, "control": [0, 1], "copi": [2, 8, 13], "correct": [0, 9], "correl": 25, "correlation_plot": 25, "correspond": [3, 6, 11, 21], "could": [2, 9], "count": 6, "cours": 9, "coverag": [0, 5, 6, 25], "creat": [3, 4, 12, 21], "creation": [3, 21], "credenti": 9, "credibl": 1, "criteria": 4, "cross": 4, "current": [2, 3, 9, 21], "curv": 25, "custom": [3, 21], "custom_pretty_print": 25, "d": 25, "dai": 8, "dark": 6, "data": [0, 1, 3, 5, 6, 8, 10, 11, 12, 13, 14, 15, 16, 17, 21, 22, 23, 24, 25], "data_set": [17, 22, 24, 25], "datafram": [11, 13, 24, 25], "dataset": [0, 1, 3, 4, 6, 13, 16, 17, 18, 21, 22, 24, 25], "dataset_visualis": 25, "datetim": [14, 15, 19], "david": [1, 13, 24], "deal": [3, 21], "dec": 7, "decai": [4, 6], "decid": [3, 21], "decis": 11, "dedic": [2, 7], "default": [3, 6, 12, 17, 19, 21, 23, 25], "defin": [3, 4, 5, 6, 21], "delet": [12, 13], "delete_train_set": 12, "delph": [4, 12], "delta": [5, 13], "delta_mu_hat": [17, 19, 22, 23], "demonstr": [3, 8, 21], "depend": 2, "depth": 2, "der": 13, "der_data": 13, "der_deltaeta_jet_jet": 4, "der_deltar_had_lep": 4, "der_lep_eta_centr": 4, "der_mass_jet_jet": 4, "der_mass_transverse_met_lep": 4, "der_mass_vi": 4, "der_met_phi_centr": 4, "der_prodeta_jet_jet": 4, "der_pt_h": 4, "der_pt_ratio_lep_tau": 4, "der_pt_tot": 4, "der_sum_pt": 4, "deriv": [3, 6, 13, 21], "derived_quant": [0, 4, 16, 18], "describ": [0, 1, 5], "descript": [4, 12], "design": [0, 1], "desir": [5, 6], "despit": 6, "detail": [0, 1, 4, 6, 12, 19, 24, 25], "detailed_label": [17, 25], "detailedlabel": [4, 24], "detect": 6, "detector": [0, 1, 4, 6, 12], "determin": [5, 6, 7], "develop": [1, 6], "deviat": 5, "devic": 8, "df_syst": 25, "dfall": 25, "diboson": [3, 4, 6, 12, 16, 21, 24], "diboson_bkg_weight_norm": 24, "diboson_scal": [3, 6, 12, 21, 24], "dict": [12, 14, 15, 17, 19, 22, 23, 24, 25], "dictionari": [12, 17, 19, 22, 23, 25], "diefenbach": 1, "differ": [2, 5, 6, 9, 13], "difficulti": 6, "dimension": [3, 21], "directli": [6, 13], "directori": [2, 8, 12, 14, 15], "dirnam": 8, "discoveri": 6, "disk": 11, "distinguish": [3, 21], "distort": 6, "distribut": [3, 5, 6, 19, 21], "divid": [3, 4, 12, 21], "divis": 19, "do": 9, "doc": 2, "document": 1, "doe": [5, 6], "doesn": [3, 21], "doesnt": 4, "domin": 6, "dont": 2, "dopostprocess": [12, 24], "download": [0, 1, 4, 8, 12], "dudlei": 1, "dummi": [0, 1], "durat": [14, 15, 19], "dure": [3, 6, 7, 21], "e": [1, 3, 4, 6, 13, 21], "each": [3, 5, 6, 21, 23, 25], "early_stopping_round": [3, 21], "eas": 5, "edg": 23, "educ": 9, "effect": 4, "electron": [4, 6], "elham": 1, "elig": [7, 9], "email": [1, 8, 9], "emphasis": 1, "encourag": [1, 8], "end": [14, 15, 19], "end_tim": [14, 15, 19], "energi": [1, 3, 4, 6, 12, 21, 24], "engin": 2, "ensur": [3, 9, 21], "enter": 7, "entri": [0, 1, 9], "env": 2, "environ": 2, "ep": 19, "epsilon": 5, "equal": 17, "error": [3, 12, 19, 21], "essenti": [1, 4, 6], "estrad": [13, 24], "eta": 4, "etc": [0, 1, 13], "eval_metr": [3, 21], "eval_set": [3, 21], "evalu": [0, 1, 6, 7, 8, 10, 19], "event": [3, 4, 6, 12, 17, 21, 23, 24], "event_vise_syst": 25, "event_vise_syst_arrow": 25, "eventid": [6, 13], "everi": 5, "examine_dataset": 25, "exampl": [0, 5, 6, 18], "example_submiss": 8, "except": [3, 6, 21], "execut": 1, "expect": [0, 1, 5, 6, 8], "experi": [0, 1, 3, 4, 5, 6, 9, 16, 21], "experiment": [4, 12], "expert": 6, "explain": 6, "explor": 1, "export": [3, 21], "extract": 12, "f": [5, 6], "f_del_der": 13, "f_der_deltaeta_jet_jet": 13, "f_der_deltar_had_lep": 13, "f_der_lep_eta_centr": 13, "f_der_mass_jet_jet": 13, "f_der_mass_transverse_met_lep": 13, "f_der_mass_vi": 13, "f_der_met_phi_centr": 13, "f_der_prodeta_jet_jet": 13, "f_der_pt_h": 13, "f_der_pt_ratio_lep_had": 13, "f_der_pt_tot": 13, "f_der_sum_pt": 13, "face": 2, "facilit": [0, 1], "factor": [23, 24], "fail": 8, "fair": [2, 8, 9, 24], "fair_univers": 2, "fals": [12, 17, 22, 23], "familiar": 6, "farrel": 1, "fb": 4, "feasibl": [3, 21], "featur": [3, 6, 10, 21, 25], "few": 5, "field": [0, 25], "field_nam": 25, "figur": 19, "file": [1, 3, 8, 11, 12, 14, 15, 19, 21, 23], "file_path": [3, 21, 23], "filenotfounderror": 12, "final": [4, 5, 7], "find": [3, 21], "first": [1, 2, 6, 7, 16], "fit": [11, 14, 15, 17, 22, 23], "fit_funct": 23, "fit_function_": 23, "fit_function_b": 23, "fit_submiss": [14, 15], "fix": [3, 21], "fixed_syst": 23, "float": [3, 17, 19, 21, 23, 24, 25], "focu": 6, "focus": [1, 6], "folder": 21, "follow": [0, 2, 3, 4, 6, 7, 8, 9, 16, 17, 21, 22, 24], "format": 8, "found": [2, 12], "four": 12, "frac": [4, 5], "fraction": [5, 6], "from": [0, 3, 4, 5, 6, 8, 9, 11, 12, 21, 23], "frugal": 7, "full": [0, 1, 5], "function": [3, 4, 5, 13, 17, 21, 22, 23, 24], "fund": 7, "further": [3, 4, 6, 21], "furthermor": 6, "g": [3, 21], "gamma": [6, 23], "gaussian": [3, 5, 21], "ge": 5, "gener": [2, 3, 4, 9, 12, 21, 24], "geneva": [6, 7], "get": [0, 9, 10, 12, 14, 15, 17, 19], "get_bootstrapped_dataset": 24, "get_dur": [14, 15, 19], "get_syst_train_set": 12, "get_systematics_dataset": 24, "get_test_set": 12, "get_train_set": [12, 17, 22], "ghosh": 1, "git": 2, "github": [0, 1, 2, 8], "give": [2, 6], "given": [5, 6, 8, 23], "go": 1, "goal": 6, "good": 2, "googl": [0, 1, 8], "gov": 1, "govern": 9, "grant": 9, "graph": 5, "great": 6, "ground": 25, "ground_truth_mu": 25, "group": [1, 4, 12], "guyon": 1, "h": [4, 6, 12], "ha": [2, 3, 6, 12, 21], "had": 4, "hadron": [4, 6, 13], "halt": [3, 21], "handl": [14, 15], "harri": 1, "hat": 5, "have": [2, 4, 5, 6, 7, 8], "help": [0, 1, 4, 8, 9], "henc": [3, 4, 8, 21], "hep": [1, 2, 3, 8, 13, 21], "here": [0, 3, 5, 8, 21], "higg": [0, 1, 6, 10, 12], "higgsml": [0, 9], "high": [1, 6], "hist": 8, "histogram": [6, 23, 25], "histogram_dataset": 25, "histogram_syst": 25, "histori": 6, "hold": 6, "holdout": 23, "holdout_set": [3, 21, 23], "host": [0, 1, 2], "how": [6, 10], "howev": [5, 6], "hsu": 1, "htautau": [4, 24], "html": 19, "http": [1, 2, 4, 8], "httperror": 12, "hyperparamet": [3, 21], "i": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 12, 13, 16, 17, 19, 21, 22, 24], "ignor": 8, "ihsan": 1, "imag": [2, 25], "iminuit": [3, 21], "impact": [0, 1, 6], "implement": [3, 11, 21], "import": [3, 12, 21], "impract": [3, 21], "improv": [3, 6, 21], "includ": [0, 1, 4, 6, 9, 12, 25], "independ": 9, "index": 0, "infer": 6, "inform": [0, 1, 6, 9, 17, 22, 23, 25], "ingest": [0, 15, 18, 19, 25], "ingestion_dur": 19, "ingestion_duration_fil": 19, "ingestion_parallel": [0, 16, 18], "ingestion_result": 19, "ingestion_result_dict": 25, "inher": 4, "init_submiss": [14, 15], "initi": [14, 15], "initial_se": [14, 15], "input": [1, 6, 8, 11, 12, 13, 24], "input_dir": 12, "instal": 2, "instead": 5, "institut": 9, "instruct": [2, 8], "int": [17, 19, 23, 24, 25], "integ": 4, "integr": 5, "interact": 2, "interest": 6, "interfac": [3, 21], "interfer": 4, "interv": [0, 1, 6], "invari": [4, 13], "invit": 7, "involv": [3, 21], "io": 2, "ipynb": 2, "isabel": 1, "isol": 6, "issu": 9, "its": 6, "je": [3, 6, 12, 16, 21, 24], "jet": [3, 4, 6, 13, 21, 24], "jordan": 1, "json": [3, 21], "jupyt": 2, "juri": 7, "kaggl": [0, 1, 6], "keep": 13, "kei": [17, 22, 23, 25], "kept": 4, "khoda": 1, "kind": 9, "kit": [0, 1, 2, 6, 12], "knowledg": 6, "label": [3, 4, 6, 11, 17, 21, 23, 24, 25], "larg": 6, "larger": 4, "largest": 4, "last": 6, "lbl": 1, "le": 5, "lead": [4, 9], "learn": [1, 6], "learning_r": [3, 21], "left": 5, "lep": 4, "lepton": [4, 6, 13], "level": [0, 1], "lhc": 6, "libomp": 2, "like": [1, 4, 6, 11, 12, 24], "likelihood": [3, 5, 6, 21, 23], "line": 25, "linear": 25, "link": 2, "list": [19, 23, 25], "ln": 5, "load": [3, 8, 11, 12, 14, 15, 16, 17, 19, 21, 22, 23], "load_ingestion_dur": [19, 20], "load_ingestion_result": [19, 20], "load_state_dict": 8, "load_test_set": 12, "load_train_set": [12, 14, 15], "local": [1, 2], "locat": [8, 19], "log": [3, 21], "log_i": 23, "logloss": [3, 21], "long": 6, "low": [3, 21], "lower": [17, 22], "luminos": 4, "lw": 25, "mac": 2, "machin": [1, 2, 6], "made": [4, 5, 6], "mae": 19, "mae_scor": [19, 20], "magnitud": 6, "mai": [2, 6, 8], "main": [2, 3, 5, 6, 21], "maintain": 5, "major": 6, "make": [2, 4, 6, 8, 9, 12, 13, 14, 15], "make_unweighted_set": 24, "mani": 6, "manipul": 24, "manual": 6, "map_loc": 8, "mass": [4, 5, 12, 13], "master": [1, 8], "matric": 25, "matter": 6, "max_depth": [3, 21], "maximis": 5, "maximum": [6, 8], "mean": [3, 6, 19, 21], "meant": 5, "measur": [0, 1, 4, 6, 12], "met": [3, 13, 16, 21, 24], "method": [5, 6, 11, 12, 15, 17, 19, 23, 25], "metric": [0, 1], "mileston": 6, "mimick": 6, "minim": [3, 21], "minimis": 5, "miss": [3, 4, 6, 21], "ml": 1, "mode": [4, 6], "model": [0, 1, 2, 3, 4, 5, 6, 7, 8, 11, 14, 15, 18, 23, 25], "model_dir": 8, "model_nam": 11, "model_path": 11, "model_syst_nam": [3, 21], "model_xgb": [3, 21], "modifi": [8, 13], "modul": [16, 20, 21], "moduli": 4, "modulu": 4, "mom4_manipul": 24, "momenta": 4, "momentum": [4, 13], "monetari": 7, "more": [6, 12, 19], "mu": [3, 5, 16, 17, 19, 21, 22, 23, 24, 25], "mu_": 5, "mu_hat": [17, 19, 22, 23, 25], "multipl": [9, 23], "muon": [4, 6], "must": [7, 9], "my": 1, "mysteri": 6, "n": 5, "n_estim": [3, 21], "n_ob": 23, "nachman": 1, "name": [11, 17, 23, 25], "natur": 6, "nbin": 25, "ndarrai": [23, 25], "necessari": 6, "need": [2, 3, 13, 21], "neg": [3, 21], "nersc": 2, "net": 8, "neurip": [1, 7, 12], "neurips2024_public_dataset": 12, "neurips_public_data_26_08_2024": 4, "new_t": [3, 21], "next": 2, "nll": [3, 21], "nobel": 6, "nomin": [3, 21, 23], "nominal_histogram": 23, "none": [11, 12, 14, 15, 17, 19, 22, 23, 24, 25], "normal": [3, 11, 21], "note": [3, 4, 9, 21], "notebook": [0, 1, 2, 8], "notifi": 9, "novelti": 7, "np": [3, 6, 8, 19, 21], "npy": 8, "nu": 6, "nuisanc": [3, 6, 21], "num": [3, 16, 21], "number": [4, 6, 17, 19, 23, 25], "numer": [5, 6], "numpi": [8, 23], "o": [2, 4, 8], "object": [3, 6, 11, 12, 14, 15, 17, 19, 21, 22, 23, 25], "observ": [6, 23], "obtain": [3, 21], "offici": [8, 9], "onc": 8, "one": [1, 3, 4, 5, 6, 21], "onli": [0, 1, 4, 6, 9, 18], "opportun": 1, "opposit": 4, "optim": 6, "option": [11, 17, 19, 23, 25], "order": [6, 9], "org": 4, "organ": 9, "organis": 0, "organiz": 9, "origin": [13, 24], "other": [3, 4, 5, 6, 9, 21, 24], "our": [1, 2, 8, 9], "outgo": 6, "output": [1, 3, 14, 15, 21], "output_dir": [14, 15], "over": 5, "overal": 5, "overview": [0, 5], "p16": [17, 19, 22, 23], "p84": [17, 19, 22, 23], "p_t": 4, "p_x": 4, "p_y": 4, "packag": [2, 3, 21], "page": [5, 12, 19], "pair": 25, "pair_plot": 25, "pair_plot_syst": 25, "pair_plots_syst": 25, "panda": [11, 13, 24], "paper": [0, 1], "parallel": [8, 16], "param": 22, "paramet": [3, 4, 6, 12, 13, 21, 22, 23, 25], "parametr": [3, 21], "parametris": 6, "part": [3, 5, 21], "particip": [0, 1, 5, 6, 7, 8, 16, 17], "particl": [4, 6, 12, 13], "particular": 6, "partip": 4, "path": [2, 8, 11, 12, 23], "penalis": 5, "per": 8, "percentil": [17, 19, 22], "perform": [0, 1, 3, 7, 21, 23], "period": 6, "phase": 7, "phenomena": 6, "phi": 4, "photon": 4, "physic": [1, 4, 6, 12], "pip": 2, "pipelin": 16, "pkl": [3, 21, 23], "place": [7, 8], "platform": [0, 1], "pleas": [8, 9], "plot": [23, 25], "plot_label": 25, "plot_stacked_histogram": 23, "png": 25, "point": [3, 21, 23], "poisson": [6, 24], "polynomi": [3, 21, 23], "possibl": [4, 6], "post": [4, 9], "postprocess": 24, "practic": 7, "pre": [1, 3, 4, 8, 21], "precis": 6, "predict": [3, 5, 6, 8, 9, 11, 14, 15, 17, 19, 21, 22, 23, 25], "predict_proba": [3, 21], "predict_submiss": [14, 15], "prediction_dir": 19, "prerog": 9, "presenc": [0, 6], "present": 1, "prevent": 9, "previou": 6, "pri": 4, "pri_had_eta": 4, "pri_had_phi": 4, "pri_had_pt": [4, 24], "pri_jet_all_pt": 4, "pri_jet_leading_eta": 4, "pri_jet_leading_phi": 4, "pri_jet_leading_pt": [4, 24], "pri_jet_num": 4, "pri_jet_subleading_eta": 4, "pri_jet_subleading_phi": 4, "pri_jet_subleading_pt": [4, 24], "pri_lep_eta": 4, "pri_lep_phi": 4, "pri_lep_pt": [4, 24], "pri_met": 4, "pri_met_phi": 4, "primari": 24, "primit": 4, "print": [19, 25], "prize": [6, 9], "probabl": [3, 5, 6, 11, 21], "problem": [2, 8], "process": [2, 3, 4, 6, 9, 14, 15, 19, 21], "produc": [4, 6, 12], "product": [4, 6, 13], "profil": [6, 23], "program": [0, 18], "project": 0, "promiss": 6, "proper": 9, "properti": [6, 13], "propos": 6, "proton": [4, 6, 12], "provid": [0, 1, 3, 5, 6, 8, 9, 21], "pseudo": [0, 3, 5, 9, 16, 21], "pseudorapid": [4, 13], "pt": 24, "pth": 8, "public": [0, 10, 12], "public_data": 4, "public_dataset": 12, "pull": 2, "purpos": 9, "push": [0, 1], "px": 13, "py": [2, 3, 4, 8, 13, 16, 21], "pythia": [4, 12], "pythia8": [4, 12], "python3": [3, 12, 16, 21], "pytorch": 8, "pz": 13, "quantif": [1, 5], "quantil": [10, 19], "quantiles_scor": [19, 20], "quantiti": [4, 6, 13], "question": 6, "r": [4, 13], "ragansu": 1, "rais": 12, "random": [3, 6, 16, 17, 21, 24], "random_st": [17, 22], "rang": [6, 23], "rate": 6, "rather": [1, 8], "ratio": [4, 6, 13], "raw": 4, "re_train": [17, 22], "real": 8, "realist": 6, "reason": 8, "recomput": 24, "regard": [0, 1], "region": 5, "regist": [0, 1, 8, 9], "regular": 4, "relat": [3, 6, 21], "remain": [3, 21], "repeat": [3, 21], "repeat_rows_by_weight": 24, "repo": [0, 1, 8, 12], "repositori": 2, "repres": [3, 6, 12, 21], "represent": 9, "request": 5, "requir": 5, "resourc": [1, 7], "respect": [5, 6], "respons": [8, 16], "result": [3, 9, 14, 15, 17, 19, 21, 22, 25], "retain": 9, "retrain": 1, "retriev": [3, 21], "return": [5, 6, 11, 12, 13, 14, 15, 17, 22, 23, 24], "reweight": [17, 22], "right": [2, 5], "rightarrow": [4, 6, 12], "rise": 6, "rmse": [3, 19, 21], "rmse_scor": [19, 20], "robust": [1, 6], "roc": 25, "roc_curve_wrapp": 25, "role": 4, "root": 19, "rousseau": [1, 13, 24], "rule": 9, "run": [2, 9, 12, 16], "run_ingest": [3, 16, 21], "same": [3, 6, 8, 21], "sampl": [0, 1, 11, 12, 25], "sample_s": 25, "sample_weight_eval_set": [3, 21], "sascha": 1, "saturdai": 7, "save": [3, 11, 14, 15, 17, 19, 21, 22, 23], "save_dur": [14, 15], "save_figur": [19, 20], "save_nam": 23, "save_result": [14, 15], "saved_info": [22, 23], "saved_info_model_xgb": [3, 21], "scalar": 4, "scale": [3, 6, 16, 21, 24], "scaler": [3, 11, 21], "scatter": 25, "scenario": [3, 4, 21], "scienc": [0, 1], "score": [0, 6, 7, 10, 18, 22, 23, 25], "score_dir": 19, "scores_dict": 19, "search": 0, "second": [4, 7], "secret": 6, "section": [3, 4, 21], "secur": 8, "see": [5, 8, 12, 19], "seed": 24, "select": [4, 6, 24], "self": [3, 11, 21], "separ": 4, "seri": 25, "serialis": 8, "serv": [0, 1], "session": 7, "set": [3, 4, 5, 9, 14, 15, 16, 17, 19, 21, 22, 23], "setup": [2, 3, 21], "sever": [0, 1], "share": 9, "shell": 2, "shift": 6, "shih": 1, "short": 7, "should": [0, 1, 3, 4, 5, 6, 21], "show": 19, "show_dur": 19, "sigma_": 5, "signal": [0, 1, 5, 6, 10, 12, 17, 23], "signal_fit": 23, "signatur": 6, "similar": 4, "simpl": [0, 18], "simple_one_syst_model": [3, 11, 17, 21, 23], "simple_stat_only_model": 22, "simpli": 6, "simul": [4, 6, 12], "sinc": [2, 5], "six": [3, 6, 21], "size": [5, 17], "skill": 1, "slack": 1, "slide": [0, 1], "sm": 6, "small": [6, 19], "smaller": 6, "so": [5, 6, 13], "soft": [3, 6, 16, 21, 24], "soft_met": [3, 6, 12, 21, 24], "solut": 8, "some": [5, 6], "sourc": [0, 1, 2], "special": [4, 7], "specif": [0, 1, 5, 6, 23, 25], "split": [3, 17, 21], "sqrt": [4, 5], "squar": 19, "stack": [23, 25], "stacked_histogram": 25, "standard": [5, 6], "standardscal": [3, 11, 21], "start": [0, 1, 6, 12, 14, 15, 19], "start_tim": [14, 15, 19], "startingkit_higgsml_uncertainty_challeng": 2, "stat": [0, 18], "stat_analysi": 17, "stat_onli": 23, "state": [4, 17], "statist": [0, 1, 6, 17, 18, 23], "statistical_analysi": [0, 3, 18, 21], "statisticalanalysi": 23, "step": [2, 16], "steven": 1, "still": [1, 2, 6], "stipul": 9, "stop": [14, 15, 19], "stop_tim": [14, 15, 19], "store": [3, 21], "str": [11, 12, 14, 15, 17, 19, 23, 25], "strategi": 2, "strength": [0, 1, 5, 6], "strongli": 1, "structur": 21, "studi": 6, "sublead": 4, "submiss": [0, 1, 3, 6, 17, 21], "submit": [0, 1, 7, 8, 14, 15, 17], "subsequ": [4, 12], "suggest": [3, 5, 21], "sum": [4, 13], "sum_": 5, "suppos": 13, "sure": [8, 13], "switzerland": [6, 7], "symmetr": 5, "syst": [0, 18], "syst_set": 23, "systbkgnorm": 24, "system": [13, 25], "systemat": [0, 1, 4, 6, 12, 16, 17, 18, 22, 23], "systjetenergyscal": 24, "systtauenergyscal": 24, "t": [3, 4, 12, 21], "tab": [1, 6, 8], "tabular": [4, 12], "take": 9, "talk": 7, "tang": 1, "target": [5, 25], "task": [3, 21], "tau": [3, 4, 6, 12, 21], "tau_": 4, "te": [3, 6, 12, 16, 21, 24], "team": 9, "technic": 6, "techniqu": [0, 1], "templat": 8, "term": 7, "termin": 4, "test": [0, 1, 3, 4, 5, 6, 8, 9, 11, 12, 14, 15, 17, 19, 21, 22, 24], "test_data": 11, "test_set": [14, 15, 17, 19, 22, 24], "test_siz": [17, 22], "tev": [4, 12], "textrm": [4, 5], "than": [1, 8], "thei": 4, "them": [3, 21], "themselv": 6, "therebi": 0, "thi": [0, 2, 3, 4, 5, 6, 8, 9, 11, 12, 13, 17, 19, 21, 22, 24], "third": [6, 7], "those": 6, "though": 6, "three": [6, 7], "through": [1, 3, 21], "time": [3, 4, 5, 6, 8, 9, 14, 15, 19, 21], "timedelta": [14, 15], "timer": [14, 15, 19], "tip": [3, 21], "togeth": [6, 8], "tool": [4, 12], "top": 7, "torch": 8, "total": [3, 4, 5, 6, 13, 21], "tradition": 6, "train": [0, 1, 4, 6, 8, 11, 12, 14, 15, 17, 22, 23], "train_data": 11, "train_set": [8, 22, 23], "train_test_split": [0, 17, 18, 22], "training_set": 17, "transvers": [4, 13], "tree": [8, 11], "true": [3, 5, 6, 17, 19, 21, 22, 24], "true_mu": 19, "truth": 25, "ttbar": [3, 4, 6, 16, 21, 24], "ttbar_bkg_weight_norm": 24, "ttbar_scal": [3, 6, 12, 21, 24], "tty": 2, "tune": [3, 21], "tupl": 17, "tutori": [0, 1], "two": [3, 4, 5, 6, 13, 21], "u": 9, "ullah": 1, "unauthor": 9, "uncertain": 6, "uncertainti": [0, 3, 5, 9, 17, 19, 21, 22], "uncov": 6, "undefin": 4, "undergo": [4, 12], "underli": [5, 11], "understand": 8, "unicertain": 0, "uninstal": 2, "uniqu": 25, "univers": [2, 8, 9], "unnecessari": 13, "up": 7, "updat": 1, "upper": [17, 22], "us": [0, 1, 2, 3, 4, 5, 6, 8, 9, 11, 12, 13, 14, 15, 16, 17, 19, 21, 22, 23], "v": 25, "valid": [3, 6, 9, 12, 21], "valid_set": [3, 11, 21], "valu": [3, 4, 5, 6, 13, 17, 19, 21, 22, 23, 24, 25], "variabl": [6, 13], "variat": [3, 12, 21], "varibal": 4, "variou": 5, "vector": 4, "verbos": [3, 21], "verif": 9, "verifi": 9, "version": 2, "victor": [13, 24], "visit": 1, "visual": [0, 16, 18], "visualize_coverag": 25, "visualize_fit": 23, "visualize_scatt": 25, "volum": 2, "vv": [4, 12], "w": [4, 5], "w_i": 4, "wa": 6, "wahid": 1, "wai": [6, 8, 9], "want": [1, 2, 3, 8, 21], "we": [3, 4, 5, 6, 8, 12, 21], "websit": 1, "weight": [3, 4, 6, 11, 13, 17, 21, 22, 23, 24, 25], "weight_kei": 25, "weight_syst": 25, "well": [0, 1], "were": 13, "wget": 4, "what": [6, 8], "when": [4, 6], "where": 6, "whether": 17, "which": [0, 2, 3, 6, 7, 8, 21, 25], "while": [1, 3, 4, 5, 12, 21], "white": [0, 1], "width": [5, 25], "win": 6, "within": [1, 2, 6], "withing": 5, "without": [3, 21], "word": 5, "work": [3, 21], "workshop": 7, "workspac": 1, "worri": 2, "would": [3, 21], "write": [7, 19], "write_html": 19, "write_scor": 19, "written": [13, 24], "www": 4, "x": [5, 6], "x_train_data": [3, 21], "x_valid_data": [3, 21], "xgbclassifi": [3, 11, 21], "xgboost": [2, 3, 11, 21], "y_i": 4, "y_scale": 25, "yaun": 1, "yield": [3, 21], "you": [0, 1, 2, 3, 8, 9, 12, 13, 16, 21], "your": [1, 2, 6, 8, 9], "yourself": 16, "yulei": 1, "z": [6, 10, 12], "zero": 19, "zhang": 1, "zip": [4, 8, 12], "zipfil": 12, "ztautau": 4}, "titles": ["Welcome to FAIR Universe HEP Challenge\u2019s documentation!", "FAIR Universe - HiggsML Uncertainty Challenge", "Getting Started", "Example: Statistical-Only and 1-Systematic Case Analysis", "Data", "Evaluation", "Overview", "Prizes", "Starting Kit and Sample Submission", "Terms and Conditions", "Appendix", "Boosted_Decision_Tree module", "Datasets module", "Derived_quantities module", "Ingestion module", "Ingestion_parallel module", "Ingestion Program", "Model One Syst", "Core modules", "Score module", "Scoring Program", "Simple One Syst Model", "Simple Stat Only Model", "Statistical_Analysis module", "Systematics module", "Visualization module"], "titleterms": {"": 0, "1": [3, 21], "2": [3, 21], "One": [17, 21], "With": 2, "affili": 9, "analysi": [3, 21], "appendix": 10, "background": 4, "berkelei": 1, "boosted_decision_tre": 11, "boson": 4, "breakdown": [3, 21], "build": [3, 21], "case": [3, 21], "chalearn": 1, "challeng": [0, 1, 6], "classifi": [3, 21], "conda": 2, "condit": 9, "construct": 5, "contact": 1, "core": [0, 18], "credit": 1, "cut": 4, "data": 4, "dataset": 12, "deriv": 4, "derived_quant": 13, "detail": [3, 21], "disqualif": 9, "docker": 2, "document": 0, "dummi": 8, "estim": 6, "evalu": 5, "exampl": [3, 21], "extract": [3, 21], "fair": [0, 1], "featur": 4, "fit": [3, 21], "get": [2, 4], "guidelin": 9, "hep": 0, "higg": 4, "higgsml": 1, "how": [1, 3, 4, 21], "indic": 0, "ingest": [14, 16], "ingestion_parallel": 15, "interv": 5, "introduct": [1, 6], "irvin": 1, "join": 1, "kei": [3, 21], "kit": 8, "laboratori": 1, "lawrenc": 1, "learn": [3, 21], "less": 4, "machin": [3, 21], "model": [17, 21, 22], "modul": [0, 11, 12, 13, 14, 15, 18, 19, 23, 24, 25], "mu": 6, "nation": 1, "note": [2, 8], "onli": [3, 21, 22], "overview": [3, 6, 21], "page": 0, "pari": 1, "particip": 9, "prefix": 4, "preselect": 4, "primari": 4, "prize": 7, "problem": [3, 6, 21], "procedur": [3, 21], "profil": 9, "program": [16, 20], "public": 4, "quantil": 5, "registr": 9, "requir": 9, "run": [3, 21], "saclai": 1, "sampl": 8, "score": [5, 19, 20], "set": 6, "signal": [3, 4, 21], "simpl": [21, 22], "start": [2, 8], "stat": 22, "statist": [3, 21], "statistical_analysi": 23, "step": [3, 21], "strength": [3, 21], "submiss": 8, "syst": [17, 21], "systemat": [3, 21, 24], "tabl": 0, "target": 6, "templat": [3, 21], "term": 9, "thi": 1, "train": [3, 21], "uc": 1, "uncertainti": [1, 6], "univers": [0, 1], "universit\u00e9": 1, "variabl": 4, "visual": 25, "washington": 1, "welcom": 0, "workflow": [3, 21], "z": 4}}) \ No newline at end of file +Search.setIndex({"alltitles": {"1. Building Templates": [[3, "building-templates"], [21, "building-templates"]], "1. Machine Learning:": [[3, "machine-learning"], [21, "machine-learning"]], "2. Fitting Procedure": [[3, "fitting-procedure"], [21, "fitting-procedure"]], "2. Statistical Analysis:": [[3, "statistical-analysis"], [21, "statistical-analysis"]], "Appendix": [[10, null]], "Boosted_Decision_Tree module": [[11, null]], "ChaLearn": [[1, "chalearn"]], "Challenge target: Estimation of \\mu and uncertainty": [[6, "challenge-target-estimation-of-mu-and-uncertainty"]], "Constructing the Interval": [[5, "constructing-the-interval"]], "Contact": [[1, "contact"]], "Core Modules:": [[0, null]], "Core modules": [[18, null]], "Credits": [[1, "credits"]], "Data": [[4, null]], "Datasets module": [[12, null]], "Derived Features": [[4, "derived-features"]], "Derived_quantities module": [[13, null]], "Disqualification Terms": [[9, "disqualification-terms"]], "Dummy Sample Submission": [[8, "dummy-sample-submission"]], "Evaluation": [[5, null]], "Example Breakdown": [[3, "example-breakdown"], [21, "example-breakdown"]], "Example: Statistical-Only and 1-Systematic Case Analysis": [[3, null], [21, "example-statistical-only-and-1-systematic-case-analysis"]], "FAIR Universe - HiggsML Uncertainty Challenge": [[1, null]], "Features in the data": [[4, "features-in-the-data"]], "Getting Started": [[2, null]], "Hardware description": [[5, "hardware-description"]], "Higgs Signal:": [[4, "higgs-signal"]], "How to get Public Data?": [[4, "how-to-get-public-data"]], "How to join this challenge?": [[1, "how-to-join-this-challenge"]], "How to run it": [[3, "how-to-run-it"], [21, "how-to-run-it"]], "Indices and tables": [[0, "indices-and-tables"]], "Ingestion Program": [[16, null]], "Ingestion module": [[14, null]], "Ingestion_parallel module": [[15, null]], "Introduction": [[1, "introduction"], [6, "introduction"]], "Key Details:": [[3, "key-details"], [21, "key-details"]], "Lawrence Berkeley National Laboratory": [[1, "lawrence-berkeley-national-laboratory"]], "Machine Learning: Classifier Training": [[3, "machine-learning-classifier-training"], [21, "machine-learning-classifier-training"]], "Model One Syst": [[17, null]], "Overview": [[6, null]], "Pages:": [[0, null]], "Participant Affiliation Guidelines": [[9, "participant-affiliation-guidelines"]], "Prefix-less variables": [[4, "prefix-less-variables"]], "Preselection Cuts": [[4, "preselection-cuts"]], "Primary Features": [[4, "primary-features"]], "Prizes": [[7, null]], "Problem Overview": [[3, "problem-overview"], [21, "problem-overview"]], "Problem Setting": [[6, "problem-setting"]], "Quantiles Score": [[5, "quantiles-score"]], "Score module": [[19, null]], "Scoring": [[5, "scoring"]], "Scoring Program": [[20, null]], "Simple One Syst Model": [[21, null]], "Simple Stat Only Model": [[22, null]], "Starting Kit": [[8, "starting-kit"]], "Starting Kit and Sample Submission": [[8, null]], "Statistical Analysis: Signal Strength Extraction": [[3, "statistical-analysis-signal-strength-extraction"], [21, "statistical-analysis-signal-strength-extraction"]], "Statistical_Analysis module": [[23, null]], "Steps:": [[3, "steps"], [21, "steps"]], "Submission requirements": [[5, "submission-requirements"]], "Systematics module": [[24, null]], "Terms and Conditions": [[9, null]], "UC Irvine": [[1, "uc-irvine"]], "University of Washington": [[1, "university-of-washington"]], "Universit\u00e9 Paris-Saclay": [[1, "universite-paris-saclay"]], "Visualization module": [[25, null]], "Welcome to FAIR Universe HEP Challenge\u2019s documentation!": [[0, null]], "With Conda :": [[2, "with-conda"]], "With Docker": [[2, "with-docker"]], "Workflow Overview": [[3, "workflow-overview"], [21, "workflow-overview"]], "Z boson Background:": [[4, "z-boson-background"]], "\u26a0\ufe0f Note:": [[2, "note"], [8, "note"]], "\u2b07\ufe0f Dummy Sample Submission": [[8, "id1"]]}, "docnames": ["index", "pages/Front_page", "pages/Local_setup", "pages/advanced_example", "pages/data", "pages/evaluation", "pages/overview", "pages/prizes", "pages/starting_kit", "pages/terms", "rst_source/Appendix", "rst_source/boosted_decision_tree", "rst_source/datasets", "rst_source/derived_quantities", "rst_source/ingestion", "rst_source/ingestion_parallel", "rst_source/ingestion_program", "rst_source/model_one_syst", "rst_source/modules", "rst_source/score", "rst_source/scoring_program", "rst_source/simple_one_syst_model", "rst_source/simple_stat_only_model", "rst_source/statistical_analysis", "rst_source/systematics", "rst_source/visualization"], "envversion": {"sphinx": 64, "sphinx.domains.c": 3, "sphinx.domains.changeset": 1, "sphinx.domains.citation": 1, "sphinx.domains.cpp": 9, "sphinx.domains.index": 1, "sphinx.domains.javascript": 3, "sphinx.domains.math": 2, "sphinx.domains.python": 4, "sphinx.domains.rst": 2, "sphinx.domains.std": 2}, "filenames": ["index.rst", "pages/Front_page.md", "pages/Local_setup.md", "pages/advanced_example.md", "pages/data.md", "pages/evaluation.md", "pages/overview.md", "pages/prizes.md", "pages/starting_kit.md", "pages/terms.md", "rst_source/Appendix.rst", "rst_source/boosted_decision_tree.rst", "rst_source/datasets.rst", "rst_source/derived_quantities.rst", "rst_source/ingestion.rst", "rst_source/ingestion_parallel.rst", "rst_source/ingestion_program.rst", "rst_source/model_one_syst.rst", "rst_source/modules.rst", "rst_source/score.rst", "rst_source/scoring_program.rst", "rst_source/simple_one_syst_model.rst", "rst_source/simple_stat_only_model.rst", "rst_source/statistical_analysis.rst", "rst_source/systematics.rst", "rst_source/visualization.rst"], "indexentries": {"all_bkg_weight_norm() (in module systematics)": [[24, "systematics.all_bkg_weight_norm", false]], "alpha_function() (simple_one_syst_model.statistical_analysis.statisticalanalysis method)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis.alpha_function", false]], "balance_set() (in module simple_one_syst_model.model)": [[17, "simple_one_syst_model.model.balance_set", false]], "boosteddecisiontree (class in simple_one_syst_model.boosted_decision_tree)": [[11, "simple_one_syst_model.boosted_decision_tree.BoostedDecisionTree", false]], "calcul_int() (in module derived_quantities)": [[13, "derived_quantities.calcul_int", false]], "calculate_saved_info() (in module simple_stat_only_model.model)": [[22, "simple_stat_only_model.model.calculate_saved_info", false]], "calculate_saved_info() (simple_one_syst_model.statistical_analysis.statisticalanalysis method)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis.calculate_saved_info", false]], "compute_mu() (in module simple_stat_only_model.model)": [[22, "simple_stat_only_model.model.compute_mu", false]], "compute_mu() (simple_one_syst_model.statistical_analysis.statisticalanalysis method)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis.compute_mu", false]], "compute_result() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.compute_result", false]], "compute_result() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.compute_result", false]], "compute_scores() (score.scoring method)": [[19, "score.Scoring.compute_scores", false]], "correlation_plots() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.correlation_plots", false]], "custom_pretty_print() (in module visualization)": [[25, "visualization.custom_pretty_print", false]], "data (class in datasets)": [[12, "datasets.Data", false]], "dataset_visualise (class in visualization)": [[25, "visualization.Dataset_visualise", false]], "datasets": [[12, "module-datasets", false]], "delete_train_set() (datasets.data method)": [[12, "datasets.Data.delete_train_set", false]], "der_data() (in module derived_quantities)": [[13, "derived_quantities.DER_data", false]], "derived_quantities": [[13, "module-derived_quantities", false]], "diboson_bkg_weight_norm() (in module systematics)": [[24, "systematics.diboson_bkg_weight_norm", false]], "event_vise_syst() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.event_vise_syst", false]], "event_vise_syst_arrow() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.event_vise_syst_arrow", false]], "examine_dataset() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.examine_dataset", false]], "f_del_der() (in module derived_quantities)": [[13, "derived_quantities.f_del_DER", false]], "f_der_deltaeta_jet_jet() (in module derived_quantities)": [[13, "derived_quantities.f_DER_deltaeta_jet_jet", false]], "f_der_deltar_had_lep() (in module derived_quantities)": [[13, "derived_quantities.f_DER_deltar_had_lep", false]], "f_der_lep_eta_centrality() (in module derived_quantities)": [[13, "derived_quantities.f_DER_lep_eta_centrality", false]], "f_der_mass_jet_jet() (in module derived_quantities)": [[13, "derived_quantities.f_DER_mass_jet_jet", false]], "f_der_mass_transverse_met_lep() (in module derived_quantities)": [[13, "derived_quantities.f_DER_mass_transverse_met_lep", false]], "f_der_mass_vis() (in module derived_quantities)": [[13, "derived_quantities.f_DER_mass_vis", false]], "f_der_met_phi_centrality() (in module derived_quantities)": [[13, "derived_quantities.f_DER_met_phi_centrality", false]], "f_der_prodeta_jet_jet() (in module derived_quantities)": [[13, "derived_quantities.f_DER_prodeta_jet_jet", false]], "f_der_pt_h() (in module derived_quantities)": [[13, "derived_quantities.f_DER_pt_h", false]], "f_der_pt_ratio_lep_had() (in module derived_quantities)": [[13, "derived_quantities.f_DER_pt_ratio_lep_had", false]], "f_der_pt_tot() (in module derived_quantities)": [[13, "derived_quantities.f_DER_pt_tot", false]], "f_der_sum_pt() (in module derived_quantities)": [[13, "derived_quantities.f_DER_sum_pt", false]], "fit() (simple_one_syst_model.boosted_decision_tree.boosteddecisiontree method)": [[11, "simple_one_syst_model.boosted_decision_tree.BoostedDecisionTree.fit", false]], "fit() (simple_one_syst_model.model.model method)": [[17, "simple_one_syst_model.model.Model.fit", false]], "fit() (simple_stat_only_model.model.model method)": [[22, "simple_stat_only_model.model.Model.fit", false]], "fit_submission() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.fit_submission", false]], "fit_submission() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.fit_submission", false]], "get_bootstrapped_dataset() (in module systematics)": [[24, "systematics.get_bootstrapped_dataset", false]], "get_duration() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.get_duration", false]], "get_duration() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.get_duration", false]], "get_syst_train_set() (datasets.data method)": [[12, "datasets.Data.get_syst_train_set", false]], "get_systematics_dataset() (in module systematics)": [[24, "systematics.get_systematics_dataset", false]], "get_test_set() (datasets.data method)": [[12, "datasets.Data.get_test_set", false]], "get_train_set() (datasets.data method)": [[12, "datasets.Data.get_train_set", false]], "histogram_dataset() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.histogram_dataset", false]], "histogram_syst() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.histogram_syst", false]], "ingestion": [[14, "module-ingestion", false]], "ingestion (class in ingestion)": [[14, "ingestion.Ingestion", false]], "ingestion (class in ingestion_parallel)": [[15, "ingestion_parallel.Ingestion", false]], "ingestion_parallel": [[15, "module-ingestion_parallel", false]], "init_submission() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.init_submission", false]], "init_submission() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.init_submission", false]], "load() (simple_one_syst_model.boosted_decision_tree.boosteddecisiontree method)": [[11, "simple_one_syst_model.boosted_decision_tree.BoostedDecisionTree.load", false]], "load() (simple_one_syst_model.statistical_analysis.statisticalanalysis method)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis.load", false]], "load_ingestion_duration() (score.scoring method)": [[19, "score.Scoring.load_ingestion_duration", false]], "load_ingestion_results() (score.scoring method)": [[19, "score.Scoring.load_ingestion_results", false]], "load_test_set() (datasets.data method)": [[12, "datasets.Data.load_test_set", false]], "load_train_set() (datasets.data method)": [[12, "datasets.Data.load_train_set", false]], "load_train_set() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.load_train_set", false]], "load_train_set() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.load_train_set", false]], "mae_score() (score.scoring method)": [[19, "score.Scoring.MAE_score", false]], "make_unweighted_set() (in module systematics)": [[24, "systematics.make_unweighted_set", false]], "model (class in simple_one_syst_model.model)": [[17, "simple_one_syst_model.model.Model", false]], "model (class in simple_stat_only_model.model)": [[22, "simple_stat_only_model.model.Model", false]], "module": [[11, "module-simple_one_syst_model.boosted_decision_tree", false], [12, "module-datasets", false], [13, "module-derived_quantities", false], [14, "module-ingestion", false], [15, "module-ingestion_parallel", false], [17, "module-simple_one_syst_model.model", false], [19, "module-score", false], [22, "module-simple_stat_only_model.model", false], [23, "module-simple_one_syst_model.statistical_analysis", false], [24, "module-systematics", false], [25, "module-visualization", false]], "mom4_manipulate() (in module systematics)": [[24, "systematics.mom4_manipulate", false]], "neurips2024_public_dataset() (in module datasets)": [[12, "datasets.Neurips2024_public_dataset", false]], "pair_plots() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.pair_plots", false]], "pair_plots_syst() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.pair_plots_syst", false]], "plot_stacked_histogram() (simple_one_syst_model.statistical_analysis.statisticalanalysis method)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis.plot_stacked_histogram", false]], "postprocess() (in module systematics)": [[24, "systematics.postprocess", false]], "predict() (simple_one_syst_model.boosted_decision_tree.boosteddecisiontree method)": [[11, "simple_one_syst_model.boosted_decision_tree.BoostedDecisionTree.predict", false]], "predict() (simple_one_syst_model.model.model method)": [[17, "simple_one_syst_model.model.Model.predict", false]], "predict() (simple_stat_only_model.model.model method)": [[22, "simple_stat_only_model.model.Model.predict", false]], "predict_submission() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.predict_submission", false]], "predict_submission() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.predict_submission", false]], "quantiles_score() (score.scoring method)": [[19, "score.Scoring.Quantiles_Score", false]], "repeat_rows_by_weight() (in module systematics)": [[24, "systematics.repeat_rows_by_weight", false]], "rmse_score() (score.scoring method)": [[19, "score.Scoring.RMSE_score", false]], "roc_curve_wrapper() (in module visualization)": [[25, "visualization.roc_curve_wrapper", false]], "save() (simple_one_syst_model.boosted_decision_tree.boosteddecisiontree method)": [[11, "simple_one_syst_model.boosted_decision_tree.BoostedDecisionTree.save", false]], "save() (simple_one_syst_model.statistical_analysis.statisticalanalysis method)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis.save", false]], "save_duration() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.save_duration", false]], "save_duration() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.save_duration", false]], "save_figure() (score.scoring method)": [[19, "score.Scoring.save_figure", false]], "save_result() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.save_result", false]], "save_result() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.save_result", false]], "score": [[19, "module-score", false]], "scoring (class in score)": [[19, "score.Scoring", false]], "simple_one_syst_model.boosted_decision_tree": [[11, "module-simple_one_syst_model.boosted_decision_tree", false]], "simple_one_syst_model.model": [[17, "module-simple_one_syst_model.model", false]], "simple_one_syst_model.statistical_analysis": [[23, "module-simple_one_syst_model.statistical_analysis", false]], "simple_stat_only_model.model": [[22, "module-simple_stat_only_model.model", false]], "stacked_histogram() (visualization.dataset_visualise method)": [[25, "visualization.Dataset_visualise.stacked_histogram", false]], "start_timer() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.start_timer", false]], "start_timer() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.start_timer", false]], "statisticalanalysis (class in simple_one_syst_model.statistical_analysis)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis", false]], "stop_timer() (ingestion.ingestion method)": [[14, "ingestion.Ingestion.stop_timer", false]], "stop_timer() (ingestion_parallel.ingestion method)": [[15, "ingestion_parallel.Ingestion.stop_timer", false]], "systematics": [[24, "module-systematics", false]], "systematics() (in module systematics)": [[24, "systematics.systematics", false]], "train_test_split() (in module simple_one_syst_model.model)": [[17, "simple_one_syst_model.model.train_test_split", false]], "train_test_split() (in module simple_stat_only_model.model)": [[22, "simple_stat_only_model.model.train_test_split", false]], "ttbar_bkg_weight_norm() (in module systematics)": [[24, "systematics.ttbar_bkg_weight_norm", false]], "visualization": [[25, "module-visualization", false]], "visualize_coverage() (in module visualization)": [[25, "visualization.visualize_coverage", false]], "visualize_fit() (simple_one_syst_model.statistical_analysis.statisticalanalysis method)": [[23, "simple_one_syst_model.statistical_analysis.StatisticalAnalysis.visualize_fit", false]], "visualize_scatter() (in module visualization)": [[25, "visualization.visualize_scatter", false]]}, "objects": {"": [[12, 0, 0, "-", "datasets"], [13, 0, 0, "-", "derived_quantities"], [14, 0, 0, "-", "ingestion"], [15, 0, 0, "-", "ingestion_parallel"], [19, 0, 0, "-", "score"], [24, 0, 0, "-", "systematics"], [25, 0, 0, "-", "visualization"]], "datasets": [[12, 1, 1, "", "Data"], [12, 3, 1, "", "Neurips2024_public_dataset"]], "datasets.Data": [[12, 2, 1, "", "delete_train_set"], [12, 2, 1, "", "get_syst_train_set"], [12, 2, 1, "", "get_test_set"], [12, 2, 1, "", "get_train_set"], [12, 2, 1, "", "load_test_set"], [12, 2, 1, "", "load_train_set"]], "derived_quantities": [[13, 3, 1, "", "DER_data"], [13, 3, 1, "", "calcul_int"], [13, 3, 1, "", "f_DER_deltaeta_jet_jet"], [13, 3, 1, "", "f_DER_deltar_had_lep"], [13, 3, 1, "", "f_DER_lep_eta_centrality"], [13, 3, 1, "", "f_DER_mass_jet_jet"], [13, 3, 1, "", "f_DER_mass_transverse_met_lep"], [13, 3, 1, "", "f_DER_mass_vis"], [13, 3, 1, "", "f_DER_met_phi_centrality"], [13, 3, 1, "", "f_DER_prodeta_jet_jet"], [13, 3, 1, "", "f_DER_pt_h"], [13, 3, 1, "", "f_DER_pt_ratio_lep_had"], [13, 3, 1, "", "f_DER_pt_tot"], [13, 3, 1, "", "f_DER_sum_pt"], [13, 3, 1, "", "f_del_DER"]], "ingestion": [[14, 1, 1, "", "Ingestion"]], "ingestion.Ingestion": [[14, 2, 1, "", "compute_result"], [14, 2, 1, "", "fit_submission"], [14, 2, 1, "", "get_duration"], [14, 2, 1, "", "init_submission"], [14, 2, 1, "", "load_train_set"], [14, 2, 1, "", "predict_submission"], [14, 2, 1, "", "save_duration"], [14, 2, 1, "", "save_result"], [14, 2, 1, "", "start_timer"], [14, 2, 1, "", "stop_timer"]], "ingestion_parallel": [[15, 1, 1, "", "Ingestion"]], "ingestion_parallel.Ingestion": [[15, 2, 1, "", "compute_result"], [15, 2, 1, "", "fit_submission"], [15, 2, 1, "", "get_duration"], [15, 2, 1, "", "init_submission"], [15, 2, 1, "", "load_train_set"], [15, 2, 1, "", "predict_submission"], [15, 2, 1, "", "save_duration"], [15, 2, 1, "", "save_result"], [15, 2, 1, "", "start_timer"], [15, 2, 1, "", "stop_timer"]], "score": [[19, 1, 1, "", "Scoring"]], "score.Scoring": [[19, 2, 1, "", "MAE_score"], [19, 2, 1, "", "Quantiles_Score"], [19, 2, 1, "", "RMSE_score"], [19, 2, 1, "", "compute_scores"], [19, 2, 1, "", "load_ingestion_duration"], [19, 2, 1, "", "load_ingestion_results"], [19, 2, 1, "", "save_figure"]], "simple_one_syst_model": [[11, 0, 0, "-", "boosted_decision_tree"], [17, 0, 0, "-", "model"], [23, 0, 0, "-", "statistical_analysis"]], "simple_one_syst_model.boosted_decision_tree": [[11, 1, 1, "", "BoostedDecisionTree"]], "simple_one_syst_model.boosted_decision_tree.BoostedDecisionTree": [[11, 2, 1, "", "fit"], [11, 2, 1, "", "load"], [11, 2, 1, "", "predict"], [11, 2, 1, "", "save"]], "simple_one_syst_model.model": [[17, 1, 1, "", "Model"], [17, 3, 1, "", "balance_set"], [17, 3, 1, "", "train_test_split"]], "simple_one_syst_model.model.Model": [[17, 2, 1, "", "fit"], [17, 2, 1, "", "predict"]], "simple_one_syst_model.statistical_analysis": [[23, 1, 1, "", "StatisticalAnalysis"]], "simple_one_syst_model.statistical_analysis.StatisticalAnalysis": [[23, 2, 1, "", "alpha_function"], [23, 2, 1, "", "calculate_saved_info"], [23, 2, 1, "", "compute_mu"], [23, 2, 1, "", "load"], [23, 2, 1, "", "plot_stacked_histogram"], [23, 2, 1, "", "save"], [23, 2, 1, "", "visualize_fit"]], "simple_stat_only_model": [[22, 0, 0, "-", "model"]], "simple_stat_only_model.model": [[22, 1, 1, "", "Model"], [22, 3, 1, "", "calculate_saved_info"], [22, 3, 1, "", "compute_mu"], [22, 3, 1, "", "train_test_split"]], "simple_stat_only_model.model.Model": [[22, 2, 1, "", "fit"], [22, 2, 1, "", "predict"]], "systematics": [[24, 3, 1, "", "all_bkg_weight_norm"], [24, 3, 1, "", "diboson_bkg_weight_norm"], [24, 3, 1, "", "get_bootstrapped_dataset"], [24, 3, 1, "", "get_systematics_dataset"], [24, 3, 1, "", "make_unweighted_set"], [24, 3, 1, "", "mom4_manipulate"], [24, 3, 1, "", "postprocess"], [24, 3, 1, "", "repeat_rows_by_weight"], [24, 3, 1, "", "systematics"], [24, 3, 1, "", "ttbar_bkg_weight_norm"]], "visualization": [[25, 1, 1, "", "Dataset_visualise"], [25, 3, 1, "", "custom_pretty_print"], [25, 3, 1, "", "roc_curve_wrapper"], [25, 3, 1, "", "visualize_coverage"], [25, 3, 1, "", "visualize_scatter"]], "visualization.Dataset_visualise": [[25, 2, 1, "", "correlation_plots"], [25, 2, 1, "", "event_vise_syst"], [25, 2, 1, "", "event_vise_syst_arrow"], [25, 2, 1, "", "examine_dataset"], [25, 2, 1, "", "histogram_dataset"], [25, 2, 1, "", "histogram_syst"], [25, 2, 1, "", "pair_plots"], [25, 2, 1, "", "pair_plots_syst"], [25, 2, 1, "", "stacked_histogram"]]}, "objnames": {"0": ["py", "module", "Python module"], "1": ["py", "class", "Python class"], "2": ["py", "method", "Python method"], "3": ["py", "function", "Python function"]}, "objtypes": {"0": "py:module", "1": "py:class", "2": "py:method", "3": "py:function"}, "terms": {"": [3, 5, 6, 9, 16, 21], "0": [3, 4, 5, 6, 12, 17, 19, 21, 22, 24, 25], "000": 7, "001": 19, "1": [0, 2, 4, 5, 6, 12, 16, 18, 24, 25], "10": [3, 4, 5, 21, 23, 25], "100": [3, 5, 16, 21, 25], "1000": 5, "1298f0a8": 2, "13": [4, 12], "14th": 7, "15": [3, 21], "150": [3, 21], "1500": 7, "16": 5, "16gb": 5, "16th": [5, 17, 19, 22], "1d": 6, "1e": 19, "2": [2, 4, 5, 7, 12, 17, 22, 25], "20": 24, "2012": 6, "2014": [0, 1], "2024": [1, 7, 12], "20gev": 4, "25": 25, "256gb": 5, "26": 24, "26gev": 4, "27": [5, 6], "3": [2, 3, 4, 5, 12, 19, 21], "30": [5, 25], "31415": [14, 15, 24], "376gb": 5, "3f609d1835b2": 4, "4": [2, 5, 13], "40gb": 5, "42": [17, 22], "4da4": 4, "4db3": 4, "5": [1, 3, 4, 12, 21], "500": 7, "5gb": 0, "6": [0, 1, 3, 4, 21], "6148": 5, "68": [5, 6], "7763": 5, "8": [4, 12], "84": 5, "84th": [5, 17, 19, 22], "A": [3, 6, 12, 17, 19, 21, 22, 23, 25], "By": 12, "For": [0, 3, 5, 12, 19, 21, 24], "If": [2, 3, 5, 9, 12, 17, 21, 22], "In": [5, 6, 7, 8, 9], "It": [0, 1, 3, 6, 8, 9, 16, 21], "NOT": 4, "Not": 5, "On": 5, "One": [0, 6, 18], "The": [0, 1, 2, 3, 4, 5, 6, 7, 8, 11, 12, 14, 15, 17, 19, 21, 22, 23, 24, 25], "There": [0, 1, 5, 6], "These": [0, 1, 4, 5], "To": [2, 8, 9, 12, 16], "_": 4, "__file__": 8, "__test_set": 12, "__train_set": 12, "_print": 19, "a100": 5, "abl": 5, "about": [0, 1, 2, 4, 6, 25], "abov": 9, "absenc": 6, "absolut": [4, 13, 19], "abspath": 8, "accept": 5, "access": 9, "accord": 9, "accordingli": 24, "account": [3, 21], "accuraci": 6, "ad": 17, "add": 6, "addit": [4, 6, 7, 9, 24], "address": 9, "adher": 9, "adjust": 5, "advanc": [0, 1], "advantag": 2, "advic": 4, "after": [4, 24], "against": 6, "agre": 7, "ai": [0, 1], "aim": 6, "aishik": 1, "algorithm": 6, "all": [2, 3, 4, 5, 7, 9, 13, 21, 24, 25], "all_bkg_weight_norm": 24, "allot": 5, "allow": [1, 4, 8, 9], "alpha": [3, 21, 23], "alpha_funct": [3, 21, 23], "alpha_list": 23, "alpha_nam": 23, "alpha_rang": 23, "alreadi": [5, 12], "also": [0, 1, 6, 8], "altern": 5, "amd": 5, "an": [0, 1, 2, 4, 5, 6, 9, 12], "analys": 6, "analysi": [0, 1, 9, 17, 18, 23], "analyz": [3, 4, 21], "angl": 4, "ani": [4, 5, 6, 9], "announc": 1, "answer": 6, "appli": [3, 4, 5, 6, 21, 24], "applic": [1, 3, 21], "approach": 6, "approxim": 8, "ar": [0, 1, 2, 3, 4, 5, 6, 8, 9, 12, 21, 24], "architectur": 5, "archiv": 8, "arg": [11, 13, 14, 15, 17, 19, 23, 24, 25], "argument": 5, "arrai": [11, 19, 23, 24], "ask": 6, "assign": 5, "associ": 9, "assum": 2, "assumpt": 5, "atla": [4, 6, 12], "atribut": [17, 19], "attribut": [9, 11, 12, 14, 15, 23, 25], "automat": 0, "avail": [0, 1, 2, 5, 6], "averag": 5, "avoid": 19, "awar": [0, 1], "award": 7, "azimuth": 4, "b": [3, 21, 25], "b1f8": 4, "b9e59d0a": 4, "background": [0, 1, 3, 6, 10, 12, 17, 21, 23, 24], "background_fit": 23, "badzipfil": 12, "balanc": [17, 22], "balance_set": 17, "bar": [4, 12], "base": [3, 5, 6, 11, 12, 14, 15, 17, 19, 21, 22, 23, 25], "bash": 2, "becaus": [3, 21], "been": [4, 5, 7], "befor": [3, 6, 21], "beforehand": [3, 21], "behind": [0, 1], "being": [5, 6], "below": [2, 3, 6, 21], "benjamin": 1, "best": [0, 1, 5], "beta": [6, 23], "between": [3, 4, 6, 13, 19, 21, 25], "beyond": 0, "bhimji": 1, "bia": 6, "bigger": 12, "bin": [2, 3, 6, 21, 23, 25], "bkg": [3, 16, 21], "bkg_scale": [3, 6, 12, 21, 24], "block": 12, "bool": 17, "boost": 11, "boosted_decision_tre": [0, 3, 18, 21], "boosteddecisiontre": 11, "bootstrap": 24, "boson": [0, 1, 6, 10, 12], "both": [3, 6, 21], "bound": [5, 17, 22], "boundari": 1, "breakdown": [0, 1], "brief": 9, "browser": 2, "build": 6, "built": [3, 21], "bunch": 4, "c": 5, "calcul": [5, 13, 17, 22, 23], "calcul_int": 13, "calculate_saved_info": [0, 3, 18, 21, 22, 23], "calibr": [0, 1], "call": [5, 9], "callabl": [5, 17], "can": [0, 1, 2, 3, 5, 6, 8, 9, 12, 16, 17, 21, 22], "cap": 4, "care": 6, "case": [0, 8, 18], "cdot": [3, 21], "center": [4, 12], "central": [4, 5, 13], "cern": [6, 7], "chakkappai": 1, "chalearn": 9, "challeng": [2, 3, 4, 5, 7, 8, 9, 21, 24], "chang": [4, 6, 8, 9], "channel": [1, 6], "chareg": 4, "charg": 4, "check": 2, "checkout": 2, "chieh": 1, "chosen": [3, 21], "chou": 1, "chri": 1, "class": [5, 8, 11, 12, 14, 15, 17, 19, 22, 23, 25], "classifi": [6, 11], "clean": 13, "click": [0, 1, 8], "clone": 2, "close": 6, "closer": [4, 12], "cm": 6, "codabench": [0, 1, 4, 9], "code": [0, 1, 8, 9, 12, 16], "coeffici": [3, 21], "coefficient_list": 23, "coher": 6, "colab": [0, 1, 8], "collect": 4, "collid": 6, "collis": [4, 6, 12], "color": 25, "column": [13, 25], "com": [2, 8], "combin": 23, "come": 4, "command": [2, 4, 16], "competit": [0, 1, 5, 7, 8, 9, 16, 19], "complet": [2, 5], "complic": 6, "compon": [3, 6, 13, 21], "composit": 6, "comput": [5, 14, 15, 17, 19, 22], "compute_mu": [0, 3, 18, 21, 22, 23], "compute_result": [14, 15], "compute_scor": [19, 20], "concern": [0, 1], "condit": [7, 24], "confid": [0, 1, 5, 6], "confirm": 9, "consid": [4, 6, 25], "consist": 5, "constrain": 6, "constraint": [3, 21], "construct": 6, "consult": 6, "contact": 9, "contain": [0, 1, 2, 5, 12, 13, 17, 22, 23, 24, 25], "content": 19, "contest": 9, "context": [0, 1], "contribut": 9, "control": [0, 1], "copi": [2, 8, 13], "correct": [0, 9], "correl": 25, "correlation_plot": 25, "correspond": [3, 6, 11, 21], "could": [2, 9], "count": 6, "countri": 9, "cours": 9, "coverag": [0, 5, 6, 25], "cpu": 5, "creat": [3, 4, 12, 21], "creation": [3, 21], "credenti": 9, "credibl": 1, "criteria": [4, 5], "cross": 4, "current": [2, 3, 9, 21], "curv": 25, "custom": [3, 21], "custom_pretty_print": 25, "cut": 5, "d": 25, "dai": 8, "dark": 6, "data": [0, 1, 3, 5, 6, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 21, 22, 23, 24, 25], "data_set": [17, 22, 24, 25], "datafram": [11, 13, 24, 25], "dataset": [0, 1, 3, 4, 5, 6, 9, 13, 16, 17, 18, 21, 22, 24, 25], "dataset_visualis": 25, "datetim": [14, 15, 19], "david": [1, 13, 24], "deal": [3, 21], "dec": 7, "decai": [4, 6], "decid": [3, 21], "decis": 11, "dedic": [2, 7], "default": [3, 6, 12, 17, 19, 21, 23, 25], "defin": [3, 4, 5, 6, 21], "delet": [12, 13], "delete_train_set": 12, "delph": [4, 12], "delta": [5, 13], "delta_mu_hat": [5, 17, 19, 22, 23], "demonstr": [3, 8, 9, 21], "depend": 2, "depth": 2, "der": 13, "der_data": 13, "der_deltaeta_jet_jet": 4, "der_deltar_had_lep": 4, "der_lep_eta_centr": 4, "der_mass_jet_jet": 4, "der_mass_transverse_met_lep": 4, "der_mass_vi": 4, "der_met_phi_centr": 4, "der_prodeta_jet_jet": 4, "der_pt_h": 4, "der_pt_ratio_lep_tau": 4, "der_pt_tot": 4, "der_sum_pt": 4, "deriv": [3, 5, 6, 13, 21], "derived_quant": [0, 4, 16, 18], "describ": [0, 1, 5], "descript": [4, 10, 12], "design": [0, 1], "desir": [5, 6], "despit": 6, "detail": [0, 1, 4, 6, 9, 12, 19, 24, 25], "detailed_label": [17, 25], "detailedlabel": [4, 24], "detect": 6, "detector": [0, 1, 4, 6, 12], "determin": [5, 6, 7], "develop": [1, 6], "deviat": 5, "devic": 8, "df_syst": 25, "dfall": 25, "diboson": [3, 4, 6, 12, 16, 21, 24], "diboson_bkg_weight_norm": 24, "diboson_scal": [3, 6, 12, 21, 24], "dict": [12, 14, 15, 17, 19, 22, 23, 24, 25], "dictionari": [5, 12, 17, 19, 22, 23, 25], "diefenbach": 1, "differ": [2, 5, 6, 9, 13], "difficulti": 6, "dimension": [3, 21], "directli": [6, 13], "directori": [2, 5, 8, 12, 14, 15], "dirnam": 8, "discoveri": 6, "disk": 11, "distinguish": [3, 21], "distort": 6, "distribut": [3, 5, 6, 19, 21], "divid": [3, 4, 12, 21], "divis": 19, "do": 9, "doc": [2, 5], "document": 1, "doe": [5, 6], "doesn": [3, 21], "doesnt": 4, "domin": 6, "dont": 2, "dopostprocess": [12, 24], "download": [0, 1, 4, 8, 12], "dudlei": 1, "dummi": [0, 1], "durat": [14, 15, 19], "dure": [3, 6, 7, 21], "e": [1, 3, 4, 6, 13, 21], "each": [3, 5, 6, 21, 23, 25], "early_stopping_round": [3, 21], "eas": 5, "edg": 23, "educ": 9, "effect": [4, 5], "eg": 5, "either": 5, "electron": [4, 6], "elham": 1, "elig": [7, 9], "email": [1, 8, 9], "emphasis": 1, "encourag": [1, 5, 8, 9], "end": [14, 15, 19], "end_tim": [14, 15, 19], "energi": [1, 3, 4, 6, 12, 21, 24], "engin": 2, "ensur": [3, 9, 21], "enter": 7, "entri": [0, 1, 9], "env": 2, "environ": 2, "ep": 19, "epsilon": 5, "epyc": 5, "equal": 17, "error": [3, 12, 19, 21], "essenti": [1, 4, 6], "estrad": [13, 24], "eta": 4, "etc": [0, 1, 13], "eval_metr": [3, 21], "eval_set": [3, 21], "evalu": [0, 1, 6, 7, 8, 10, 19], "event": [3, 4, 6, 9, 12, 17, 21, 23, 24], "event_vise_syst": 25, "event_vise_syst_arrow": 25, "eventid": [6, 13], "everi": 5, "examine_dataset": 25, "exampl": [0, 5, 6, 18], "example_submiss": 8, "except": [3, 6, 21], "execut": 1, "expect": [0, 1, 5, 6, 8], "experi": [0, 1, 3, 4, 5, 6, 9, 16, 21], "experiment": [4, 12], "expert": 6, "explain": 6, "explor": 1, "export": [3, 21], "extract": 12, "f": [5, 6], "f_del_der": 13, "f_der_deltaeta_jet_jet": 13, "f_der_deltar_had_lep": 13, "f_der_lep_eta_centr": 13, "f_der_mass_jet_jet": 13, "f_der_mass_transverse_met_lep": 13, "f_der_mass_vi": 13, "f_der_met_phi_centr": 13, "f_der_prodeta_jet_jet": 13, "f_der_pt_h": 13, "f_der_pt_ratio_lep_had": 13, "f_der_pt_tot": 13, "f_der_sum_pt": 13, "face": 2, "facilit": [0, 1], "factor": [23, 24], "fail": 8, "fair": [2, 8, 9, 24], "fair_univers": 2, "fals": [12, 17, 22, 23], "familiar": 6, "farrel": 1, "fb": 4, "feasibl": [3, 21], "featur": [3, 5, 6, 10, 21, 25], "few": 5, "field": [0, 25], "field_nam": 25, "figur": 19, "file": [1, 3, 5, 8, 11, 12, 14, 15, 19, 21, 23], "file_path": [3, 21, 23], "filenotfounderror": 12, "final": [4, 5, 7, 9], "find": [3, 21], "first": [1, 2, 6, 7, 16], "fit": [5, 11, 14, 15, 17, 22, 23], "fit_funct": 23, "fit_function_": 23, "fit_function_b": 23, "fit_submiss": [14, 15], "fix": [3, 21], "fixed_syst": 23, "float": [3, 17, 19, 21, 23, 24, 25], "focu": 6, "focus": [1, 6], "folder": 21, "follow": [0, 2, 3, 4, 5, 6, 7, 8, 9, 16, 17, 21, 22, 24], "format": 8, "found": [2, 12], "four": [5, 12], "frac": [4, 5], "fraction": [5, 6], "freelanc": 9, "from": [0, 3, 4, 5, 6, 8, 9, 11, 12, 21, 23], "frugal": 7, "full": [0, 1, 5], "function": [3, 4, 5, 13, 17, 21, 22, 23, 24], "fund": 7, "further": [3, 4, 6, 21], "furthermor": 6, "g": [3, 21], "gamma": [6, 23], "gaussian": [3, 5, 21], "gb": [1, 4], "ge": 5, "gener": [2, 3, 4, 9, 12, 21, 24], "geneva": [6, 7], "get": [0, 9, 10, 12, 14, 15, 17, 19], "get_bootstrapped_dataset": 24, "get_dur": [14, 15, 19], "get_syst_train_set": 12, "get_systematics_dataset": 24, "get_test_set": 12, "get_train_set": [5, 12, 17, 22], "ghosh": 1, "git": 2, "github": [0, 1, 2, 8], "give": [2, 6], "given": [5, 6, 8, 23], "go": 1, "goal": 6, "gold": 5, "good": 2, "googl": [0, 1, 8], "gov": [1, 5, 9], "govern": 9, "gpu": 5, "grant": 9, "graph": 5, "great": 6, "ground": 25, "ground_truth_mu": 25, "group": [1, 4, 12], "guyon": 1, "h": [4, 6, 12], "ha": [2, 3, 6, 12, 21], "had": 4, "hadron": [4, 6, 13], "halt": [3, 21], "handl": [14, 15], "hardwar": 10, "harri": 1, "hat": 5, "have": [2, 4, 5, 6, 7, 8], "help": [0, 1, 4, 8, 9], "henc": [3, 4, 8, 21], "hep": [1, 2, 3, 8, 13, 21], "here": [0, 3, 5, 8, 21], "higg": [0, 1, 6, 10, 12], "higgsml": [0, 9], "high": [1, 6], "hist": 8, "histogram": [6, 23, 25], "histogram_dataset": 25, "histogram_syst": 25, "histori": 6, "hold": 6, "holdout": 23, "holdout_set": [3, 21, 23], "host": [0, 1, 2], "hour": 5, "how": [6, 10], "howev": [5, 6], "hsu": 1, "htautau": [4, 24], "html": 19, "http": [1, 2, 4, 5, 8], "httperror": 12, "hyperparamet": [3, 21], "i": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 12, 13, 16, 17, 19, 21, 22, 24], "ignor": 8, "ihsan": 1, "imag": [2, 25], "iminuit": [3, 21], "impact": [0, 1, 6], "implement": [3, 11, 21], "import": [3, 12, 21], "impract": [3, 21], "improv": [3, 6, 21], "includ": [0, 1, 4, 6, 9, 12, 25], "inclus": 9, "independ": 9, "index": 0, "infer": [5, 6], "inform": [0, 1, 6, 9, 17, 22, 23, 25], "ingest": [0, 15, 18, 19, 25], "ingestion_dur": 19, "ingestion_duration_fil": 19, "ingestion_parallel": [0, 16, 18], "ingestion_result": 19, "ingestion_result_dict": 25, "inher": 4, "init_submiss": [14, 15], "initi": [5, 14, 15], "initial_se": [14, 15], "input": [1, 6, 8, 11, 12, 13, 24], "input_dir": 12, "insid": 5, "instal": 2, "instead": 5, "institut": 9, "instruct": [2, 8], "int": [17, 19, 23, 24, 25], "integ": 4, "integr": 5, "intel": 5, "interact": 2, "interest": 6, "interfac": [3, 21], "interfer": 4, "interv": [0, 1, 6], "invari": [4, 13], "invit": 7, "involv": [3, 21], "io": 2, "ipynb": 2, "isabel": 1, "isol": 6, "issu": 9, "item": 5, "its": 6, "je": [3, 6, 12, 16, 21, 24], "jet": [3, 4, 6, 13, 21, 24], "jordan": 1, "json": [3, 21], "jupyt": 2, "juri": 7, "kaggl": [0, 1, 6], "keep": 13, "kei": [17, 22, 23, 25], "kept": 4, "khoda": 1, "kind": 9, "kit": [0, 1, 2, 6, 12], "knowledg": 6, "label": [3, 4, 6, 11, 17, 21, 23, 24, 25], "larg": 6, "larger": 4, "largest": 4, "last": 6, "lbl": [1, 9], "lbnl": 5, "le": 5, "lead": [4, 9], "learn": [1, 6], "learning_r": [3, 21], "left": 5, "lep": 4, "lepton": [4, 6, 13], "level": [0, 1], "lhc": 6, "libomp": 2, "like": [1, 4, 6, 11, 12, 24], "likelihood": [3, 5, 6, 21, 23], "limit": 5, "line": 25, "linear": 25, "link": 2, "list": [19, 23, 25], "ln": 5, "load": [3, 8, 11, 12, 14, 15, 16, 17, 19, 21, 22, 23], "load_ingestion_dur": [19, 20], "load_ingestion_result": [19, 20], "load_state_dict": 8, "load_test_set": 12, "load_train_set": [12, 14, 15], "local": [1, 2], "locat": [8, 19], "log": [3, 21], "log_i": 23, "logloss": [3, 21], "long": 6, "low": [3, 21], "lower": [5, 17, 22], "luminos": 4, "lw": 25, "mac": 2, "machin": [1, 2, 6], "made": [4, 5, 6], "mae": 19, "mae_scor": [19, 20], "magnitud": 6, "mai": [2, 6, 8], "main": [2, 3, 5, 6, 21], "maintain": 5, "major": 6, "make": [2, 4, 6, 8, 9, 12, 13, 14, 15], "make_unweighted_set": 24, "mani": [5, 6], "manipul": 24, "manual": 6, "map_loc": 8, "mass": [4, 5, 12, 13], "master": [1, 8], "matric": 25, "matter": 6, "max_depth": [3, 21], "maximis": 5, "maximum": [6, 8], "mean": [3, 6, 19, 21], "meant": 5, "measur": [0, 1, 4, 6, 12], "memori": 5, "met": [3, 13, 16, 21, 24], "method": [5, 6, 9, 11, 12, 15, 17, 19, 23, 25], "metric": [0, 1], "mileston": 6, "mimick": 6, "minim": [3, 21], "minimis": 5, "miss": [3, 4, 6, 21], "ml": 1, "mode": [4, 6], "model": [0, 1, 2, 3, 4, 5, 6, 7, 8, 11, 14, 15, 18, 23, 25], "model_dir": 8, "model_nam": 11, "model_path": 11, "model_syst_nam": [3, 21], "model_xgb": [3, 21], "modifi": [8, 13], "modul": [16, 20, 21], "moduli": 4, "modulu": 4, "mom4_manipul": 24, "momenta": 4, "momentum": [4, 13], "monetari": 7, "more": [6, 12, 19], "mu": [3, 5, 16, 17, 19, 21, 22, 23, 24, 25], "mu_": 5, "mu_hat": [5, 17, 19, 22, 23, 25], "multipl": [9, 23], "muon": [4, 6], "must": [5, 7, 9], "my": 1, "mysteri": 6, "n": 5, "n_estim": [3, 21], "n_ob": 23, "nachman": 1, "name": [11, 17, 23, 25], "natur": 6, "nbin": 25, "ndarrai": [23, 25], "necessari": [5, 6], "need": [2, 3, 13, 21], "neg": [3, 21], "nersc": [2, 5], "net": 8, "neurip": [1, 7, 12], "neurips2024_public_dataset": 12, "neurips_public_data_26_08_2024": 4, "new_t": [3, 21], "next": 2, "nll": [3, 21], "nobel": 6, "node": 5, "nomin": [3, 21, 23], "nominal_histogram": 23, "none": [11, 12, 14, 15, 17, 19, 22, 23, 24, 25], "normal": [3, 11, 21], "note": [3, 4, 9, 21], "notebook": [0, 1, 2, 8], "notifi": 9, "novelti": 7, "np": [3, 6, 8, 19, 21], "npy": 8, "nu": 6, "nuisanc": [3, 6, 21], "num": [3, 16, 21], "number": [4, 6, 17, 19, 23, 25], "numer": [5, 6], "numpi": [8, 23], "nvidia": 5, "o": [2, 4, 8], "object": [3, 6, 11, 12, 14, 15, 17, 19, 21, 22, 23, 25], "observ": [6, 23], "obtain": [3, 21], "offici": [8, 9], "onc": [5, 8], "one": [1, 3, 4, 5, 6, 21], "onli": [0, 1, 4, 5, 6, 9, 18], "oper": 9, "opportun": 1, "opposit": 4, "optim": 6, "option": [11, 17, 19, 23, 25], "order": [6, 9], "org": 4, "organ": 9, "organis": 0, "organiz": 9, "origin": [13, 24], "other": [3, 4, 5, 6, 9, 21, 24], "our": [1, 2, 8, 9], "outgo": 6, "output": [1, 3, 14, 15, 21], "output_dir": [14, 15], "over": 5, "overal": 5, "overview": [0, 5], "p16": [5, 17, 19, 22, 23], "p84": [5, 17, 19, 22, 23], "p_t": 4, "p_x": 4, "p_y": 4, "packag": [2, 3, 21], "page": [5, 12, 19], "pair": 25, "pair_plot": 25, "pair_plot_syst": 25, "pair_plots_syst": 25, "panda": [11, 13, 24], "paper": [0, 1], "parallel": [5, 8, 16], "param": 22, "paramet": [3, 4, 6, 12, 13, 21, 22, 23, 25], "parametr": [3, 21], "parametris": 6, "part": [3, 5, 21], "particip": [0, 1, 5, 6, 7, 8, 16, 17], "particl": [4, 6, 12, 13], "particular": 6, "partip": 4, "path": [2, 8, 11, 12, 23], "penalis": 5, "per": 8, "percentil": [5, 17, 19, 22], "perform": [0, 1, 3, 7, 21, 23], "period": 6, "perlmutt": 5, "phase": [5, 7], "phenomena": 6, "phi": 4, "photon": 4, "physic": [1, 4, 6, 12], "pip": 2, "pipelin": 16, "pkl": [3, 21, 23], "place": [7, 8], "platform": [0, 1], "pleas": [8, 9], "plot": [23, 25], "plot_label": 25, "plot_stacked_histogram": 23, "png": 25, "point": [3, 21, 23], "poisson": [6, 24], "polynomi": [3, 21, 23], "possibl": [4, 6, 9], "post": [4, 5, 9], "postprocess": 24, "potenti": 9, "practic": 7, "pre": [1, 3, 4, 5, 8, 21], "precis": 6, "predict": [3, 5, 6, 8, 9, 11, 14, 15, 17, 19, 21, 22, 23, 25], "predict_proba": [3, 21], "predict_submiss": [14, 15], "prediction_dir": 19, "prepar": 5, "prerog": 9, "presenc": [0, 6], "present": 1, "prevent": 9, "previou": 6, "pri": 4, "pri_had_eta": 4, "pri_had_phi": 4, "pri_had_pt": [4, 24], "pri_jet_all_pt": 4, "pri_jet_leading_eta": 4, "pri_jet_leading_phi": 4, "pri_jet_leading_pt": [4, 24], "pri_jet_num": 4, "pri_jet_subleading_eta": 4, "pri_jet_subleading_phi": 4, "pri_jet_subleading_pt": [4, 24], "pri_lep_eta": 4, "pri_lep_phi": 4, "pri_lep_pt": [4, 24], "pri_met": 4, "pri_met_phi": 4, "primari": [5, 24], "primit": 4, "print": [19, 25], "prize": [6, 9], "probabl": [3, 5, 6, 11, 21], "problem": [2, 8], "process": [2, 3, 4, 6, 9, 14, 15, 19, 21], "produc": [4, 6, 12], "product": [4, 6, 13], "profil": [6, 9, 23], "program": [0, 18], "project": 0, "promiss": 6, "proper": 9, "properti": [6, 13], "propos": 6, "proton": [4, 6, 12], "provid": [0, 1, 3, 5, 6, 8, 9, 21], "pseudo": [0, 3, 5, 9, 16, 21], "pseudoexperi": 5, "pseudorapid": [4, 13], "pt": 24, "pth": 8, "public": [0, 5, 10, 12], "public_data": 4, "public_dataset": 12, "pull": 2, "purpos": 9, "push": [0, 1], "px": 13, "py": [2, 3, 4, 5, 8, 13, 16, 21], "pythia": [4, 12], "pythia8": [4, 12], "python3": [3, 12, 16, 21], "pytorch": 8, "pz": 13, "quantif": [1, 5], "quantil": [10, 19], "quantiles_scor": [19, 20], "quantiti": [4, 6, 13], "question": 6, "r": [4, 5, 13], "ragansu": 1, "rais": 12, "ram": 5, "random": [3, 6, 16, 17, 21, 24], "random_st": [17, 22], "rang": [6, 23], "rate": 6, "rather": [1, 8], "ratio": [4, 6, 13], "raw": 4, "re_train": [17, 22], "real": 8, "realist": 6, "reason": 8, "receiv": 5, "recomput": 24, "reduc": 5, "regard": [0, 1], "region": 5, "regist": [0, 1, 8, 9], "registr": 9, "regular": 4, "relat": [3, 6, 21], "remain": [3, 21], "repeat": [3, 21], "repeat_rows_by_weight": 24, "repo": [0, 1, 8, 12], "repositori": 2, "repres": [3, 6, 12, 21], "represent": 9, "request": 5, "requir": [9, 10], "research": 9, "resid": 9, "resourc": [1, 7], "respect": [5, 6], "respons": [8, 16], "result": [3, 5, 9, 14, 15, 17, 19, 21, 22, 25], "retain": 9, "retrain": 1, "retriev": [3, 21], "return": [5, 6, 11, 12, 13, 14, 15, 17, 22, 23, 24], "reweight": [17, 22], "right": [2, 5], "rightarrow": [4, 6, 12], "rise": 6, "rmse": [3, 19, 21], "rmse_scor": [19, 20], "robust": [1, 6], "roc": 25, "roc_curve_wrapp": 25, "role": 4, "root": 19, "rousseau": [1, 13, 24], "rule": 9, "run": [2, 5, 9, 12, 16], "run_ingest": [3, 16, 21], "same": [3, 6, 8, 21], "sampl": [0, 1, 11, 12, 25], "sample_s": 25, "sample_weight_eval_set": [3, 21], "sascha": 1, "satisfi": 5, "saturdai": 7, "save": [3, 11, 14, 15, 17, 19, 21, 22, 23], "save_dur": [14, 15], "save_figur": [19, 20], "save_nam": 23, "save_result": [14, 15], "saved_info": [22, 23], "saved_info_model_xgb": [3, 21], "scalar": 4, "scale": [3, 6, 16, 21, 24], "scaler": [3, 11, 21], "scatter": 25, "scenario": [3, 4, 21], "scienc": [0, 1], "score": [0, 6, 7, 10, 18, 22, 23, 25], "score_dir": 19, "scores_dict": 19, "search": 0, "second": [4, 7], "secret": 6, "section": [3, 4, 21], "secur": 8, "see": [5, 8, 12, 19], "seed": 24, "select": [4, 5, 6, 24], "self": [3, 11, 21], "separ": 4, "seri": 25, "serialis": 8, "serv": [0, 1], "session": 7, "set": [3, 4, 5, 9, 14, 15, 16, 17, 19, 21, 22, 23], "setup": [2, 3, 21], "sever": [0, 1], "share": 9, "shell": 2, "shift": 6, "shih": 1, "short": 7, "should": [0, 1, 3, 4, 5, 6, 9, 21], "show": 19, "show_dur": 19, "sigma_": 5, "signal": [0, 1, 5, 6, 10, 12, 17, 23], "signal_fit": 23, "signatur": 6, "similar": 4, "simpl": [0, 18], "simple_one_syst_model": [3, 11, 17, 21, 23], "simple_stat_only_model": 22, "simpli": 6, "simul": [4, 6, 12], "sinc": [2, 5], "six": [3, 6, 21], "size": [5, 17], "skill": 1, "slack": 1, "slide": [0, 1], "sm": 6, "small": [6, 19], "smaller": 6, "so": [5, 6, 13], "soft": [3, 6, 16, 21, 24], "soft_met": [3, 6, 12, 21, 24], "solut": 8, "some": [5, 6], "sourc": [0, 1, 2], "special": [4, 7], "specif": [0, 1, 5, 6, 23, 25], "split": [3, 17, 21], "sqrt": [4, 5], "squar": 19, "stack": [23, 25], "stacked_histogram": 25, "stage": 9, "standard": [5, 6], "standardscal": [3, 11, 21], "start": [0, 1, 6, 12, 14, 15, 19], "start_tim": [14, 15, 19], "startingkit_higgsml_uncertainty_challeng": 2, "stat": [0, 18], "stat_analysi": 17, "stat_onli": 23, "state": [4, 17], "statist": [0, 1, 6, 17, 18, 23], "statistical_analysi": [0, 3, 18, 21], "statisticalanalysi": 23, "step": [2, 16], "steven": 1, "still": [1, 2, 6], "stipul": 9, "stop": [14, 15, 19], "stop_tim": [14, 15, 19], "store": [3, 21], "str": [11, 12, 14, 15, 17, 19, 23, 25], "strategi": 2, "strength": [0, 1, 5, 6], "strongli": 1, "structur": 21, "studi": 6, "sublead": 4, "submiss": [0, 1, 3, 6, 9, 10, 17, 21], "submit": [0, 1, 5, 7, 8, 14, 15, 17], "subsequ": [4, 12], "success": 9, "suggest": [3, 5, 21], "sum": [4, 13], "sum_": 5, "supercomput": 5, "support": 9, "suppos": 13, "sure": [8, 13], "switzerland": [6, 7], "sxm2": 5, "symmetr": 5, "syst": [0, 18], "syst_set": 23, "systbkgnorm": 24, "system": [5, 13, 25], "systemat": [0, 1, 4, 5, 6, 12, 16, 17, 18, 22, 23], "systjetenergyscal": 24, "systtauenergyscal": 24, "t": [3, 4, 12, 21], "tab": [1, 6, 8, 9], "tabular": [4, 12], "take": 9, "talk": 7, "tang": 1, "target": [5, 25], "task": [3, 9, 21], "tau": [3, 4, 6, 12, 21], "tau_": 4, "te": [3, 6, 12, 16, 21, 24], "team": 9, "technic": 6, "techniqu": [0, 1], "templat": 8, "term": 7, "termin": 4, "tesla": 5, "test": [0, 1, 3, 4, 5, 6, 8, 9, 11, 12, 14, 15, 17, 19, 21, 22, 24], "test_data": 11, "test_set": [14, 15, 17, 19, 22, 24], "test_siz": [17, 22], "tev": [4, 12], "textrm": [4, 5], "than": [1, 8], "thei": [4, 5, 9], "them": [3, 9, 21], "themselv": 6, "therebi": 0, "thi": [0, 2, 3, 4, 5, 6, 8, 9, 11, 12, 13, 17, 19, 21, 22, 24], "third": [6, 7], "those": 6, "though": 6, "three": [6, 7], "through": [1, 3, 21], "throughout": 5, "time": [3, 4, 5, 6, 8, 9, 14, 15, 19, 21], "timedelta": [14, 15], "timer": [14, 15, 19], "tip": [3, 21], "togeth": [6, 8], "tool": [4, 12], "top": 7, "torch": 8, "total": [3, 4, 5, 6, 13, 21], "tradition": 6, "train": [0, 1, 4, 5, 6, 8, 11, 12, 14, 15, 17, 22, 23], "train_data": 11, "train_set": [8, 22, 23], "train_test_split": [0, 17, 18, 22], "training_set": 17, "transvers": [4, 13], "tree": [8, 11], "true": [3, 5, 6, 17, 19, 21, 22, 24], "true_mu": 19, "truth": 25, "ttbar": [3, 4, 6, 16, 21, 24], "ttbar_bkg_weight_norm": 24, "ttbar_scal": [3, 6, 12, 21, 24], "tty": 2, "tune": [3, 21], "tupl": 17, "tutori": [0, 1], "two": [3, 4, 5, 6, 13, 21], "u": 9, "ullah": 1, "unauthor": 9, "uncertain": 6, "uncertainti": [0, 3, 5, 9, 17, 19, 21, 22], "uncov": 6, "undefin": 4, "undergo": [4, 12], "underli": [5, 11], "understand": 8, "unicertain": 0, "uninstal": 2, "uniqu": 25, "univers": [2, 8, 9], "unnecessari": 13, "up": 7, "updat": 1, "upper": [5, 17, 22], "url": 9, "us": [0, 1, 2, 3, 4, 5, 6, 8, 9, 11, 12, 13, 14, 15, 16, 17, 19, 21, 22, 23], "v": 25, "v100": 5, "valid": [3, 6, 9, 12, 21], "valid_set": [3, 11, 21], "valu": [3, 4, 5, 6, 13, 17, 19, 21, 22, 23, 24, 25], "variabl": [6, 13], "variat": [3, 12, 21], "varibal": 4, "variou": 5, "vector": 4, "verbos": [3, 21], "verif": 9, "verifi": 9, "version": 2, "via": 9, "victor": [13, 24], "visit": 1, "visual": [0, 16, 18], "visualize_coverag": 25, "visualize_fit": 23, "visualize_scatt": 25, "volum": 2, "vv": [4, 12], "w": [4, 5], "w_i": 4, "wa": 6, "wahid": 1, "wai": [5, 6, 8, 9], "want": [1, 2, 3, 8, 21], "we": [3, 4, 5, 6, 8, 9, 12, 21], "websit": 1, "weight": [3, 4, 5, 6, 11, 13, 17, 21, 22, 23, 24, 25], "weight_kei": 25, "weight_syst": 25, "well": [0, 1], "were": 13, "wget": 4, "what": [6, 8], "when": [4, 5, 6], "where": 6, "whether": 17, "which": [0, 2, 3, 5, 6, 7, 8, 21, 25], "while": [1, 3, 4, 5, 12, 21], "white": [0, 1], "who": 9, "width": [5, 25], "win": 6, "within": [1, 2, 6], "withing": 5, "without": [3, 21], "word": 5, "work": [3, 21], "worker": 5, "workshop": 7, "workspac": 1, "workstat": 5, "worri": 2, "would": [3, 21], "write": [7, 19], "write_html": 19, "write_scor": 19, "written": [13, 24], "www": 4, "x": [5, 6], "x_train_data": [3, 21], "x_valid_data": [3, 21], "xeon": 5, "xgbclassifi": [3, 11, 21], "xgboost": [2, 3, 11, 21], "y_i": 4, "y_scale": 25, "yaun": 1, "yield": [3, 21], "you": [0, 1, 2, 3, 8, 9, 12, 13, 16, 21], "your": [1, 2, 6, 8, 9], "yourself": 16, "yulei": 1, "z": [6, 10, 12], "zero": 19, "zhang": 1, "zip": [4, 5, 8, 12], "zipfil": 12, "ztautau": 4}, "titles": ["Welcome to FAIR Universe HEP Challenge\u2019s documentation!", "FAIR Universe - HiggsML Uncertainty Challenge", "Getting Started", "Example: Statistical-Only and 1-Systematic Case Analysis", "Data", "Evaluation", "Overview", "Prizes", "Starting Kit and Sample Submission", "Terms and Conditions", "Appendix", "Boosted_Decision_Tree module", "Datasets module", "Derived_quantities module", "Ingestion module", "Ingestion_parallel module", "Ingestion Program", "Model One Syst", "Core modules", "Score module", "Scoring Program", "Simple One Syst Model", "Simple Stat Only Model", "Statistical_Analysis module", "Systematics module", "Visualization module"], "titleterms": {"": 0, "1": [3, 21], "2": [3, 21], "One": [17, 21], "With": 2, "affili": 9, "analysi": [3, 21], "appendix": 10, "background": 4, "berkelei": 1, "boosted_decision_tre": 11, "boson": 4, "breakdown": [3, 21], "build": [3, 21], "case": [3, 21], "chalearn": 1, "challeng": [0, 1, 6], "classifi": [3, 21], "conda": 2, "condit": 9, "construct": 5, "contact": 1, "core": [0, 18], "credit": 1, "cut": 4, "data": 4, "dataset": 12, "deriv": 4, "derived_quant": 13, "descript": 5, "detail": [3, 21], "disqualif": 9, "docker": 2, "document": 0, "dummi": 8, "estim": 6, "evalu": 5, "exampl": [3, 21], "extract": [3, 21], "fair": [0, 1], "featur": 4, "fit": [3, 21], "get": [2, 4], "guidelin": 9, "hardwar": 5, "hep": 0, "higg": 4, "higgsml": 1, "how": [1, 3, 4, 21], "indic": 0, "ingest": [14, 16], "ingestion_parallel": 15, "interv": 5, "introduct": [1, 6], "irvin": 1, "join": 1, "kei": [3, 21], "kit": 8, "laboratori": 1, "lawrenc": 1, "learn": [3, 21], "less": 4, "machin": [3, 21], "model": [17, 21, 22], "modul": [0, 11, 12, 13, 14, 15, 18, 19, 23, 24, 25], "mu": 6, "nation": 1, "note": [2, 8], "onli": [3, 21, 22], "overview": [3, 6, 21], "page": 0, "pari": 1, "particip": 9, "prefix": 4, "preselect": 4, "primari": 4, "prize": 7, "problem": [3, 6, 21], "procedur": [3, 21], "program": [16, 20], "public": 4, "quantil": 5, "requir": 5, "run": [3, 21], "saclai": 1, "sampl": 8, "score": [5, 19, 20], "set": 6, "signal": [3, 4, 21], "simpl": [21, 22], "start": [2, 8], "stat": 22, "statist": [3, 21], "statistical_analysi": 23, "step": [3, 21], "strength": [3, 21], "submiss": [5, 8], "syst": [17, 21], "systemat": [3, 21, 24], "tabl": 0, "target": 6, "templat": [3, 21], "term": 9, "thi": 1, "train": [3, 21], "uc": 1, "uncertainti": [1, 6], "univers": [0, 1], "universit\u00e9": 1, "variabl": 4, "visual": 25, "washington": 1, "welcom": 0, "workflow": [3, 21], "z": 4}}) \ No newline at end of file