Performance investigation upgrade Python to 3.9 (#87)

Co-authored-by: Mebin Abraham <[email protected]>
ONSdigital · Apr 16, 2021 · f3c5a0a · f3c5a0a
1 parent db20add
commit f3c5a0a
Show file tree

Hide file tree

Showing 9 changed files with 2,709 additions and 0 deletions.
diff --git a/...ions/0017-upgrade-python-3.9/outputs/baseline/2021-04-15T08:00:00/baseline_exceptions.csv b/...ions/0017-upgrade-python-3.9/outputs/baseline/2021-04-15T08:00:00/baseline_exceptions.csv
@@ -0,0 +1 @@
+Count,Message,Traceback,Nodes
diff --git a/...ations/0017-upgrade-python-3.9/outputs/baseline/2021-04-15T08:00:00/baseline_failures.csv b/...ations/0017-upgrade-python-3.9/outputs/baseline/2021-04-15T08:00:00/baseline_failures.csv
@@ -0,0 +1 @@
+Method,Name,Error,Occurrences
diff --git a/...tigations/0017-upgrade-python-3.9/outputs/baseline/2021-04-15T08:00:00/baseline_stats.csv b/...tigations/0017-upgrade-python-3.9/outputs/baseline/2021-04-15T08:00:00/baseline_stats.csv
diff --git a/...s/0017-upgrade-python-3.9/outputs/baseline/2021-04-15T08:00:00/baseline_stats_history.csv b/...s/0017-upgrade-python-3.9/outputs/baseline/2021-04-15T08:00:00/baseline_stats_history.csv
diff --git a/...017-upgrade-python-3.9/outputs/investigation/2021-04-15T09:00:00/python3.9_exceptions.csv b/...017-upgrade-python-3.9/outputs/investigation/2021-04-15T09:00:00/python3.9_exceptions.csv
@@ -0,0 +1 @@
+Count,Message,Traceback,Nodes
diff --git a/.../0017-upgrade-python-3.9/outputs/investigation/2021-04-15T09:00:00/python3.9_failures.csv b/.../0017-upgrade-python-3.9/outputs/investigation/2021-04-15T09:00:00/python3.9_failures.csv
@@ -0,0 +1 @@
+Method,Name,Error,Occurrences
diff --git a/...ons/0017-upgrade-python-3.9/outputs/investigation/2021-04-15T09:00:00/python3.9_stats.csv b/...ons/0017-upgrade-python-3.9/outputs/investigation/2021-04-15T09:00:00/python3.9_stats.csv
diff --git a/...-upgrade-python-3.9/outputs/investigation/2021-04-15T09:00:00/python3.9_stats_history.csv b/...-upgrade-python-3.9/outputs/investigation/2021-04-15T09:00:00/python3.9_stats_history.csv
diff --git a/doc/performance-investigations/0017-upgrade-python-3.9/summary.md b/doc/performance-investigations/0017-upgrade-python-3.9/summary.md
@@ -0,0 +1,33 @@
+# Upgrade Python from 3.8 to 3.9
+
+Python's latest minor release version is 3.9. EQ Census is currently running on version 3.8, whereas the post-census branch has been upgraded to 3.9. This looks at possible performance improvements due to the upgrade.
+
+## Benchmark profile
+
+| Option                 | Value                        |
+| ---------------------- | ---------------------------- |
+| Requests file          | census_household_gb_eng.json |
+| Run time               | 60m                          |
+| User wait time minimum | 1                            |
+| User wait time maximum | 2                            |
+| Clients                | 100                          |
+| Hatch rate             | 100                          |
+| Number of workers      | 7                            |
+| Number of threads      | 7                            |
+
+## Results
+
+Results based on 99th percentile timings.
+
+| Metric              | Baseline | Investigation |
+| ------------------- | -------- | ------------- |
+| Questionnaire GETs  | 198ms    | 154ms         |
+| Questionnaire POSTs | 299ms    | 250ms         |
+| All requests        | 247ms    | 202ms         |
+| Total Requests      | 16,683   | 18,146        |
+| Total Failures      | 0        | 0             |
+| Error Percentage    | 0        | 0.0%          |
+
+## Decision
+
+The upgrade has already merged, but this result shows a performance improvement when using Python 3.9 over Python 3.8.