🚀 Release v1.86.0

[YuryHrytsuk]

Release version

1.86.0

Commit SHA

1efd09c

Previous pre-release

https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_Cheops9

Planned date

25.9.

Did the commit CI succeed?

• The commit CI succeeded.

Motivation

• End of September Release

Changes

• ⚠️🎨✨ Execute the api-server's run and map function api endpoints in celery worker #8233 by @bisgaard-itis
• ✨ [Frontend] OEC to Support chat #8288 by @odeimaiz
• 🎨 Use FogBugz client to create support request (⚠️) #8293 by @matusdrobuliak66
• Add a function_job_list_with_status endpoint 🎨 #8278 by @wvangeit
• ✨ dynamic-scheduler prerequisites ⚠️🚨 #8287 by @GitHK
• 🐛🎨Do not fail a pipeline when the clusters-keeper or the computational backend in general is not reachable for short time 🚨 #8286 by @sanderegg
• ✨ Support center: extend response model of get profile endpoint with support group info #8294 by @pcrespov
• ✨ [Frontend] Support: Book a call #8297 by @odeimaiz
• ✨E2E: Added initial skeleton for testing MMUX services in E2E tests #8301 by @sanderegg
• 🐛Director-v2: fix empty arguments for max method #8308 by @sanderegg
• Fix python client wrt function job status 🐛 #8309 by @wvangeit
• ✨ Add Optional Contact Information Fields to get_profile Response #8300 by @pcrespov
• 🎨 Run each job creation as a single task in api-worker #8306 by @bisgaard-itis
• 🎨 [Frontend] Display Contact information #8302 by @odeimaiz
• ♻️ Refactors studies-dispatcher before extending nih portal's views api (🚨) #8257 by @pcrespov
• [Frontend] e2e: IDs for MetaModeling #8310 by @odeimaiz
• 🎨 [Frontend] All users know about the Support group #8305 by @odeimaiz
• 🐛 [Frontend] FIXES: Add nodes #8312 by @odeimaiz
• 🎨 Allow headers and random body generation in single endpoint locust test #8318 by @bisgaard-itis
• 🎨 Enhance account request emails to reduce invitation errors #8317 by @pcrespov
• ✨Clusters-keeper: Add new ENV to test different configurations #8304 by @sanderegg
• 🎨 [Frontend] Enh: Show Tags filter only in the Tutorials tab #8320 by @odeimaiz
• 🎨 Add env var for setting number of threads in api-server celery worker #8298 by @bisgaard-itis
• 🎨Maintenance & Performance: Properly setup asyncpg DB engine #8322 by @sanderegg
• 🎨 Only run a single function at a time in map endpoint #8327 by @bisgaard-itis
• 🎨 [Frontend] UX: Join project with assigned wallet #8324 by @odeimaiz
• 🐛 [Frontend] Add new parameter from node's inputs #8332 by @odeimaiz
• Add a check_write_permissions option to update function job/out 🐛  #8325 by @wvangeit
• ✅ Add parametrizable load tests for function interface #8326 by @bisgaard-itis
• 🎨 added docker hub registry auth to director-v2 when creating services ⚠️ #8321 by @GitHK
• 🎨 [Frontend] Event-driven patch regardless of whether RTC is enabled #8328 by @odeimaiz
• 🐛🎨⚗️Computational backend stability: improvements step 1 #8323 by @sanderegg
• 🎨 [Frontend] Hide some pages in Study/Template details when user has no write access #8331 by @odeimaiz
• ✨ Support Center: Gives Read Access to Support Users to User Accounts and Product Details #8313 by @pcrespov
• 🎨E2E: add create study, create function, start mmux #8311 by @sanderegg
• 🎨 [Frontend] Distinguish product groups (Everyone/Public and Support) #8335 by @odeimaiz
• ✨ Create custom generate json schema for resolving references #8295 by @bisgaard-itis
• 🐛🎨Computational backend stability: improvements step 2 #8341 by @sanderegg
• ⬆️ Upgrade traefik to v3.5.2 #8343 by @YuryHrytsuk
• Fix job_task_id not found if db doesnt have the field 🐛 🚑️ #8347 by @wvangeit
• ✨ Check for associated jobs when deleting a function #8342 by @giancarloromeo
• ✨ [Frontend] Delete Functions #8351 by @odeimaiz
• ✨ [Frontend] Support users can access other users extra data #8339 by @odeimaiz
• Bump actions/setup-python from 5 to 6 #8329 by @dependabot[bot]
• Bump actions/setup-node from 4.4.0 to 5.0.0 #8330 by @dependabot[bot]
• ♻️[Maintenance]: Improve RPC Server Logging and Error Handling #8346 by @pcrespov
• 🎨 [Frontend] Enhanced Support Center #8353 by @odeimaiz
• 🎨 [Frontend] Remove S4L's border and Enhance PO Center #8359 by @odeimaiz
• 🎨 Unmarks WEBSERVER_REALTIME_COLLABORATION as dev feature ⚠️ #8348 by @pcrespov
• 🎨 Added user identifiers to the UserAccountGetmodel #8358 by @pcrespov
• 🐛 Ensure consistent Celery task cancellation #8354 by @giancarloromeo
• 🎨 [Frontend] Enh: User Account UI #8361 by @odeimaiz
• 🐛 Ensure proper Redis client shutdown in Celery #8237 by @giancarloromeo
• 🎨🐛 Fix filtering bug in celery tasks #8355 by @bisgaard-itis
• 🎨 Cleanup test in celery library #8364 by @bisgaard-itis
• ♻️ Refactor Models, Schema Validation, and DB Utilities (Spin-off 1 from PR #8141) #8360 by @pcrespov
• ♻️Maintenance: improve cancellation error handling #8367 by @sanderegg
• ♻️ [Maintenance] Refactor Tests Utilities and Typing (Spin-off 2 from PR #8141) #8368 by @pcrespov
• 🎨 [Frontend] Support center feedback #8362 by @odeimaiz
• 🐛 Update API keys uniqueness constraint (🗃️) #8363 by @giancarloromeo
• 🎨 Makes removal of long running tasks faster #8350 by @GitHK
• 🎨 allow support user to patch conversation #8372 by @matusdrobuliak66
• ♻️🐛 Use celery task manager in function job task client service #8352 by @bisgaard-itis
• 🎨 [Frontend] Suport Center: Chat bubble and Fogbugz link #8369 by @odeimaiz
• 🐛 Celery tasks aborted after submission #8371 by @giancarloromeo
• 🎨 Computational backend performance: improvements step1 #8349 by @sanderegg
• 🐛 Add task_manager to api-worker #8373 by @bisgaard-itis
• 🎨Computational backend: performance improvements step2 - autoscaling shall ask dask to retire nodes only if necessary #8374 by @sanderegg
• ♻️Maintenance: multiple improvements after debugging session #8370 by @sanderegg
• ♻️Maintenance: fix generation of service names #8377 by @sanderegg
• 🐛 Minor fixes for the function api #8376 by @bisgaard-itis
• ⚗️ [Frontend] PoC: Rocket preview #8378 by @odeimaiz
• 🎨♻️Computational backend: stability improvements step 4 #8380 by @sanderegg
• 🎨 Increase timeout in map load test #8385 by @bisgaard-itis
• 🐛RabbitMQ client: prevent crashing consumer if channel is closed #8382 by @sanderegg
• ⬆️🔨 upgrade cache cleanup script #8390 by @sanderegg
• 🐛Dask-sidecar: added a larger timeout when pulling images #8389 by @sanderegg
• ⚗️ [Frontend] Integrate the 3rd party Appointment Booking tool #8391 by @odeimaiz
• 🐛 [Frontend] Fix: Crop long parameter values #8393 by @odeimaiz
• 🐛Computational backend: fix issue where job_id is inexistent + logs improvements #8395 by @sanderegg
• 🎨Computational backend: improvements step 5 #8396 by @sanderegg
• 🎨Computational backend: improvements step 6 #8397 by @sanderegg
• 🐛 [Frontend] Fix/hide support buttons #8399 by @odeimaiz
• 🎨Computational backend: stability improvements step7 #8400 by @sanderegg
• 🐛 [Frontend] Fix workbench #8402 by @odeimaiz
• 🐛 Adds user to project rooms on websocket reconnect #8407 by @matusdrobuliak66
• 🐛🎨 [Frontend] RTC: Reload project after websocket reconnection #8406 by @odeimaiz
• 🎨Computational backend: stability improvements step8 🚨 #8401 by @sanderegg
• 🐛Fix possible race condition in distributed semaphore initialization #8411 by @sanderegg
• ♻️🎨 [Frontend] Refactor conversations #8404 by @odeimaiz
• 🐛 Add internal scheduler UI in dynamic-scheduler #8410 by @GitHK
• 🎨 [Frontend] Create Function: Do not allow registering functions without exposing 1 input AND 1 output #8412 by @odeimaiz
• 🐛🎨 [Frontend] Consistent modified #8413 by @odeimaiz
• 🐛 [Frontend] Fix: Limit conversation title (50) #8416 by @odeimaiz

OPS

• Enable Chatbot for S4L products osparc-ops-environments#1221
• Revert: disable loki & vector-dev, oldschool graylog logging osparc-ops-environments#1223
• Explicitly set rabbit cluster name osparc-ops-environments#1220
• Prometheus: scrape RabbitMQ Cluster osparc-ops-environments#1218
• Fix misc bugs osparc-ops-environments#1216
• master: switch to standalone (cluster) rabbit ⚠️ 🚨 osparc-ops-environments#1212
• fix: bitname postgres-exporter image is only available on paid tier, switch to quay
• Refactor: pg-backup (remove dedicated service) ⚠️  osparc-ops-environments#1150
• Add (ha) rabbit cluster (but not use it) osparc-ops-environments#1179
• ✨ Add: vector.dev log aggregator (removes fluentd) osparc-ops-environments#1209
• 🐛 Fix: postgres query exporter staying disconnected when postgres is (briefly) offline osparc-ops-environments#1207
• FIX: typo in opentelemetry collector config
• 🎨 Improve: Observability performance osparc-ops-environments#1205
• Upgrade ops traefik to 3.5.2 osparc-ops-environments#1202
• Experimental: Tackle tempo max trace reached
• Experimental: Remove tempo span-metrics generator
• Fix prometheus high cardinality due to tempo span_name osparc-ops-environments#1200
• Add api-worker simcore service osparc-ops-environments#1195

DevOps action needed 👷

• Fix NIH PROD database configuration nih prod: metabase user has access to all simcore tables osparc-ops-environments#1193
• Merge config changes for Upgrade traefik to v3.5.2 ⚠️  osparc-ops-environments#1199
• AWS TIP: extend existing vpc osparc-ops-environments#1204
• AWS Subnets: simplify infrastructure osparc-ops-environments#1203
  • sim4life prod
  • nih prod
  • aws tip
  • dalco prod
  • inhouse tip
• install conntract to temp. fix sim4life: director-v2 missing logs in Graylog osparc-ops-environments#1180
  • sim4life prod
  • nih prod
  • aws tip
  • dalco prod
  • inhouse tip
• ✨ dynamic-scheduler prerequisites ⚠️🚨 #8287 @GitHK
  • sim4life prod
  • nih prod
  • aws tip
  • dalco prod
  • inhouse tip
• Add dockerhub creds env for director-v2 osparc-ops-environments#1208 @YuryHrytsuk
  • sim4life prod
  • nih prod
  • aws tip
  • dalco prod
  • inhouse tip
• ♻️ Refactors studies-dispatcher before extending nih portal's views api (🚨) #8257 @pcrespov
  • nih prod
• Add grafana dashboard for redis osparc-ops-environments#1160
  • sim4life prod
  • nih prod
  • aws tip
  • dalco prod
  • inhouse tip

DevOps after

• Close Issues during release v1.85.0 osparc-ops-environments#1201

Tests assessment: e2e testing check 🧪

No response

Test assessment: targeted-testing 🔍️

No response

Test assessment: user-testing 🧐

No response

Summary 📝

• Prepare release link

make release-prod version=<M.m.0>  git_sha=<commit_sha>

• Draft release changelog
• Announce maintenance ( ** ANNOUNCE AT LEAST 24 HOURS BEFORE ** )
• redis add an entry in db scheduled_maintenance with key maintenance {"start": "2023-03-06T13:00:00.000Z", "end": "2023-03-06T15:00:00.000Z", "reason": "Release <vX.X.0>"}. Note the time is in UTC, please adjust accordingly
  • sim4life.io
  • osparc.speag.com
  • osparc.io
  • tip.science
• status page (https://manage.statuspage.io/)
  • sim4life.io
  • s4l-lite.io
  • osparc.io
  • tip.science
• mattermost channels
  • maintenance
  • power users
• Publish draft draft
• Check release CI

Releasing 🚀

• Maintenance page up (https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/pipeline_schedules)
• Check hanging sidecars. Helper command to run in director-v2 CLI simcore-service-director-v2 close-and-save-service <uuid>
• Remove redis key
• Check deployed
  • sim4life.io
  • osparc.speag.com
  • osparc.io
  • tip.science
• Check testing endpoint ex. https://testing.osparc.speag.com/
• Update status page
• Update Release notes if hotfix (https://github.com/ITISFoundation/osparc-issues/blob/master/scripts/run_after_hotfix_to_prod.py)
• Check e2e runs
• Announce in mattermost

:tada: https://github.com/ITISFoundation/osparc-simcore/releases/tag/v<M.m.0>