🚀 Release v1.81.0

[YuryHrytsuk]

Release version

1.81.0

Commit SHA

c8e880a0a7818f969485b2505c4a15c06281a50c

Previous pre-release

https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_PauwelKwak3

Planned date

April 20, 2025

Did the commit CI suceeded?

• The commit CI succeeded.

Motivation

• Regular sprint release

Changes

• ✨ web-api: Adds endpoint to retrieve project services with Release and Access Information #7287 by @pcrespov
• ✨ [Frontend] Enh: Adapt to paginated navigation and to new model #7280 by @odeimaiz
• 🐛 Use tenacity in flaky api keys tests #7304 by @bisgaard-itis
• ⬆️ updates test & tooling requirements #7298 by @GitHK
• 🐛 Fixes raises when stopping log fetching in dynamic-sidecar #7302 by @GitHK
• ♻️ Refactor catalog domain in webserver #7308 by @bisgaard-itis
• 🐛 [Frontend] Bugfix: getDatasetsByLocationCached #7310 by @odeimaiz
• 🐛 Fixes contract limit parameter #7309 by @matusdrobuliak66
• 🐛Storage: quote returned links such that they are usable with files containing parentheses #7313 by @sanderegg
• 🎨 [Frontend] Guided Tours: update to latest frontend #7311 by @odeimaiz
• 🐛 sidecar no longer fails when saving data with missing permissions #7307 by @GitHK
• 🐛 EFS - background task not starting #7314 by @matusdrobuliak66
• ✨Storage: provide entrypoint to compute path size (⚠️ devops) #7286 by @sanderegg
• 🎨E2E: add --service_version option #7083 by @sanderegg
• 🐛 [Frontend] Fix: Update members list after sharing #7325 by @odeimaiz
• ♻️🎨 web-server: enhances product domain #7294 by @pcrespov
• 🐛 Clean Pydantic's UserWarnings #7324 by @giancarloromeo
• 🐛 [Frontend] Fix: Credits Summary indicator's offset #7333 by @odeimaiz
• 🐛 allows mergify to merge PRs #7332 by @GitHK
• 🎨Autoscaling monitor: allow SSH tunneling for DB access, and add return value for CLI usage #7329 by @sanderegg
• 🐛 fixed issue with catalog and the icon field #7331 by @GitHK
• ⬆️ upgraded dynamic-sidecar requirements #7316 by @GitHK
• 🐛 [Frontend] Shop: Fix thumbnail #7335 by @odeimaiz
• 🐛Autoscaled instances monitoring script: small fixes #7337 by @sanderegg
• ✨ Add a Distributed Task Queue (using Celery) (🏗️ ⚠️DEVOPS) #7214 by @giancarloromeo
• ♻️ webserver: catalog & api_keys renaming of modules #7334 by @pcrespov
• ⬆️ upgraded dynamic-scheduler requirements #7318 by @GitHK
• Add workflow_dispatch trigger to PR CI workflows #7340 by @bisgaard-itis
• 🐛 agent now starts the volume cleanup task #7346 by @GitHK
• 🎨 [Frontend] Show default product thumbnail if resource's thumbnail is invalid #7341 by @odeimaiz
• ⬆️ upgraded director-v2 requirements #7319 by @GitHK
• ⬆️ upgraded agent requirements #7317 by @GitHK
• 🎨 release notes version has always patch set to 0 #7339 by @GitHK
• ♻️Storage: use transactions helpers #7343 by @sanderegg
• ♻️Storage Celery integration: diverse enhancements #7353 by @sanderegg
• ⬆️ catalog service: upgrades requirements #7356 by @pcrespov
• 🐛 fix wrong ServiceRunGet model #7349 by @matusdrobuliak66
• ⬆️ invitations service: upgrades requirements #7355 by @pcrespov
• 🐛 Avoid GC form detecting services as orphans when they are not #7354 by @GitHK
• 🎨♻️ [Frontend (& API)] Retire history from list latest services #7292 by @odeimaiz
• 🐛 Fix minor director-v0 typing bug #7323 by @mrnicegyu11
• 🐛 Celery tasks list doesn't include submitted, active and scheduled ones #7366 by @giancarloromeo
• 🎨 [Frontend] Wording: Don't say Failed, say Unsuccessful #7361 by @odeimaiz
• Bump @babel/helpers from 7.24.7 to 7.26.10 in /tests/e2e in the npm_and_yarn group across 1 directory #7347 by @dependabot
• 🐛 [Frontend] Fix: Cropped Fontawesome images #7369 by @odeimaiz
• ✨Computation of path size: WebAPI + RPC to storage through Asyncjobs #7315 by @sanderegg
• 🐛 [Frontend] Do not allow to leave studies with no owners #7370 by @odeimaiz
• 🎨 Changed confusing wording #7365 by @GitHK
• ♻️DB maintenance: drop clusters and cluster_to_groups db tables (🗃️) #7373 by @sanderegg
• 🎨 [Frontend] Study (and Node) :size #7371 by @odeimaiz
• 🐛 [Frontend] Fix: New project from menu #7377 by @odeimaiz
• 🐛Cannot refresh page when only 1 study per user is allowed #7374 by @sanderegg
• 🐛 Permission changes in dynamic-sidecar are always executed when closing a service #7372 by @GitHK
• 🎨 web-api: enhances reset-password workflow (🚨) #7336 by @pcrespov
• 🎨 New OEC:{traceback}-{timestamp} format for de-duplication purposes #7364 by @pcrespov
• 🎨 web-api: patch userName at least 4 chars ⚠️ #7389 by @pcrespov
• 🎨 [Frontend] Use cursor paginated storage API #7388 by @odeimaiz
• ⬆️Maintenance: unblock moto library #7378 by @sanderegg
• ⬆️Maintenance: upgrade rabbitmq to 3.13.7 #7376 by @sanderegg
• Introduce links for async jobs actions (hateos style) in webserver #7320 by @bisgaard-itis
• ✅ Fixes flaky test: create_troubleshotting_log_message #7400 by @pcrespov
• 🎨 [Frontend] Allow users copy OEC #7394 by @odeimaiz
• 🎨Maintenance: make devel mode faster to boot + log fixes + webserver DB disable write to disk #7403 by @sanderegg
• ⚗️Director-v0: Disable keep-alive connections #7405 by @sanderegg
• ✨ web-api: User privacy policy extended to username 🗃️ #7402 by @pcrespov
• 🎨 [Frontend] Mock: Job Manager #7396 by @odeimaiz
• ✨Async Jobs: add some tests + an internal client #7410 by @sanderegg
• 🎨 web-api: Add privacy Field to Profile Endpoints and Retire Legacy Entrypoint #7408 by @pcrespov
• 🎨 [Frontend] Feature: Hide username #7406 by @odeimaiz
• 🐛web-api: Fixes missing supportID on default 5XX responses #7414 by @pcrespov
• 🔧 Fix CI installation failure for json2html caused by setuptools 78.0.1 update #7415 by @pcrespov
• ♻️ webserver: Refactor projects Domain to Align with Standardized Module Structure #7409 by @pcrespov
• 🎨🐛 [Frontend] Enh/fix: Services Pricing Plans #7412 by @odeimaiz
• 🎨 web-api: empty_trash operation waits until explicitly trashed projects are deleted #7416 by @pcrespov
• 🐛 Fix Celery's Redis backend SSL config #7407 by @giancarloromeo
• 🐛 Fix task status percentage #7422 by @bisgaard-itis
• 🐛 Fix redis ssl certificate issue #7425 by @bisgaard-itis
• 🎨 [Frontend] Enh: Wording and .po file #7418 by @odeimaiz
• 🐛Storage Worker does not need a RabbitMQ client #7426 by @sanderegg
• 🐛Storage: Celery issues with validation #7427 by @sanderegg
• 🐛Storage: multiple user_id defined issue #7433 by @sanderegg
• ⚗️ Remove asserts in async jobs #7434 by @bisgaard-itis
• ♻️ Further cleanup of async jobs framework #7424 by @bisgaard-itis
• 🐛 [Frontend] Fix: storage/async-jobs was retired #7429 by @odeimaiz
• 🎨Storage with Celery: unit tests working now with storage worker implemented #7438 by @sanderegg
• ♻️ webserver: Refactor login domain for CSR compliance and future confirmation logic #7417 by @pcrespov
• 🐛 Fix bug #7440 by @bisgaard-itis
• 🐛Storage-Worker: ensure startup waits for fastapi application readyness #7442 by @sanderegg
• ✨ New CatalogService in api-server that connects via rpc to the catalog micro-service #7439 by @pcrespov
• 🎨 Use async redis client #7443 by @bisgaard-itis
• 🎨Storage: HA (🚨🚨🚨 test with multiple replicas) #7375 by @sanderegg
• Add example functions section to api-server #7398 by @bisgaard-itis
• 🐛 [Frontend] Fix: Extract path :size #7441 by @odeimaiz
• 🐛 [Frontend] Fix: show computational service's settings in App Mode #7445 by @odeimaiz
• 🐛 [Frontend] Fix: Remove Task #7451 by @odeimaiz
• 🎨 Prettify emails #7432 by @odeimaiz
• 🎨Director-v0: set default timeout to 20s and potentially allow setting it up #7460 by @sanderegg
• 🐛 Fixed issue where GC stopping too early #7457 by @GitHK
• ✨ adds entry point to dynamic-scheduler exposing the current running services #7454 by @GitHK
• 🎨Monitoring script: add json output for summary, allow to trigger computational cluster termination #7462 by @sanderegg
• ✨Storage: batchDelete #7450 by @sanderegg
• 🎨 [Frontend] Enh: batch delete files #7458 by @odeimaiz
• 🎨E2E: Fail fast conditions + websocket logging in case of error #7463 by @sanderegg
• 🐛 Clean Pydantic model_dumps warnings #7358 by @giancarloromeo
• 🎨 [Frontend] Enh: Show deleting files progress #7466 by @odeimaiz
• ✨ api and web-server: introduce job-project mapping via projects_to_jobs table and RPC integration #7435 by @pcrespov
• 🐛Datcore-Adapter: fix listing files in pennsieve pagination sized 1000 #7464 by @sanderegg
• 🔨 Removes unused validation #7468 by @pcrespov
• 🎨 [Frontend] Enh: Expose access rights when Sharing Study #7467 by @odeimaiz
• 🎨 [Frontend] Enh: releaseTag to OEC clipboard data #7469 by @odeimaiz
• ✨ web-api: new share_project operation (dev) and updates notifications-library #7431 by @pcrespov
• 🐛 [Frontend] Bugfixes: Long Running Task #7470 by @odeimaiz
• 🐛Webserver: duplication of studies, ensure message does not contain progress #7474 by @sanderegg
• 🐛Dask-sidecar: set 1 hour timeout when waiting for container logs #7472 by @sanderegg
• ♻️🚨 Improve DB query listing_projects performance (🗃️) #7475 by @matusdrobuliak66
• 🎨Monitoring script: allow to terminate non-billable clusters #7479 by @sanderegg
• ✨ Maintenance: Improves troubleshooting dump message used to log 5XX errors #7473 by @pcrespov
• 🎨 Feature: on share project email #7455 by @odeimaiz
• ✨ [Frontend] Feature: Share Study via email #7481 by @odeimaiz
• 🐛 [Frontend] Fixes: delete(d) Workspaces #7484 by @odeimaiz
• 🎨 [Frontend] Enh service calls: avoid request deduplication #7487 by @odeimaiz
• ✨ Start implementation of programs section of api server #7447 by @bisgaard-itis
• ✨ Add exporter code to storage #7218 by @GitHK
• 🎨 catalog: lifespan managers for fastapi apps #7483 by @pcrespov
• 🎨 state of webserverDevFeaturesEnabled flag is passed in statics for the front-end #7490 by @pcrespov
• 🐛 Dont freeze fields in ApiServerOutputSchema #7494 by @bisgaard-itis
• ✨ [Frontend] Feature: multi download #7495 by @odeimaiz
• 🐛Autoscaling: Fix lost stopped EC2 instances and missing error logs #7493 by @sanderegg
• ✨ Add Celery routing queues ⚠️ #7471 by @giancarloromeo
• ♻️ making docker-api-proxy buildable on arm #7497 by @GitHK
• ♻️ export data feature enhancements #7498 by @GitHK
• 🐛🎨 [Frontend] Handle missing services #7488 by @odeimaiz
• 🐛 Fix a typo in Celery's cpu-bound queue name #7503 by @giancarloromeo
• 🐛 Fix abort task test #7501 by @bisgaard-itis
• 🎨E2E: playwright improvements #7500 by @sanderegg
• ♻️ Refactor simcore_service_catalog: Apply Layered Architecture and Initialization Cleanup #7491 by @pcrespov
• 🎨 E2E: upgrade timings #7511 by @sanderegg
• ♻️ lifespans cleanup #7496 by @GitHK
• 🎨E2E: fixed computation of timeouts #7512 by @sanderegg
• 🐛 [Frontend] Fix: Do not list deprecated service versions #7504 by @odeimaiz
• ✨Maintenance: added first draft of copilot instructions #7513 by @sanderegg
• 🐛E2E: fix missing return value #7515 by @sanderegg
• 🐛🎨 [Frontend] Enh: Comments aesthetics #7517 by @odeimaiz
• ✨ [Frontend] Clusters mock table #7521 by @odeimaiz
• 🐛 Monitor Celery tasks cancellation #7514 by @giancarloromeo
• ♻️ Remove listing of programs #7530 by @bisgaard-itis

Devops check 👷

• PROD: use registry pull through cache osparc-ops-environments#939 blocked
• verify and close [Docker hub] Introduce [more] fine-grained access tokens osparc-ops-environments#975
  • Analyse dockerhub usage and make sure that proper access tokens are used for pulling in deployments
• double check director v0 is not struggling (we reduced amount of replicas) internal master: registry is occasionally unresponsive osparc-ops-environments#995
• Require grafana terraform state to be green in CI (remove allowed_failure)
• add grafana dashboard for docker registry from internal master: registry is occasionally unresponsive osparc-ops-environments#995
  • make sure [BUG] CI Pipelines do not add new Grafana dashboards osparc-ops-environments#1002 was fixed
  • nih prod
  • dalco prod
  • inhouse tip DK is working on it
  • aws tip
  • sim4life
• Update shell prompt with ansible introduce terminal prompt per deployment osparc-ops-environments#980
  • nih prod
  • dalco prod
  • inhouse tip
  • aws tip
  • sim4life
• [Dalco] remove staging docker configs / secrets
• Update SSL Certificates
  • dalco prod
  • tip inhouse
  • aws tip
• Make sure Prometheus configuration is up-to-date
  • aws
  • public
  • dalco

Tests assessment: e2e testing check 🧪

No response

Test assessment: targeted-testing 🔍️

No response

Test assessment: user-testing 🧐

No response

Summary 📝

• Prepare release link

make release-prod version=<M.m.0>  git_sha=<commit_sha>

• Draft release changelog
• Announce maintenance ( ** ANNOUNCE AT LEAST 24 HOURS BEFORE ** )
• redis add an entry in db scheduled_maintenance with key maintenance {"start": "2023-03-06T13:00:00.000Z", "end": "2023-03-06T15:00:00.000Z", "reason": "Release <vX.X.0>"}. Note the time is in UTC, please adjust accordingly
  • sim4life.io
  • osparc.speag.com
  • osparc.io
  • tip.science
• status page (https://manage.statuspage.io/)
  • sim4life.io
  • s4l-lite.io
  • osparc.io
  • tip.science
• mattermost channels
  • maintenance
  • power users
• Publish draft draft
• Check release CI

Releasing 🚀

• Maintenance page up (https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/pipeline_schedules)
• Check hanging sidecars. Helper command to run in director-v2 CLI simcore-service-director-v2 close-and-save-service <uuid>
• Remove redis key
• Check deployed
  • sim4life.io
  • osparc.speag.com
  • osparc.io
  • tip.science
• Check testing endpoint ex. https://testing.osparc.speag.com/
• Update status page
• Update Release notes if hotfix (https://github.com/ITISFoundation/osparc-issues/blob/master/scripts/run_after_hotfix_to_prod.py)
• Check e2e runs
• Announce in mattermost

:tada: https://github.com/ITISFoundation/osparc-simcore/releases/tag/v<M.m.0>

[matusdrobuliak66]

👷 DB Tables maintenance during next release @matusdrobuliak66

• vacuum full analyze <table name> --> Rewrites the entire table into a new disk file, removing all dead tuples and compacting the table to reclaim disk space. (Blocking operation) + Does update query planner statistics (important for DB engine planner)
• reindex table <table name> --> Rebuilds indexes to remove bloat caused by dead tuples.

vacuum full analyze resource_tracker_service_runs;
reindex table resource_tracker_service_runs;

vacuum full analyze resource_tracker_credit_transactions;
reindex table resource_tracker_credit_transactions;

vacuum full analyze projects;
reindex table projects;

vacuum full analyze projects_tags;
reindex table projects_tags;

vacuum full analyze projects_to_products;
reindex table projects_to_products;

vacuum full analyze projects_nodes;
reindex table projects_nodes;

vacuum full analyze project_to_groups;
reindex table project_to_groups;

vacuum full analyze workspaces_access_rights;
reindex table workspaces_access_rights;

vacuum full analyze tags_access_rights;
reindex table tags_access_rights;

vacuum full analyze comp_tasks;
reindex table comp_tasks;

vacuum full analyze comp_runs;
reindex table comp_runs;

vacuum full analyze comp_pipeline;
reindex table comp_pipeline;

vacuum full analyze file_meta_data;
reindex table file_meta_data;

vacuum full analyze services_meta_data;
reindex table services_meta_data;

vacuum full analyze services_access_rights;
reindex table services_access_rights;

vacuum full analyze user_preferences_frontend;
reindex table user_preferences_frontend;

[matusdrobuliak66]

After release

• 🎨 web-api: patch userName at least 4 chars ⚠️ #7389 (comment) @odeimaiz @pcrespov

[YuryHrytsuk]

Incidents during release

• Docker registry grafana dashboard is missing (was not added by grafana import) @mrnicegyu11
• traefik www redirect is broken osparc-ops-environments#1028

[matusdrobuliak66]

👷 DB Tables maintenance during next release @matusdrobuliak66

• vacuum full analyze <table name> --> Rewrites the entire table into a new disk file, removing all dead tuples and compacting the table to reclaim disk space. (Blocking operation) + Does update query planner statistics (important for DB engine planner)
• reindex table <table name> --> Rebuilds indexes to remove bloat caused by dead tuples.

vacuum full analyze resource_tracker_service_runs;
reindex table resource_tracker_service_runs;

vacuum full analyze resource_tracker_credit_transactions;
reindex table resource_tracker_credit_transactions;

vacuum full analyze projects;
reindex table projects;

vacuum full analyze projects_tags;
reindex table projects_tags;

vacuum full analyze projects_to_products;
reindex table projects_to_products;

vacuum full analyze projects_nodes;
reindex table projects_nodes;

vacuum full analyze project_to_groups;
reindex table project_to_groups;

vacuum full analyze workspaces_access_rights;
reindex table workspaces_access_rights;

vacuum full analyze tags_access_rights;
reindex table tags_access_rights;

vacuum full analyze comp_tasks;
reindex table comp_tasks;

vacuum full analyze comp_runs;
reindex table comp_runs;

vacuum full analyze comp_pipeline;
reindex table comp_pipeline;

vacuum full analyze file_meta_data;
reindex table file_meta_data;

vacuum full analyze services_meta_data;
reindex table services_meta_data;

vacuum full analyze services_access_rights;
reindex table services_access_rights;

vacuum full analyze user_preferences_frontend;
reindex table user_preferences_frontend;

Database maintenance done for all deployments ✅