What are these background tasks?

[tomkolp]

Today for several hours the CPU usage has been around 2000% (20 vCPU). Is this the announced update of indexes in the database? Such updates always took place when the weblate containers were launched.

weblate=# SELECT * FROM pg_stat_activity WHERE state <> 'idle';
 datid | datname |  pid  | leader_pid | usesysid | usename | application_name | client_addr | client_hostname | client_port |         backend_start         |          xact_start           |          query_start          |         state_change          | wait_event_type | wait_event | state  | backend_xid | backend_xmin | query_id |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              query                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              |  backend_type
-------+---------+-------+------------+----------+---------+------------------+-------------+-----------------+-------------+-------------------------------+-------------------------------+-------------------------------+-------------------------------+-----------------+------------+--------+-------------+--------------+----------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------
 18558 | weblate | 28843 |            |       10 | weblate |                  | 172.18.0.5  |                 |       46228 | 2023-09-14 18:26:30.187446+00 | 2023-09-14 18:26:37.241747+00 | 2023-09-14 18:26:37.241747+00 | 2023-09-14 18:26:37.241764+00 |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | client backend
 18558 | weblate | 28822 |            |       10 | weblate |                  | 172.18.0.5  |                 |       59876 | 2023-09-14 18:26:25.109327+00 | 2023-09-14 18:26:31.984075+00 | 2023-09-14 18:26:31.984075+00 | 2023-09-14 18:26:31.984087+00 |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | client backend
 18558 | weblate | 28787 |            |       10 | weblate |                  | 172.18.0.5  |                 |       37844 | 2023-09-14 18:25:54.727732+00 | 2023-09-14 18:26:00.874985+00 | 2023-09-14 18:26:00.874985+00 | 2023-09-14 18:26:00.874994+00 |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | client backend
 18558 | weblate | 28794 |      28787 |       10 | weblate |                  |             |                 |             | 2023-09-14 18:26:00.889593+00 | 2023-09-14 18:26:00.874985+00 | 2023-09-14 18:26:00.874985+00 | 2023-09-14 18:26:00.914973+00 |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | parallel worker
 18558 | weblate | 28795 |      28787 |       10 | weblate |                  |             |                 |             | 2023-09-14 18:26:00.8899+00   | 2023-09-14 18:26:00.874985+00 | 2023-09-14 18:26:00.874985+00 | 2023-09-14 18:26:00.914975+00 |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | parallel worker
 18558 | weblate | 28796 |      28787 |       10 | weblate |                  |             |                 |             | 2023-09-14 18:26:00.890173+00 | 2023-09-14 18:26:00.874985+00 | 2023-09-14 18:26:00.874985+00 | 2023-09-14 18:26:00.915051+00 |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | parallel worker
 18558 | weblate | 28849 |      28822 |       10 | weblate |                  |             |                 |             | 2023-09-14 18:26:32.001384+00 | 2023-09-14 18:26:31.984075+00 | 2023-09-14 18:26:31.984075+00 | 2023-09-14 18:26:32.036186+00 |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | parallel worker
 18558 | weblate | 28850 |      28822 |       10 | weblate |                  |             |                 |             | 2023-09-14 18:26:32.001947+00 | 2023-09-14 18:26:31.984075+00 | 2023-09-14 18:26:31.984075+00 | 2023-09-14 18:26:32.027616+00 |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | parallel worker
 18558 | weblate | 28851 |      28822 |       10 | weblate |                  |             |                 |             | 2023-09-14 18:26:32.002426+00 | 2023-09-14 18:26:31.984075+00 | 2023-09-14 18:26:31.984075+00 | 2023-09-14 18:26:32.036186+00 |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | parallel worker
 18558 | weblate | 28852 |      28822 |       10 | weblate |                  |             |                 |             | 2023-09-14 18:26:32.002857+00 | 2023-09-14 18:26:31.984075+00 | 2023-09-14 18:26:31.984075+00 | 2023-09-14 18:26:32.029842+00 |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | parallel worker
 18558 | weblate | 28853 |      28822 |       10 | weblate |                  |             |                 |             | 2023-09-14 18:26:32.003466+00 | 2023-09-14 18:26:31.984075+00 | 2023-09-14 18:26:31.984075+00 | 2023-09-14 18:26:32.03375+00  |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | parallel worker
 18558 | weblate | 28840 |            |       10 | weblate | psql             |             |                 |          -1 | 2023-09-14 18:26:28.856717+00 | 2023-09-14 18:26:48.337151+00 | 2023-09-14 18:26:48.337151+00 | 2023-09-14 18:26:48.337155+00 |                 |            | active |             |      3218001 |          | SELECT * FROM pg_stat_activity WHERE state <> 'idle';                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           | client backend
 18558 | weblate | 28855 |      28843 |       10 | weblate |                  |             |                 |             | 2023-09-14 18:26:37.259072+00 | 2023-09-14 18:26:37.241747+00 | 2023-09-14 18:26:37.241747+00 | 2023-09-14 18:26:37.287943+00 |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | parallel worker
 18558 | weblate | 28856 |      28843 |       10 | weblate |                  |             |                 |             | 2023-09-14 18:26:37.259365+00 | 2023-09-14 18:26:37.241747+00 | 2023-09-14 18:26:37.241747+00 | 2023-09-14 18:26:37.284337+00 |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | parallel worker
 18558 | weblate | 28857 |      28843 |       10 | weblate |                  |             |                 |             | 2023-09-14 18:26:37.259867+00 | 2023-09-14 18:26:37.241747+00 | 2023-09-14 18:26:37.241747+00 | 2023-09-14 18:26:37.28433+00  |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | parallel worker
 18558 | weblate | 28858 |      28843 |       10 | weblate |                  |             |                 |             | 2023-09-14 18:26:37.260492+00 | 2023-09-14 18:26:37.241747+00 | 2023-09-14 18:26:37.241747+00 | 2023-09-14 18:26:37.28433+00  |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | parallel worker
 18558 | weblate | 28797 |      28787 |       10 | weblate |                  |             |                 |             | 2023-09-14 18:26:00.890426+00 | 2023-09-14 18:26:00.874985+00 | 2023-09-14 18:26:00.874985+00 | 2023-09-14 18:26:00.915097+00 |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | parallel worker
 18558 | weblate | 28798 |      28787 |       10 | weblate |                  |             |                 |             | 2023-09-14 18:26:00.890859+00 | 2023-09-14 18:26:00.874985+00 | 2023-09-14 18:26:00.874985+00 | 2023-09-14 18:26:00.922004+00 |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | parallel worker
 18558 | weblate | 28859 |      28843 |       10 | weblate |                  |             |                 |             | 2023-09-14 18:26:37.260963+00 | 2023-09-14 18:26:37.241747+00 | 2023-09-14 18:26:37.241747+00 | 2023-09-14 18:26:37.290208+00 |                 |            | active |             |      3218001 |          | SELECT "trans_unit"."id", "trans_unit"."translation_id", "trans_unit"."id_hash", "trans_unit"."location", "trans_unit"."context", "trans_unit"."note", "trans_unit"."flags", "trans_unit"."source", "trans_unit"."previous_source", "trans_unit"."target", "trans_unit"."state", "trans_unit"."original_state", "trans_unit"."details", "trans_unit"."position", "trans_unit"."num_words", "trans_unit"."priority", "trans_unit"."pending", "trans_unit"."timestamp", "trans_unit"."last_updated", "trans_unit"."extra_flags", "trans_unit"."explanation", "trans_unit"."variant_id", "trans_unit"."source_unit_id" FROM "trans_unit" INNER JOIN "trans_translation" ON ("trans_unit"."translation_id" = "trans_translation"."id") INNER JOIN "trans_component" ON ("trans_translation"."component_id" = "trans_component"."id") WHERE ("trans_unit"."state" >= 20 AND "trans_component"."allow_translation_propagation" AND "trans_component"."project_id" = 5 AND NOT (MD5(LOWER("trans_unit"."target")) = (MD5(LOWER('')))) AND ((MD5("trans_unit"."target") | parallel worker

CONTAINER ID   NAME                            CPU %      MEM USAGE / LIMIT     MEM %     NET I/O           BLOCK I/O         PIDS
004e9573e2e0   weblate-docker-weblate-1        9.82%      8.403GiB / 39.15GiB   21.47%    13.8GB / 6.97GB   88.8MB / 304MB    249
39741650f8a5   weblate-docker-cache-1          0.36%      51.49MiB / 39.15GiB   0.13%     811MB / 3.47GB    128MB / 6.79GB    7
1331b2cc27e9   weblate-docker-database-1       1806.69%   6.845GiB / 39.15GiB   17.49%    5.51GB / 10.3GB   3.58GB / 30.8GB   32
28355d4fcc8b   weblate-docker-https-portal-1   0.00%      6.211MiB / 39.15GiB   0.02%     375MB / 162MB     8.19kB / 360kB    14

Start 17:00

[nijel]

The indexes are created upon upgrade during the container startup, you can see this in the logs.

Celery is used for many tasks, see https://docs.weblate.org/en/latest/admin/install.html#celery. Again, the container log will show you which tasks it is processing.

[tomkolp]

update_checks and update_component_stats has been going on for 16 hours now.

weblate-docker-weblate-1   | celery-celery stderr | [2023-09-15 08:42:09,120: INFO/MainProcess] Task weblate.checks.tasks.batch_update_checks[6209b51f-1d24-4f3d-bc77-816ed6192cdd] received
weblate-docker-weblate-1   | celery-celery stderr | [2023-09-15 08:42:09,209: INFO/MainProcess] Task weblate.checks.tasks.batch_update_checks[3c48bcc2-c938-4302-a0b5-244aac100be3] received
weblate-docker-weblate-1   | celery-celery stderr | [2023-09-15 08:42:09,277: INFO/MainProcess] Task weblate.trans.tasks.update_component_stats[46df253d-9030-4120-add9-45fa1cc92c0c] received
weblate-docker-weblate-1   | nginx stdout | 127.0.0.1 - - [15/Sep/2023:08:42:19 +0200] "GET /healthz/ HTTP/1.1" 200 12 "-" "curl/7.74.0"
weblate-docker-weblate-1   | celery-celery stderr | [2023-09-15 08:42:34,376: INFO/MainProcess] Task weblate.trans.tasks.update_component_stats[1f8215f8-9bd2-402f-9f85-91cc5d6d09ed] received
weblate-docker-weblate-1   | celery-celery stderr | [2023-09-15 08:42:34,469: INFO/MainProcess] Task weblate.checks.tasks.batch_update_checks[7bdd1d57-d71c-48d0-87ff-435e55171c10] received

Can detailed Celera statistics be displayed in the "Performance Report" tab? Could such a feature appear in the future?

[nijel]

I don't think we will develop more detailed monitoring. There are already existing tools like https://github.com/mher/flower

[tomkolp]

@nijel I already know what triggers the above tasks. after removing one component from the weblate gui, the following is launched: Task weblate.checks.tasks.batch_update_checks weblate.trans.tasks.update_component_stats these two tasks last 48 hours with a load of 21 vCPU at 100%. Is there some bug? When I delete the component in the remote repo there is no such problem.

[nijel]

This seems weird, looks like it is triggered too many times. I've added more verbose logging of these in #10040 so that it is easier to see what is going on.