-
Notifications
You must be signed in to change notification settings - Fork 1.2k
Description
After running sudo ansible-playbook -i environments/local openwhisk.yml, an error occurred indicating that the controller was unable to communicate with Kafka.
error when installing:
fatal: [controller0]: FAILED! => {"access_control_allow_headers": "Authorization, Origin, X-Requested-With, Content-Type, Accept, User-Agent", "access_control_allow_methods": "GET, DELETE, POST, PUT, HEAD", "access_control_allow_origin": "*", "changed": false, "connection": "close", "content_length": "141", "content_type": "application/json", "date": "Wed, 15 Oct 2025 14:41:03 GMT", "elapsed": 0, "json": {"code": "xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ", "error": "The server is currently unavailable (because it is overloaded or down for maintenance)."}, "msg": "Status code was 503 and not [200]: HTTP Error 503: Service Unavailable", "redirected": false, "server": "akka-http/10.2.4", "status": 503, "url": "https://789c46b1-71f6-4ed5-8c54-816aa4f8c502:abczO3xZCLrMN6v2BKK1dXYFpXlPkccOFqm12CdAsMgRU4VrNZ9lyGVCGuMDGIwP@172.17.0.1:10001/api/v1/namespaces/_/actions/invokerHealthTestAction0?blocking=false&result=false", "x_request_id": "xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ"}
...ignoring
Logs for controller0
bash-5.1# grep -i "ERROR" controller0_logs.log
[2025-10-13T08:55:03.952Z] [ERROR] [#tid_fLiYiW3E2rT8f71rW3b8z6tRyaSmGkhN] [ShardingContainerPoolBalancer] failed to schedule activation 52b273eb154b43ceb273eb154b03ced9, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T08:55:03.952Z] [WARN] [#tid_fLiYiW3E2rT8f71rW3b8z6tRyaSmGkhN] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:215:77]
[2025-10-13T08:55:03.953Z] [WARN] [#tid_fLiYiW3E2rT8f71rW3b8z6tRyaSmGkhN] [ActionsApi] No invokers available [marker:controller_activation_error:215:78]
[2025-10-13T08:55:03.953Z] [ERROR] [#tid_fLiYiW3E2rT8f71rW3b8z6tRyaSmGkhN] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T12:25:16.312Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T12:25:16.413Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T12:25:16.619Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T12:25:39.076Z] [ERROR] [#tid_OFhG5xFk0XbrDBvRaWu8tixEFuHNFPfy] [ShardingContainerPoolBalancer] failed to schedule activation 9f8a3fe90f7748078a3fe90f77f80738, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T12:25:39.077Z] [WARN] [#tid_OFhG5xFk0XbrDBvRaWu8tixEFuHNFPfy] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:193:65]
[2025-10-13T12:25:39.077Z] [WARN] [#tid_OFhG5xFk0XbrDBvRaWu8tixEFuHNFPfy] [ActionsApi] No invokers available [marker:controller_activation_error:193:65]
[2025-10-13T12:25:39.077Z] [ERROR] [#tid_OFhG5xFk0XbrDBvRaWu8tixEFuHNFPfy] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T12:54:48.356Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T12:54:48.356Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T12:54:48.356Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T12:55:10.268Z] [ERROR] [#tid_kOFS0gnVuGyGFPtQSb9jjYdBxWNX7M8r] [ShardingContainerPoolBalancer] failed to schedule activation a816a41eac5141c596a41eac5131c5ac, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T12:55:10.268Z] [WARN] [#tid_kOFS0gnVuGyGFPtQSb9jjYdBxWNX7M8r] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:190:62]
[2025-10-13T12:55:10.269Z] [WARN] [#tid_kOFS0gnVuGyGFPtQSb9jjYdBxWNX7M8r] [ActionsApi] No invokers available [marker:controller_activation_error:191:63]
[2025-10-13T12:55:10.269Z] [ERROR] [#tid_kOFS0gnVuGyGFPtQSb9jjYdBxWNX7M8r] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T13:50:50.917Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T13:50:50.917Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T13:50:50.918Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T13:51:13.616Z] [ERROR] [#tid_eIpz7abhXYRyWgPcl8jaw4KghgSCQLAT] [ShardingContainerPoolBalancer] failed to schedule activation 0f69a5547f084b47a9a5547f08fb47ba, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T13:51:13.617Z] [WARN] [#tid_eIpz7abhXYRyWgPcl8jaw4KghgSCQLAT] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:176:66]
[2025-10-13T13:51:13.617Z] [WARN] [#tid_eIpz7abhXYRyWgPcl8jaw4KghgSCQLAT] [ActionsApi] No invokers available [marker:controller_activation_error:177:67]
[2025-10-13T13:51:13.617Z] [ERROR] [#tid_eIpz7abhXYRyWgPcl8jaw4KghgSCQLAT] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T14:05:11.175Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:05:11.175Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:05:11.176Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:05:31.893Z] [ERROR] [#tid_xqUuunFLYIeq5b7jmZDunenZ316Vs3tG] [ShardingContainerPoolBalancer] failed to schedule activation 7697b2e8847e4b8b97b2e8847e5b8b61, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T14:05:31.894Z] [WARN] [#tid_xqUuunFLYIeq5b7jmZDunenZ316Vs3tG] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:182:65]
[2025-10-13T14:05:31.894Z] [WARN] [#tid_xqUuunFLYIeq5b7jmZDunenZ316Vs3tG] [ActionsApi] No invokers available [marker:controller_activation_error:182:65]
[2025-10-13T14:05:31.894Z] [ERROR] [#tid_xqUuunFLYIeq5b7jmZDunenZ316Vs3tG] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T14:47:41.646Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:47:41.647Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:47:41.647Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:47:58.220Z] [ERROR] [#tid_rBQ3X6P4hC79aFrH6BPZdnYbDZULV5gf] [ShardingContainerPoolBalancer] failed to schedule activation 1076de7831b348afb6de7831b348afc3, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map(Unhealthy -> 1)
[2025-10-13T14:47:58.221Z] [WARN] [#tid_rBQ3X6P4hC79aFrH6BPZdnYbDZULV5gf] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:211:88]
[2025-10-13T14:47:58.221Z] [WARN] [#tid_rBQ3X6P4hC79aFrH6BPZdnYbDZULV5gf] [ActionsApi] No invokers available [marker:controller_activation_error:211:89]
[2025-10-13T14:47:58.221Z] [ERROR] [#tid_rBQ3X6P4hC79aFrH6BPZdnYbDZULV5gf] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T14:48:50.143Z] [ERROR] [#tid_sid_invokerHealth] [KafkaProducerConnector] sending message on topic 'invoker0' failed: Topic invoker0 not present in metadata after 60000 ms.
[2025-10-13T14:48:50.157Z] [ERROR] [#tid_sid_invokerHealth] [KafkaProducerConnector] sending message on topic 'invoker0' failed: Cannot perform operation after producer has been closed
[2025-10-13T14:48:50.208Z] [WARN] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] error on posting to topic invoker0 [marker:controller_kafka_error:61716:52]
[2025-10-13T14:48:50.208Z] [WARN] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] error on posting to topic invoker0 [marker:controller_kafka_error:61716:60069]
[2025-10-13T14:48:50.209Z] [WARN] unhandled event Failure(org.apache.kafka.common.errors.TimeoutException: Topic invoker0 not present in metadata after 60000 ms.) in state Unhealthy
[2025-10-13T14:59:29.834Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:59:30.338Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:59:31.969Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:59:50.604Z] [ERROR] [#tid_gziDmjzOIPPec3BLkvmb4NKZFauQHYiz] [ShardingContainerPoolBalancer] failed to schedule activation 40e6f41c137042efa6f41c137052efde, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T14:59:50.605Z] [WARN] [#tid_gziDmjzOIPPec3BLkvmb4NKZFauQHYiz] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:178:69]
[2025-10-13T14:59:50.605Z] [WARN] [#tid_gziDmjzOIPPec3BLkvmb4NKZFauQHYiz] [ActionsApi] No invokers available [marker:controller_activation_error:178:69]
[2025-10-13T14:59:50.605Z] [ERROR] [#tid_gziDmjzOIPPec3BLkvmb4NKZFauQHYiz] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T15:16:20.236Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T15:16:20.642Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T15:16:22.380Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T15:16:40.829Z] [ERROR] [#tid_k6VrzBdL602daEtkyZqOxtrjk84XMBD3] [ShardingContainerPoolBalancer] failed to schedule activation 5f2d2d21d55749d2ad2d21d55779d2a6, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T15:16:40.829Z] [WARN] [#tid_k6VrzBdL602daEtkyZqOxtrjk84XMBD3] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:205:83]
[2025-10-13T15:16:40.829Z] [WARN] [#tid_k6VrzBdL602daEtkyZqOxtrjk84XMBD3] [ActionsApi] No invokers available [marker:controller_activation_error:205:83]
[2025-10-13T15:16:40.830Z] [ERROR] [#tid_k6VrzBdL602daEtkyZqOxtrjk84XMBD3] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T16:03:10.646Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T16:03:11.046Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T16:03:12.867Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T16:03:30.268Z] [ERROR] [#tid_apyUwJFY3qBmV68pSBZgAjuZINrmx8Dg] [ShardingContainerPoolBalancer] failed to schedule activation e59483f139144a559483f139144a555b, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T16:03:30.269Z] [WARN] [#tid_apyUwJFY3qBmV68pSBZgAjuZINrmx8Dg] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:203:69]
[2025-10-13T16:03:30.269Z] [WARN] [#tid_apyUwJFY3qBmV68pSBZgAjuZINrmx8Dg] [ActionsApi] No invokers available [marker:controller_activation_error:203:69]
[2025-10-13T16:03:30.269Z] [ERROR] [#tid_apyUwJFY3qBmV68pSBZgAjuZINrmx8Dg] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T16:08:31.007Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T16:08:31.415Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T16:08:33.243Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T16:08:50.952Z] [ERROR] [#tid_Lsak05H6yGift4jzypAFWOUMLQGj7jAf] [ShardingContainerPoolBalancer] failed to schedule activation ec2af18c06514e41aaf18c06516e41a0, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T16:08:50.953Z] [WARN] [#tid_Lsak05H6yGift4jzypAFWOUMLQGj7jAf] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:192:78]
[2025-10-13T16:08:50.953Z] [WARN] [#tid_Lsak05H6yGift4jzypAFWOUMLQGj7jAf] [ActionsApi] No invokers available [marker:controller_activation_error:192:78]
[2025-10-13T16:08:50.953Z] [ERROR] [#tid_Lsak05H6yGift4jzypAFWOUMLQGj7jAf] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-14T02:41:52.656Z] [ERROR] [#tid_sid_unknown] [KafkaConsumerConnector] org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired before successfully committing offsets {cacheInvalidation-0=OffsetAndMetadata{offset=0, leaderEpoch=null, metadata=''}}: retrying 3 more times
[2025-10-14T02:41:52.904Z] [ERROR] [#tid_sid_unknown] [KafkaConsumerConnector] org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired before successfully committing offsets {health-0=OffsetAndMetadata{offset=37186, leaderEpoch=0, metadata=''}}: retrying 3 more times
[2025-10-14T02:41:53.000Z] [ERROR] [#tid_sid_unknown] [KafkaConsumerConnector] org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired before successfully committing offsets {completed0-0=OffsetAndMetadata{offset=6, leaderEpoch=0, metadata=''}}: retrying 3 more times
[2025-10-14T02:42:22.905Z] [INFO] [#tid_sid_unknown] [KafkaConsumerConnector] lag metric reporting failed for topic 'health': org.apache.kafka.common.errors.TimeoutException: Failed to get offsets by times in 30000ms
[2025-10-14T02:42:22.999Z] [INFO] [#tid_sid_unknown] [KafkaConsumerConnector] lag metric reporting failed for topic 'completed0': org.apache.kafka.common.errors.TimeoutException: Failed to get offsets by times in 30000ms
[2025-10-14T02:56:46.717Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T02:56:46.814Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T02:56:47.430Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T02:57:08.733Z] [ERROR] [#tid_cTsHt0n3iq7ZZGe8qHe3FE6Ihd771TNn] [ShardingContainerPoolBalancer] failed to schedule activation dbb1bdb7cc3d4aa7b1bdb7cc3d8aa74f, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map(Unhealthy -> 1)
[2025-10-14T02:57:08.734Z] [WARN] [#tid_cTsHt0n3iq7ZZGe8qHe3FE6Ihd771TNn] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:212:67]
[2025-10-14T02:57:08.734Z] [WARN] [#tid_cTsHt0n3iq7ZZGe8qHe3FE6Ihd771TNn] [ActionsApi] No invokers available [marker:controller_activation_error:212:67]
[2025-10-14T02:57:08.734Z] [ERROR] [#tid_cTsHt0n3iq7ZZGe8qHe3FE6Ihd771TNn] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-14T03:00:17.008Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T03:00:20.357Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T03:00:20.757Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T03:00:36.199Z] [ERROR] [#tid_AuJDmHZ4EFSNkmsDFsojXEpckTvBLJYM] [ShardingContainerPoolBalancer] failed to schedule activation 5d1428217a634d709428217a632d7047, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-14T03:00:36.200Z] [WARN] [#tid_AuJDmHZ4EFSNkmsDFsojXEpckTvBLJYM] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:205:86]
[2025-10-14T03:00:36.200Z] [WARN] [#tid_AuJDmHZ4EFSNkmsDFsojXEpckTvBLJYM] [ActionsApi] No invokers available [marker:controller_activation_error:205:86]
[2025-10-14T03:00:36.200Z] [ERROR] [#tid_AuJDmHZ4EFSNkmsDFsojXEpckTvBLJYM] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-14T03:39:38.981Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T03:39:40.824Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T03:39:41.127Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T03:40:02.138Z] [ERROR] [#tid_amZBrip4bOoGFAiNSuXsCQoz345z3wNi] [ShardingContainerPoolBalancer] failed to schedule activation ab774711269e4415b74711269ed415a8, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map(Unhealthy -> 1)
[2025-10-14T03:40:02.138Z] [WARN] [#tid_amZBrip4bOoGFAiNSuXsCQoz345z3wNi] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:215:63]
[2025-10-14T03:40:02.139Z] [WARN] [#tid_amZBrip4bOoGFAiNSuXsCQoz345z3wNi] [ActionsApi] No invokers available [marker:controller_activation_error:215:64]
[2025-10-14T03:40:02.139Z] [ERROR] [#tid_amZBrip4bOoGFAiNSuXsCQoz345z3wNi] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-14T03:40:54.035Z] [ERROR] [#tid_sid_invokerHealth] [KafkaProducerConnector] sending message on topic 'invoker0' failed: Topic invoker0 not present in metadata after 60000 ms.
[2025-10-14T03:40:54.049Z] [ERROR] [#tid_sid_invokerHealth] [KafkaProducerConnector] sending message on topic 'invoker0' failed: Cannot perform operation after producer has been closed
[2025-10-14T03:40:54.112Z] [WARN] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] error on posting to topic invoker0 [marker:controller_kafka_error:61719:63]
[2025-10-14T03:40:54.113Z] [WARN] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] error on posting to topic invoker0 [marker:controller_kafka_error:61721:60080]
[2025-10-14T03:40:54.113Z] [WARN] unhandled event Failure(org.apache.kafka.common.errors.TimeoutException: Topic invoker0 not present in metadata after 60000 ms.) in state Unhealthy
[2025-10-15T03:00:42.155Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T03:00:42.658Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T03:00:42.759Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T03:01:02.873Z] [ERROR] [#tid_I10PxYArc69pZMc7ObLKHmLoiWnzkUDQ] [ShardingContainerPoolBalancer] failed to schedule activation 4cd5d972e77d4f0b95d972e77d7f0bd8, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-15T03:01:02.873Z] [WARN] [#tid_I10PxYArc69pZMc7ObLKHmLoiWnzkUDQ] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:175:74]
[2025-10-15T03:01:02.873Z] [WARN] [#tid_I10PxYArc69pZMc7ObLKHmLoiWnzkUDQ] [ActionsApi] No invokers available [marker:controller_activation_error:175:74]
[2025-10-15T03:01:02.874Z] [ERROR] [#tid_I10PxYArc69pZMc7ObLKHmLoiWnzkUDQ] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-15T14:04:00.484Z] [ERROR] [#tid_y2HCC8CR5pMRIBvCOU4mGDdeuXnW1M6s] [ShardingContainerPoolBalancer] failed to schedule activation 677d63634a364e63bd63634a363e63a9, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-15T14:04:00.485Z] [WARN] [#tid_y2HCC8CR5pMRIBvCOU4mGDdeuXnW1M6s] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:214:80]
[2025-10-15T14:04:00.485Z] [WARN] [#tid_y2HCC8CR5pMRIBvCOU4mGDdeuXnW1M6s] [ActionsApi] No invokers available [marker:controller_activation_error:215:81]
[2025-10-15T14:04:00.485Z] [ERROR] [#tid_y2HCC8CR5pMRIBvCOU4mGDdeuXnW1M6s] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-15T14:08:22.459Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T14:08:22.459Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T14:08:22.662Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T14:08:40.359Z] [ERROR] [#tid_hQF6mZnlZ22X0yRV8QaMuIvVBlF8zCVJ] [ShardingContainerPoolBalancer] failed to schedule activation ef2be4b1891742ababe4b1891712ab48, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-15T14:08:40.359Z] [WARN] [#tid_hQF6mZnlZ22X0yRV8QaMuIvVBlF8zCVJ] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:201:66]
[2025-10-15T14:08:40.359Z] [WARN] [#tid_hQF6mZnlZ22X0yRV8QaMuIvVBlF8zCVJ] [ActionsApi] No invokers available [marker:controller_activation_error:201:66]
[2025-10-15T14:08:40.360Z] [ERROR] [#tid_hQF6mZnlZ22X0yRV8QaMuIvVBlF8zCVJ] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-15T14:40:42.855Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T14:40:42.856Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T14:40:43.059Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T14:41:03.892Z] [ERROR] [#tid_xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ] [ShardingContainerPoolBalancer] failed to schedule activation 392a6e72795a4d7faa6e72795a4d7f9e, action 'whisk.system/[email protected]' (managed), ns 'whisk.system' - invokers to use: Map(Unhealthy -> 1)
[2025-10-15T14:41:03.893Z] [WARN] [#tid_xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:190:62]
[2025-10-15T14:41:03.893Z] [WARN] [#tid_xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ] [ActionsApi] No invokers available [marker:controller_activation_error:190:62]
[2025-10-15T14:41:03.893Z] [ERROR] [#tid_xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ] [ActionsApi] [POST] failed in loadbalancer: No invokers available
bash-5.1#
执行过程中的报错:
PLAY [controllers] ***********************************************************************************************************************************
TASK [Gathering Facts] *******************************************************************************************************************************
星期三 15 十月 2025 22:40:47 +0800 (0:00:00.037) 0:00:47.268 ****************
ok: [controller0]
TASK [controller : docker login] *********************************************************************************************************************
星期三 15 十月 2025 22:40:47 +0800 (0:00:00.784) 0:00:48.052 ****************
skipping: [controller0]
TASK [controller : get controller name and index] ****************************************************************************************************
星期三 15 十月 2025 22:40:48 +0800 (0:00:00.013) 0:00:48.065 ****************
ok: [controller0]
TASK [controller : pull the latest image of controller] **********************************************************************************************
星期三 15 十月 2025 22:40:48 +0800 (0:00:00.018) 0:00:48.084 ****************
skipping: [controller0]
TASK [controller : ensure controller log directory is created with permissions] **********************************************************************
星期三 15 十月 2025 22:40:48 +0800 (0:00:00.010) 0:00:48.095 ****************
ok: [controller0]
TASK [controller : ensure controller log file is created with permissions] ***************************************************************************
星期三 15 十月 2025 22:40:48 +0800 (0:00:00.105) 0:00:48.200 ****************
skipping: [controller0]
TASK [controller : ensure controller config directory is created with permissions] *******************************************************************
星期三 15 十月 2025 22:40:48 +0800 (0:00:00.019) 0:00:48.219 ****************
ok: [controller0]
TASK [controller : copy jmxremote password file] *****************************************************************************************************
星期三 15 十月 2025 22:40:48 +0800 (0:00:00.171) 0:00:48.391 ****************
changed: [controller0]
TASK [controller : copy jmxremote access file] *******************************************************************************************************
星期三 15 十月 2025 22:40:48 +0800 (0:00:00.295) 0:00:48.687 ****************
changed: [controller0]
TASK [controller : copy kafka truststore/keystore] ***************************************************************************************************
星期三 15 十月 2025 22:40:48 +0800 (0:00:00.189) 0:00:48.876 ****************
skipping: [controller0]
TASK [controller : copy nginx certificate keystore] **************************************************************************************************
星期三 15 十月 2025 22:40:48 +0800 (0:00:00.014) 0:00:48.890 ****************
changed: [controller0]
TASK [controller : copy certificates] ****************************************************************************************************************
星期三 15 十月 2025 22:40:49 +0800 (0:00:00.337) 0:00:49.227 ****************
changed: [controller0] => (item=controller-openwhisk-server-cert.pem)
changed: [controller0] => (item=controller-openwhisk-server-key.pem)
TASK [controller : check, that required databases exist] *********************************************************************************************
星期三 15 十月 2025 22:40:49 +0800 (0:00:00.637) 0:00:49.865 ****************
included: /home/djc/Desktop/InstaInfer-SoCC24/ansible/tasks/db/checkDb.yml for controller0 => (item=whisk_local_whisks)
included: /home/djc/Desktop/InstaInfer-SoCC24/ansible/tasks/db/checkDb.yml for controller0 => (item=whisk_local_subjects)
included: /home/djc/Desktop/InstaInfer-SoCC24/ansible/tasks/db/checkDb.yml for controller0 => (item=whisk_local_activations)
TASK [controller : check if whisk_local_whisks with CouchDB exists] **********************************************************************************
星期三 15 十月 2025 22:40:49 +0800 (0:00:00.112) 0:00:49.977 ****************
[WARNING]: Module did not set no_log for password
ok: [controller0]
TASK [controller : check if whisk_local_subjects with CouchDB exists] ********************************************************************************
星期三 15 十月 2025 22:40:50 +0800 (0:00:00.279) 0:00:50.257 ****************
ok: [controller0]
TASK [controller : check if whisk_local_activations with CouchDB exists] *****************************************************************************
星期三 15 十月 2025 22:40:50 +0800 (0:00:00.272) 0:00:50.529 ****************
ok: [controller0]
TASK [controller : prepare controller port] **********************************************************************************************************
星期三 15 十月 2025 22:40:50 +0800 (0:00:00.261) 0:00:50.791 ****************
ok: [controller0]
TASK [controller : expose additional ports if jmxremote is enabled] **********************************************************************************
星期三 15 十月 2025 22:40:50 +0800 (0:00:00.057) 0:00:50.848 ****************
ok: [controller0]
TASK [controller : Load config from template] ********************************************************************************************************
星期三 15 十月 2025 22:40:50 +0800 (0:00:00.040) 0:00:50.889 ****************
ok: [controller0]
TASK [controller : populate environment variables for controller] ************************************************************************************
星期三 15 十月 2025 22:40:50 +0800 (0:00:00.021) 0:00:50.911 ****************
ok: [controller0]
TASK [controller : merge extra env variables] ********************************************************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.580) 0:00:51.491 ****************
ok: [controller0]
TASK [controller : setup elasticsearch activation store env] *****************************************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.034) 0:00:51.526 ****************
skipping: [controller0]
TASK [controller : merge elasticsearch activation store env] *****************************************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.032) 0:00:51.558 ****************
skipping: [controller0]
TASK [controller : setup mongodb artifact store env] *************************************************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.031) 0:00:51.589 ****************
skipping: [controller0]
TASK [controller : merge mongodb artifact store env] *************************************************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.032) 0:00:51.622 ****************
skipping: [controller0]
TASK [controller : setup scheduler env] **************************************************************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.032) 0:00:51.654 ****************
ok: [controller0]
TASK [controller : merge scheduler env] **************************************************************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.066) 0:00:51.720 ****************
ok: [controller0]
TASK [controller : populate volumes for controller] **************************************************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.019) 0:00:51.740 ****************
ok: [controller0]
TASK [controller : check if coverage collection is enabled] ******************************************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.037) 0:00:51.778 ****************
skipping: [controller0]
TASK [controller : ensure controller coverage directory is created with permissions] *****************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.012) 0:00:51.790 ****************
skipping: [controller0] => (item=controller)
skipping: [controller0] => (item=common)
TASK [controller : extend controller volume for coverage] ********************************************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.020) 0:00:51.811 ****************
skipping: [controller0]
TASK [controller : include plugins] ******************************************************************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.017) 0:00:51.828 ****************
included: /home/djc/Desktop/InstaInfer-SoCC24/ansible/roles/controller/tasks/join_akka_cluster.yml for controller0 => (item=join_akka_cluster)
TASK [controller : add akka port to ports_to_expose] *************************************************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.026) 0:00:51.854 ****************
ok: [controller0]
TASK [controller : add seed nodes to controller environment] *****************************************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.033) 0:00:51.888 ****************
ok: [controller0] => (item=[0, '172.17.0.1'])
TASK [controller : Add akka environment to controller environment] ***********************************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.057) 0:00:51.945 ****************
ok: [controller0]
TASK [controller : lean controller setup] ************************************************************************************************************
星期三 15 十月 2025 22:40:51 +0800 (0:00:00.105) 0:00:52.051 ****************
skipping: [controller0]
TASK [controller : remove the controller from nginx's upstream configuration] ************************************************************************
星期三 15 十月 2025 22:40:52 +0800 (0:00:00.016) 0:00:52.068 ****************
skipping: [controller0] => (item=172.17.0.1)
TASK [controller : wait some time for controllers fire all existing triggers] ************************************************************************
星期三 15 十月 2025 22:40:52 +0800 (0:00:00.012) 0:00:52.081 ****************
skipping: [controller0]
TASK [controller : wait until controller0 executes all existing activations] *************************************************************************
星期三 15 十月 2025 22:40:52 +0800 (0:00:00.012) 0:00:52.093 ****************
skipping: [controller0]
TASK [controller : Disable controller0 before remove controller] *************************************************************************************
星期三 15 十月 2025 22:40:52 +0800 (0:00:00.012) 0:00:52.105 ****************
skipping: [controller0]
TASK [controller : wait some time for controller to gracefully shutdown the consumer for activation ack] *********************************************
星期三 15 十月 2025 22:40:52 +0800 (0:00:00.011) 0:00:52.117 ****************
skipping: [controller0]
TASK [controller : (re)start controller] *************************************************************************************************************
星期三 15 十月 2025 22:40:52 +0800 (0:00:00.014) 0:00:52.131 ****************
changed: [controller0]
TASK [controller : wait until the Controller in this host is up and running] *************************************************************************
星期三 15 十月 2025 22:40:52 +0800 (0:00:00.874) 0:00:53.005 ****************
FAILED - RETRYING: wait until the Controller in this host is up and running (12 retries left).
ok: [controller0]
TASK [controller : warm up activation path] **********************************************************************************************************
星期三 15 十月 2025 22:41:03 +0800 (0:00:10.517) 0:01:03.523 ****************
fatal: [controller0]: FAILED! => {"access_control_allow_headers": "Authorization, Origin, X-Requested-With, Content-Type, Accept, User-Agent", "access_control_allow_methods": "GET, DELETE, POST, PUT, HEAD", "access_control_allow_origin": "*", "changed": false, "connection": "close", "content_length": "141", "content_type": "application/json", "date": "Wed, 15 Oct 2025 14:41:03 GMT", "elapsed": 0, "json": {"code": "xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ", "error": "The server is currently unavailable (because it is overloaded or down for maintenance)."}, "msg": "Status code was 503 and not [200]: HTTP Error 503: Service Unavailable", "redirected": false, "server": "akka-http/10.2.4", "status": 503, "url": "https://789c46b1-71f6-4ed5-8c54-816aa4f8c502:abczO3xZCLrMN6v2BKK1dXYFpXlPkccOFqm12CdAsMgRU4VrNZ9lyGVCGuMDGIwP@172.17.0.1:10001/api/v1/namespaces/_/actions/invokerHealthTestAction0?blocking=false&result=false", "x_request_id": "xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ"}
...ignoring
Status code was 503 and not [200]: HTTP Error 503: Service Unavailable
TASK [controller : wait for all invokers in controller0 to become up] ********************************************************************************
星期三 15 十月 2025 22:41:03 +0800 (0:00:00.449) 0:01:03.973 ****************
skipping: [controller0]
TASK [controller : Add the controller back to nginx's upstream configuration when there exist at least one healthy invoker] **************************
星期三 15 十月 2025 22:41:03 +0800 (0:00:00.021) 0:01:03.994 ****************
skipping: [controller0] => (item=172.17.0.1)
TASK [controller : get controller name] **************************************************************************************************************
星期三 15 十月 2025 22:41:03 +0800 (0:00:00.017) 0:01:04.011 ****************
skipping: [controller0]
TASK [controller : remove controller] ****************************************************************************************************************
星期三 15 十月 2025 22:41:03 +0800 (0:00:00.015) 0:01:04.027 ****************
skipping: [controller0]
TASK [controller : remove controller log directory] **************************************************************************************************
星期三 15 十月 2025 22:41:03 +0800 (0:00:00.011) 0:01:04.039 ****************
skipping: [controller0]
TASK [controller : remove controller conf directory] *************************************************************************************************
星期三 15 十月 2025 22:41:03 +0800 (0:00:00.011) 0:01:04.050 ****************
skipping: [controller0]