Skip to content

[BUG] Following Quick Start results in a kubectl unhandled error and connections refused errors #1587

Open
@xFichtl1

Description

@xFichtl1

What did you do

I followed the Quick Start https://k3d.io/stable/#quick-start

  • How was the cluster created?

    • k3d cluster create --trace --no-rollback mycluster
    • k3d kubeconfig merge mycluster --kubeconfig-switch-context
  • What did you do afterwards?

    • kubectl cluster-info

What did you expect to happen

A successful output of kubectl cluster info

Screenshots or terminal output

Output of kubectl cluster-info

fichtl@chaos ~> kubectl cluster-info
E0620 19:47:39.061380   29857 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://0.0.0.0:32825/api?timeout=32s\": EOF"
E0620 19:47:49.069766   29857 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://0.0.0.0:32825/api?timeout=32s\": EOF"
E0620 19:47:59.080248   29857 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://0.0.0.0:32825/api?timeout=32s\": EOF"
E0620 19:48:09.090305   29857 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://0.0.0.0:32825/api?timeout=32s\": EOF"
E0620 19:48:19.099637   29857 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://0.0.0.0:32825/api?timeout=32s\": EOF"

To further debug and diagnose cluster problems, use 'kubectl cluster-info dump'.
Unable to connect to the server: EOF

Output of docker logs k3d-mycluster-serverlb:

[2025-06-20T17:42:13+00:00] creating initial nginx config (try 1/3)
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: INFO Backend set to file
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: INFO Starting confd
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: INFO Backend source(s) set to /etc/confd/values.yaml
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: DEBUG Loading template resources from confdir /etc/confd
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: DEBUG Found template: /etc/confd/conf.d/nginx.toml
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: DEBUG Loading template resource from /etc/confd/conf.d/nginx.toml
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: DEBUG Retrieving keys from store
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: DEBUG Key prefix set to /
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: DEBUG Key Map: map[string]string{"/ports/6443.tcp/0":"k3d-mycluster-server-0", "/settings/workerConnections":"1024"}
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: DEBUG Got the following map from store: map[/ports/6443.tcp/0:k3d-mycluster-server-0 /settings/workerConnections:1024]
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: DEBUG Using source template /etc/confd/templates/nginx.tmpl
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: DEBUG Compiling source template /etc/confd/templates/nginx.tmpl
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: DEBUG Comparing candidate config to /etc/nginx/nginx.conf
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: INFO /etc/nginx/nginx.conf has md5sum 756e7eaae19e95b5f49ce81e73b10512 should be e0926635391f27272a7aad2b4b5caccb
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: INFO Target config /etc/nginx/nginx.conf out of sync
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: DEBUG Overwriting target config /etc/nginx/nginx.conf
2025-06-20T17:42:13Z k3d-mycluster-serverlb confd[10]: INFO Target config /etc/nginx/nginx.conf has been updated
[2025-06-20T17:42:15+00:00] creating initial nginx config (try 2/3)
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: INFO Backend set to file
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: INFO Starting confd
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: INFO Backend source(s) set to /etc/confd/values.yaml
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: DEBUG Loading template resources from confdir /etc/confd
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: DEBUG Found template: /etc/confd/conf.d/nginx.toml
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: DEBUG Loading template resource from /etc/confd/conf.d/nginx.toml
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: DEBUG Retrieving keys from store
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: DEBUG Key prefix set to /
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: DEBUG Key Map: map[string]string{"/ports/6443.tcp/0":"k3d-mycluster-server-0", "/settings/workerConnections":"1024"}
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: DEBUG Got the following map from store: map[/ports/6443.tcp/0:k3d-mycluster-server-0 /settings/workerConnections:1024]
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: DEBUG Using source template /etc/confd/templates/nginx.tmpl
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: DEBUG Compiling source template /etc/confd/templates/nginx.tmpl
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: DEBUG Comparing candidate config to /etc/nginx/nginx.conf
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: INFO /etc/nginx/nginx.conf has md5sum e0926635391f27272a7aad2b4b5caccb should be 7fde4e65881230aee17ee7ed61d8ae4f
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: INFO Target config /etc/nginx/nginx.conf out of sync
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: DEBUG Overwriting target config /etc/nginx/nginx.conf
2025-06-20T17:42:15Z k3d-mycluster-serverlb confd[17]: INFO Target config /etc/nginx/nginx.conf has been updated
[2025-06-20T17:42:17+00:00] creating initial nginx config (try 3/3)
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: INFO Backend set to file
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: INFO Starting confd
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: INFO Backend source(s) set to /etc/confd/values.yaml
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: DEBUG Loading template resources from confdir /etc/confd
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: DEBUG Found template: /etc/confd/conf.d/nginx.toml
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: DEBUG Loading template resource from /etc/confd/conf.d/nginx.toml
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: DEBUG Retrieving keys from store
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: DEBUG Key prefix set to /
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: DEBUG Key Map: map[string]string{"/ports/6443.tcp/0":"k3d-mycluster-server-0", "/settings/workerConnections":"1024"}
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: DEBUG Got the following map from store: map[/ports/6443.tcp/0:k3d-mycluster-server-0 /settings/workerConnections:1024]
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: DEBUG Using source template /etc/confd/templates/nginx.tmpl
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: DEBUG Compiling source template /etc/confd/templates/nginx.tmpl
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: DEBUG Comparing candidate config to /etc/nginx/nginx.conf
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: INFO /etc/nginx/nginx.conf has md5sum 7fde4e65881230aee17ee7ed61d8ae4f should be 1d0e938e1371a679008dd7cb95d7092a
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: INFO Target config /etc/nginx/nginx.conf out of sync
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: DEBUG Overwriting target config /etc/nginx/nginx.conf
2025-06-20T17:42:17Z k3d-mycluster-serverlb confd[24]: INFO Target config /etc/nginx/nginx.conf has been updated
===== Initial nginx configuration =====
nginx: the configuration file /etc/nginx/nginx.conf syntax is ok
# configuration file /etc/nginx/nginx.conf:
###################################
# Generated by confd 2025-06-20 17:42:17.64492987 +0000 UTC m=+0.002222541 #
#             #######             #
#             # k3d #             #
#             #######             #
###################################

error_log stderr notice;

worker_processes auto;
events {
  multi_accept on;
  use epoll;
  worker_connections 1024;
}

stream {

  upstream 6443_tcp {
    server k3d-mycluster-server-0:6443 max_fails=1 fail_timeout=10s;
nginx: configuration file /etc/nginx/nginx.conf test is successful
  }

  server {
    listen        6443;
    proxy_pass    6443_tcp;
    proxy_timeout 600;
    proxy_connect_timeout 2s;
  }

}

=======================================
2025/06/20 17:42:19 [notice] 32#32: using the "epoll" event method
2025/06/20 17:42:19 [notice] 32#32: nginx/1.27.0
2025/06/20 17:42:19 [notice] 32#32: built by gcc 13.2.1 20231014 (Alpine 13.2.1_git20231014) 
2025/06/20 17:42:19 [notice] 32#32: OS: Linux 6.12.33_1
2025/06/20 17:42:19 [notice] 32#32: getrlimit(RLIMIT_NOFILE): 4096:4096
2025/06/20 17:42:19 [notice] 32#32: start worker processes
2025/06/20 17:42:19 [notice] 32#32: start worker process 37
2025/06/20 17:42:19 [notice] 32#32: start worker process 38
2025/06/20 17:42:19 [notice] 32#32: start worker process 39
2025/06/20 17:42:19 [notice] 32#32: start worker process 40
2025/06/20 17:42:19 [notice] 32#32: start worker process 41
2025/06/20 17:42:19 [notice] 32#32: start worker process 42
2025/06/20 17:42:19 [notice] 32#32: start worker process 43
2025/06/20 17:42:19 [notice] 32#32: start worker process 44
2025/06/20 17:42:19 [notice] 32#32: start worker process 45
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: INFO Backend set to file
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: INFO Starting confd
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: INFO Backend source(s) set to /etc/confd/values.yaml
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: DEBUG Loading template resources from confdir /etc/confd
2025/06/20 17:42:19 [notice] 32#32: start worker process 48
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: DEBUG Found template: /etc/confd/conf.d/nginx.toml
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: DEBUG Loading template resource from /etc/confd/conf.d/nginx.toml
2025/06/20 17:42:19 [notice] 32#32: start worker process 50
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: DEBUG Retrieving keys from store
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: DEBUG Key prefix set to /
2025/06/20 17:42:19 [notice] 32#32: start worker process 51
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: DEBUG Key Map: map[string]string{"/ports/6443.tcp/0":"k3d-mycluster-server-0", "/settings/workerConnections":"1024"}
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: DEBUG Got the following map from store: map[/ports/6443.tcp/0:k3d-mycluster-server-0 /settings/workerConnections:1024]
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: DEBUG Using source template /etc/confd/templates/nginx.tmpl
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: DEBUG Compiling source template /etc/confd/templates/nginx.tmpl
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: DEBUG Comparing candidate config to /etc/nginx/nginx.conf
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: INFO /etc/nginx/nginx.conf has md5sum 1d0e938e1371a679008dd7cb95d7092a should be cd0c6a51c554ef055c91d2d50c11ed0c
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: INFO Target config /etc/nginx/nginx.conf out of sync
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: DEBUG Running /usr/sbin/nginx -T -c /etc/nginx/.nginx.conf965244933
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: DEBUG "nginx: the configuration file /etc/nginx/.nginx.conf965244933 syntax is ok\nnginx: configuration file /etc/nginx/.nginx.conf965244933 test is successful\n# configuration file /etc/nginx/.nginx.conf965244933:\n###################################\n# Generated by confd 2025-06-20 17:42:19.652503182 +0000 UTC m=+0.003093324 #\n#             #######             #\n#             # k3d #             #\n#             #######             #\n###################################\n\nerror_log stderr notice;\n\nworker_processes auto;\nevents {\n  multi_accept on;\n  use epoll;\n  worker_connections 1024;\n}\n\nstream {\n\n  upstream 6443_tcp {\n    server k3d-mycluster-server-0:6443 max_fails=1 fail_timeout=10s;\n  }\n\n  server {\n    listen        6443;\n    proxy_pass    6443_tcp;\n    proxy_timeout 600;\n    proxy_connect_timeout 2s;\n  }\n\n}\n\n"
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: DEBUG Overwriting target config /etc/nginx/nginx.conf
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: DEBUG Running /usr/sbin/nginx -s reload
2025/06/20 17:42:19 [notice] 32#32: signal 1 (SIGHUP) received from 53, reconfiguring
2025/06/20 17:42:19 [notice] 32#32: reconfiguring
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: DEBUG "2025/06/20 17:42:19 [notice] 53#53: signal process started\n"
2025-06-20T17:42:19Z k3d-mycluster-serverlb confd[31]: INFO Target config /etc/nginx/nginx.conf has been updated
2025/06/20 17:42:19 [notice] 32#32: using the "epoll" event method
2025/06/20 17:42:19 [notice] 32#32: start worker processes
2025/06/20 17:42:19 [notice] 32#32: start worker process 54
2025/06/20 17:42:19 [notice] 32#32: start worker process 55
2025/06/20 17:42:19 [notice] 32#32: start worker process 56
2025/06/20 17:42:19 [notice] 32#32: start worker process 57
2025/06/20 17:42:19 [notice] 32#32: start worker process 58
2025/06/20 17:42:19 [notice] 32#32: start worker process 59
2025/06/20 17:42:19 [notice] 32#32: start worker process 60
2025/06/20 17:42:19 [notice] 32#32: start worker process 61
2025/06/20 17:42:19 [notice] 32#32: start worker process 62
2025/06/20 17:42:19 [notice] 32#32: start worker process 63
2025/06/20 17:42:19 [notice] 32#32: start worker process 64
2025/06/20 17:42:19 [notice] 32#32: start worker process 65
2025/06/20 17:42:19 [notice] 40#40: gracefully shutting down
2025/06/20 17:42:19 [notice] 39#39: gracefully shutting down
2025/06/20 17:42:19 [notice] 41#41: gracefully shutting down
2025/06/20 17:42:19 [notice] 44#44: gracefully shutting down
2025/06/20 17:42:19 [notice] 38#38: gracefully shutting down
2025/06/20 17:42:19 [notice] 37#37: gracefully shutting down
2025/06/20 17:42:19 [notice] 45#45: gracefully shutting down
2025/06/20 17:42:19 [notice] 43#43: gracefully shutting down
2025/06/20 17:42:19 [notice] 42#42: gracefully shutting down
2025/06/20 17:42:19 [notice] 50#50: gracefully shutting down
2025/06/20 17:42:19 [notice] 51#51: gracefully shutting down
2025/06/20 17:42:19 [notice] 39#39: exiting
2025/06/20 17:42:19 [notice] 40#40: exiting
2025/06/20 17:42:19 [notice] 41#41: exiting
2025/06/20 17:42:19 [notice] 44#44: exiting
2025/06/20 17:42:19 [notice] 45#45: exiting
2025/06/20 17:42:19 [notice] 50#50: exiting
2025/06/20 17:42:19 [notice] 38#38: exiting
2025/06/20 17:42:19 [notice] 37#37: exiting
2025/06/20 17:42:19 [notice] 48#48: gracefully shutting down
2025/06/20 17:42:19 [notice] 51#51: exiting
2025/06/20 17:42:19 [notice] 43#43: exiting
2025/06/20 17:42:19 [notice] 42#42: exiting
2025/06/20 17:42:19 [notice] 48#48: exiting
2025/06/20 17:42:19 [notice] 41#41: exit
2025/06/20 17:42:19 [notice] 50#50: exit
2025/06/20 17:42:19 [notice] 39#39: exit
2025/06/20 17:42:19 [notice] 45#45: exit
2025/06/20 17:42:19 [notice] 44#44: exit
2025/06/20 17:42:19 [notice] 38#38: exit
2025/06/20 17:42:19 [notice] 37#37: exit
2025/06/20 17:42:19 [notice] 48#48: exit
2025/06/20 17:42:19 [notice] 51#51: exit
2025/06/20 17:42:19 [notice] 42#42: exit
2025/06/20 17:42:19 [notice] 43#43: exit
2025/06/20 17:42:19 [notice] 40#40: exit
2025/06/20 17:42:19 [notice] 32#32: signal 17 (SIGCHLD) received from 39
2025/06/20 17:42:19 [notice] 32#32: worker process 39 exited with code 0
2025/06/20 17:42:19 [notice] 32#32: signal 29 (SIGIO) received
2025/06/20 17:42:19 [notice] 32#32: signal 17 (SIGCHLD) received from 45
2025/06/20 17:42:19 [notice] 32#32: worker process 45 exited with code 0
2025/06/20 17:42:19 [notice] 32#32: signal 29 (SIGIO) received
2025/06/20 17:42:19 [notice] 32#32: signal 17 (SIGCHLD) received from 40
2025/06/20 17:42:19 [notice] 32#32: worker process 40 exited with code 0
2025/06/20 17:42:19 [notice] 32#32: signal 29 (SIGIO) received
2025/06/20 17:42:19 [notice] 32#32: signal 17 (SIGCHLD) received from 51
2025/06/20 17:42:19 [notice] 32#32: worker process 38 exited with code 0
2025/06/20 17:42:19 [notice] 32#32: worker process 41 exited with code 0
2025/06/20 17:42:19 [notice] 32#32: worker process 51 exited with code 0
2025/06/20 17:42:19 [notice] 32#32: signal 29 (SIGIO) received
2025/06/20 17:42:19 [notice] 32#32: signal 17 (SIGCHLD) received from 41
2025/06/20 17:42:19 [notice] 32#32: signal 17 (SIGCHLD) received from 37
2025/06/20 17:42:19 [notice] 32#32: worker process 37 exited with code 0
2025/06/20 17:42:19 [notice] 32#32: signal 29 (SIGIO) received
2025/06/20 17:42:19 [notice] 32#32: signal 17 (SIGCHLD) received from 48
2025/06/20 17:42:19 [notice] 32#32: worker process 48 exited with code 0
2025/06/20 17:42:19 [notice] 32#32: signal 29 (SIGIO) received
2025/06/20 17:42:19 [notice] 32#32: signal 17 (SIGCHLD) received from 50
2025/06/20 17:42:19 [notice] 32#32: worker process 50 exited with code 0
2025/06/20 17:42:19 [notice] 32#32: signal 29 (SIGIO) received
2025/06/20 17:42:19 [notice] 32#32: signal 17 (SIGCHLD) received from 44
2025/06/20 17:42:19 [notice] 32#32: worker process 44 exited with code 0
2025/06/20 17:42:19 [notice] 32#32: signal 29 (SIGIO) received
2025/06/20 17:42:19 [notice] 32#32: signal 17 (SIGCHLD) received from 43
2025/06/20 17:42:19 [notice] 32#32: worker process 43 exited with code 0
2025/06/20 17:42:19 [notice] 32#32: signal 29 (SIGIO) received
2025/06/20 17:42:19 [notice] 32#32: signal 17 (SIGCHLD) received from 42
2025/06/20 17:42:19 [notice] 32#32: worker process 42 exited with code 0
2025/06/20 17:42:19 [notice] 32#32: signal 29 (SIGIO) received
2025/06/20 17:42:38 [error] 54#54: *1 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:39 [error] 54#54: *3 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:40 [error] 54#54: *5 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:41 [error] 54#54: *7 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:42 [error] 54#54: *9 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:43 [error] 54#54: *11 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:44 [error] 54#54: *13 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:45 [error] 54#54: *15 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:46 [error] 54#54: *17 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:47 [error] 54#54: *19 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:48 [error] 54#54: *21 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:48 [error] 54#54: *23 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:49 [error] 54#54: *25 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:50 [error] 54#54: *27 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:51 [error] 54#54: *29 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:52 [error] 54#54: *31 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:53 [error] 54#54: *33 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:54 [error] 54#54: *35 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:55 [error] 54#54: *37 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:56 [error] 54#54: *39 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:57 [error] 54#54: *41 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:58 [error] 54#54: *43 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:58 [error] 54#54: *45 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:42:59 [error] 54#54: *47 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:43:16 [error] 54#54: *49 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:29 [error] 54#54: *51 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:30 [error] 54#54: *53 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:31 [error] 54#54: *55 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:32 [error] 54#54: *57 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:33 [error] 54#54: *59 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:34 [error] 54#54: *61 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:35 [error] 54#54: *63 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:36 [error] 54#54: *65 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:37 [error] 54#54: *67 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:38 [error] 54#54: *69 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:39 [error] 54#54: *71 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:39 [error] 54#54: *73 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:40 [error] 54#54: *75 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:41 [error] 54#54: *77 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:42 [error] 54#54: *79 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:43 [error] 54#54: *81 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:44 [error] 54#54: *83 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:45 [error] 54#54: *85 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:46 [error] 54#54: *87 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:47 [error] 54#54: *89 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:48 [error] 54#54: *91 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:49 [error] 54#54: *93 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:49 [error] 54#54: *95 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:50 [error] 54#54: *97 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:51 [error] 54#54: *99 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:52 [error] 54#54: *101 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:53 [error] 54#54: *103 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:54 [error] 54#54: *105 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:55 [error] 54#54: *107 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:56 [error] 54#54: *109 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:57 [error] 54#54: *111 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:58 [error] 54#54: *113 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:59 [error] 54#54: *115 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:47:59 [error] 54#54: *117 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:00 [error] 54#54: *119 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:01 [error] 54#54: *121 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:02 [error] 54#54: *123 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:03 [error] 54#54: *125 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:04 [error] 54#54: *127 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:05 [error] 54#54: *129 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:06 [error] 54#54: *131 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:07 [error] 54#54: *133 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:08 [error] 54#54: *135 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:09 [error] 54#54: *137 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:09 [error] 54#54: *139 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:10 [error] 54#54: *141 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:11 [error] 54#54: *143 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:12 [error] 54#54: *145 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:13 [error] 54#54: *147 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:14 [error] 54#54: *149 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:15 [error] 54#54: *151 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:16 [error] 54#54: *153 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:17 [error] 54#54: *155 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:18 [error] 54#54: *157 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0
2025/06/20 17:48:19 [error] 54#54: *159 connect() failed (111: Connection refused) while connecting to upstream, client: 172.24.0.1, server: 0.0.0.0:6443, upstream: "172.24.0.2:6443", bytes from/to client:0/0, bytes from/to upstream:0/0

Which OS & Architecture

  • output of k3d runtime-info
arch: x86_64
cgroupdriver: cgroupfs
cgroupversion: "2"
endpoint: /var/run/docker.sock
filesystem: btrfs
infoname: chaos
name: docker
os: Void Linux
ostype: linux
version: 28.2.2

Which version of k3d

k3d version v5.8.3
k3s version v1.21.7-k3s1 (default)

Which version of docker

Output of docker version

Client:
 Version:           28.2.2
 API version:       1.50
 Go version:        go1.24.3
 Git commit:        tag v28.2.2
 Built:             Mon Jun  2 06:53:21 2025
 OS/Arch:           linux/amd64
 Context:           default

Server:
 Engine:
  Version:          28.2.2
  API version:      1.50 (minimum version 1.24)
  Go version:       go1.24.3
  Git commit:       tag v28.2.2
  Built:            Mon Jun  2 06:53:21 2025
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          2.0.1
  GitCommit:        UNSET
 runc:
  Version:          1.2.5
  GitCommit:        
 docker-init:
  Version:          0.19.0
  GitCommit: 

Output docker info:

Client:
 Version:    28.2.2
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.24.0
    Path:     /usr/libexec/docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v2.37.1
    Path:     /usr/libexec/docker/cli-plugins/docker-compose

Server:
 Containers: 8
  Running: 3
  Paused: 0
  Stopped: 5
 Images: 161
 Server Version: 28.2.2
 Storage Driver: overlay2
  Backing Filesystem: btrfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
 CDI spec directories:
  /etc/cdi
  /var/run/cdi
 Swarm: inactive
 Runtimes: runc io.containerd.runc.v2
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: UNSET
 runc version: 
 init version: 
 Security Options:
  seccomp
   Profile: builtin
  cgroupns
 Kernel Version: 6.12.33_1
 Operating System: Void Linux
 OSType: linux
 Architecture: x86_64
 CPUs: 12
 Total Memory: 30.5GiB
 Name: chaos
 ID: db940b85-7d72-4001-8020-bdbd1c6e053b
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Experimental: false
 Insecure Registries:
  ::1/128
  127.0.0.0/8
 Live Restore Enabled: false

WARNING: No swap limit support

some things I want to say

After some time I thought if it was something with what my Linux Distributions is distributing, like an old version. But then I tested the same thing on my notebook, which has the same Linux Distro + Packages installed, and it worked flawlessy, so I really don't know anymore where to search for errors

Here is also the trace log of k3d create cluster mycluster: trace_log.txt

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions