Allow changing default loglevel for ScyllaDB

[mflendrich]

Issue originally authored by tnozicka as #2011

As a user I'd like to change the default loglevel for all ScyllaDB components using --default-log-level flag in spec.scyllaArgs.

While we allow adding extra flags with spec.scyllaArgs, when configured with scyllaArgs: "--default-log-level=trace" the ScyllaDB startup scripts fail because they have hard wired the flag with info level and it can be defined only once

Scylla version 6.0.1-0.20240612.bc89aac9d017 with build-id e845b7c6530ae1385e7bb3b7def09b4ffdf191c2 starting ...
command used: "/usr/bin/scylla --log-to-syslog 0 --log-to-stdout 1 --default-log-level info --network-stack posix --developer-mode=1 --smp 1 --overprovisioned --listen-address 0.0.0.0 --rpc-address 0.0.0.0 --seed-provider-parameters seeds=10.85.5.102 --broadcast-address 10.85.5.102 --broadcast-rpc-address 10.85.5.102 --alternator-address 0.0.0.0 --blocked-reactor-notify-ms 999999999 --default-log-level=trace --prometheus-address=0.0.0.0"
pid: 58
parsed command line options: [log-to-syslog, (positional) 0, log-to-stdout, (positional) 1, default-log-level, (positional) info, network-stack, (positional) posix, developer-mode: 1, smp, (positional) 1, overprovisioned, listen-address: 0.0.0.0, rpc-address: 0.0.0.0, seed-provider-parameters: seeds=10.85.5.102, broadcast-address: 10.85.5.102, broadcast-rpc-address: 10.85.5.102, alternator-address: 0.0.0.0, blocked-reactor-notify-ms, (positional) 999999999, default-log-level: trace, prometheus-address: 0.0.0.0]
error: option '--default-log-level' cannot be specified more than once

Try --help.

[mflendrich]

Closing as duplicate. We should think about logging from the user's perspective holistically, including both individual clusters and the operator machinery - will clarify this distinction and track as one issue.

[rzetelskik]

Closing as duplicate. We should think about logging from the user's perspective holistically, including both individual clusters and the operator machinery - will clarify this distinction and track as one issue.

But this issue is a tracker for making changing the default database loglevel possible? Seems like a separate issue to me, as it's not even on us to fix this.

[mflendrich]

Looking at the two problem statements taken verbatim from the two issues:

I'd like to change the default loglevel for all ScyllaDB components using --default-log-level flag in spec.scyllaArgs

Loglevel of particular components should be configurable through ScyllaOperatorConfig.

there's either overlap between the two (that I'm trying to untangle), or some implicit context that makes them different.