Skip to content

[Bug]: Send sidecar logs to aws-fluent-bit also #6009

Open
@proof-nicholas

Description

@proof-nicholas

Description:

I have defined the aws-fluent-bit logging for my service and the logs for the main container are published to my configured log destination as expected but it appears that any sidecars defined in the service are not sent to aws-fluent-bit but instead are sent to the default awslogs driver. How can I ensure all my containers or at least configure a subset of my sidecards to use the aws-fluent-bit logging?

Details:

Example:

name: api
type: "Load Balanced Web Service"

logging:
  image: aws-fluent-bit
  destination:
    Name: "datadog"
    Host: "http-intake.logs.datadoghq.com"
    compress: "gzip"
    dd_service: "api"
    dd_source: "api"
    dd_tags: "env:${COPILOT_ENVIRONMENT_NAME}"
    TLS: "on"
    provider: "ecs"
  secretOptions:
    apiKey: XXXXXX
  configFilePath: "/fluent-bit/configs/parse-json.conf"

sidecars:
  datadog-agent:
    image:
      location: public.ecr.aws/datadog/agent:latest
    secrets:
      DD_API_KEY: XXXXXX
    variables:
      ECS_FARGATE: true
      DD_PROCESS_AGENT_PROCESS_COLLECTION_ENABLED: true
      DD_DOGSTATSD_NON_LOCAL_TRAFFIC: true
  mysidecar:
    port: 23853
    image:
      location: XXXXXXX

image:
  location: XXXXX/api
  port: 8080
  depends_on:
    mysidecar: healthy

Observed result:

Logs for only the main api container are available in Datadog. All other logs are sent to CloudWatch.

Expected result:

Logs for mysidecar container are also available in Datadog.

Debugging:

Metadata

Metadata

Assignees

No one assigned

    Labels

    type/bugIssues that are bugs.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions