lambda-google-cloud-logging

This is lambda-google-cloud-logging, a Lambda function to forward logs from CloudWatch to Google Cloud Logging. It is built with the Serverless Framework, and is a perfect companion to the serverless-log-forwarding plugin.

Getting Started

Install Node 12.x, Docker, and the AWS CLI. Then clone this repository & install dependencies:

# Install dependencies
npm install

# Run local tests:
npm test

Next, configure serverless-dev (for dev & QA stages) and serverless-production IAM roles:

$ aws configure --profile serverless-dev
AWS Access Key ID [None]: **************
AWS Secret Access Key [None]: **************
Default region name [None]: us-east-1
Default output format [None]: text

$ aws configure --profile serverless-production
AWS Access Key ID [None]: **************
AWS Secret Access Key [None]: **************
Default region name [None]: us-east-1
Default output format [None]: text

Finally, run either npm run deploy:dev, npm run deploy:qa, or npm run deploy:prod to deploy!

Usage

You can now easily forward logs from any other Serverless application with serverless-log-forwarding.

plugins:
  - serverless-log-forwarding

custom:
  logForwarding:
    destinationARN: ${cf:lambda-google-cloud-logging-${opt:stage}.ForwarderLambdaArn}

You can also manually attach a log group by clicking Actions → Stream to AWS Lambda from the CloudWatch Log Groups dashboard. Then just choose the appropriate destination Lambda function (e.g. lambda-google-cloud-logging-prod-forwarder) and configure a filter (or "Other" to forward all log messages).

Configuration

Before deploying, you'll need to set up the following AWS Systems Manager (SSM) parameters:

• /prod/google-cloud-project-id: Your Google Cloud Project ID
• /prod/google-cloud-log-name: The name of the log in Google Cloud Logging (optional, defaults to 'cloudwatch-forwarded-logs')
• /prod/google-application-credentials: Path to your Google Cloud service account key file or JSON content

Google Cloud Setup

1. Create a Google Cloud project or use an existing one
2. Enable the Cloud Logging API
3. Create a service account with the "Logging Writer" role
4. Download the service account key file
5. Store the key file path or JSON content in SSM parameter /prod/google-application-credentials

License

© DoSomething.org. lambda-google-cloud-logging is free software, and may be redistributed under the terms specified in the LICENSE file. The name and logo for DoSomething.org are trademarks of Do Something, Inc and may not be used without permission.