stevenjdh/aws-cwl-exporter repository overview

⁠AWS CloudWatch Log Exporter

AWS CloudWatch Log Exporter is a productivity tool that makes it easy to schedule automated log exports to an AWS S3 Bucket. Currently in AWS, exporting logs is a manual task that is done using tools like Log Insights and the AWS CLI. None of these options provide a way to export logs to an S3 Bucket where additional features like storage classes, lifecycle policies, and legal holds can be leveraged. As a result, those desiring some form of automation will create a custom solution using something like a Lambda function to achieve this, but there are many approaches available that are written in different programming languages, and not everyone is a programmer. AWS CloudWatch Log Exporter is built ready to go, and can be quickly deployed as a CronJob or Scheduled Task to any cluster, or as a container directly.

⁠Features

• Export CloudWatch logs on an hourly or daily basis to an S3 Bucket.
• Automatic calculation of the needed time period being exported.
• Enable access by leveraging the AWS Credential Provider Chain. IRSA (IAM Roles for Service Accounts) is recommended.
• Can be deployed to EKS, ECS, and other managed and self-managed clusters.

⁠Usage

Please visit AWS CloudWatch Log Exporter's project⁠ page for the most up to date documentation.