Skip to content

Commit

Permalink
feat: add Cost and Usage Glue visual ETL job (#22)
Browse files Browse the repository at this point in the history
Add a download the Cost and Usage Glue visual ETL job definition.  There
is currently no way to manage visual ETL jobs using Terraform, but this will
give us a backup of the job definition in case we need to revert a change.

A future PR will have a nightly sync job that checks for new or modified visual ETL
jobs and creates automated PRs with the changes.
  • Loading branch information
patheard authored Nov 14, 2024
1 parent d1283a1 commit 4f97f30
Show file tree
Hide file tree
Showing 2 changed files with 1,579 additions and 2 deletions.
4 changes: 2 additions & 2 deletions terragrunt/aws/glue/crawlers.tf
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ resource "aws_glue_security_configuration" "encryption_at_rest" {
# Cost and Usage Report
#
resource "aws_glue_crawler" "operations_aws_production_cost_usage_report" {
name = "Cost and Usage Report 2.0"
name = "Operations / AWS / Cost and Usage Report"
description = "Classify the AWS Organization Cost and Usage Report data"
database_name = aws_glue_catalog_database.operations_aws_production.name
table_prefix = "cost_usage_report_"
Expand Down Expand Up @@ -52,7 +52,7 @@ resource "aws_glue_crawler" "operations_aws_production_cost_usage_report" {
# Organization Account Tags
#
resource "aws_glue_crawler" "operations_aws_production_account_tags" {
name = "Organization Account Tags"
name = "Operations / AWS / Organization / Account Tags"
description = "Classify the AWS Organization account tag extract"
database_name = aws_glue_catalog_database.operations_aws_production.name
table_prefix = "account_tags_"
Expand Down
Loading

0 comments on commit 4f97f30

Please sign in to comment.