Skip to content

Commit 79a117b

Browse files
authored
chore: add connections metadata with bigquery, pubsub and GCS simple bucket (#92)
1 parent 077f8c3 commit 79a117b

File tree

2 files changed

+22
-1
lines changed

2 files changed

+22
-1
lines changed

modules/flex/metadata.display.yaml

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -37,6 +37,11 @@ spec:
3737
container_spec_gcs_path:
3838
name: container_spec_gcs_path
3939
title: Container Spec Gcs Path
40+
enumValueLabels:
41+
- label: PUBSUB_TO_BIGQUERY_FLEX
42+
value: gs://adc-dataflow-templates/images/latest/flex/PubSub_to_BigQuery_Flex
43+
- label: PUBSUB_TO_GCS_TEXT_FLEX
44+
value: gs://adc-dataflow-templates/images/latest/flex/Cloud_PubSub_to_GCS_Text_Flex
4045
enable_streaming_engine:
4146
name: enable_streaming_engine
4247
title: Enable Streaming Engine

modules/flex/metadata.yaml

Lines changed: 17 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -78,7 +78,7 @@ spec:
7878
connections:
7979
- source:
8080
source: github.com/terraform-google-modules/terraform-google-service-accounts//modules/simple-sa
81-
version: ~> 4.3
81+
version: ">= 4.3"
8282
spec:
8383
outputExpr: email
8484
- name: subnetwork
@@ -126,6 +126,22 @@ spec:
126126
description: Key/Value pairs to be passed to the Dataflow job (as used in the template).
127127
varType: map(string)
128128
defaultValue: {}
129+
connections:
130+
- source:
131+
source: github.com/terraform-google-modules/terraform-google-bigquery
132+
version: ">= 10.0.1"
133+
spec:
134+
outputExpr: "{\"OutputTableSpec\": table_ids[0]}"
135+
- source:
136+
source: github.com/terraform-google-modules/terraform-google-pubsub
137+
version: ">= 8.0.1"
138+
spec:
139+
outputExpr: "{\"InputTopic\": id}"
140+
- source:
141+
source: github.com/terraform-google-modules/terraform-google-cloud-storage//modules/simple_bucket
142+
version: ">= 9.1.0"
143+
spec:
144+
outputExpr: "{\"OutputDirectory\": url, \"OutputFilenamePrefix\": \"adc-dataflow\"}"
129145
- name: labels
130146
description: User labels to be specified for the job.
131147
varType: map(string)

0 commit comments

Comments
 (0)