Open
Description
Hi there,
I found this repo to be very good, useful, and I would like to ask how I can handle writing errors from Apache Beam BigtableIO.
My dataflow is reading from Pubsub subscription, does some data cleansing/processing, then use BigtableIO to write to Bigtable table.
The writing code is:
translatedMessages.apply(
"Writing to BT",
org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.write().withProjectId("my-project").withInstanceId("my-instance").withTableId("my-table")
as PTransform<in PCollection<KV<ByteString, java.lang.Iterable<Mutation>>>, PDone>
)
How can I handle the error from this writing step?
Thanks in advance.
Metadata
Metadata
Assignees
Labels
No labels