Skip to content
This repository has been archived by the owner on Dec 16, 2021. It is now read-only.

Releases: yu-iskw/bigquery-to-datastore

Version 0.7.0

30 Dec 23:46
70fc0b9
Compare
Choose a tag to compare
  • Wait for finish of the apache beam job.

Support another timestamp format

11 Dec 03:56
caa7b8c
Compare
Choose a tag to compare

Upgrade Apache Beam to 2.16.0

10 Dec 19:44
0d7e227
Compare
Choose a tag to compare

Google Dataflow support Apache Beam SDK for Java with version 2.4.0 and lower. So, we need to upgrade the SDK version to the current latest 2.16.0.

SDK Decommission Notice: The following SDK versions will be decommissioned in late 2019 due to the discontinuation of support for JSON-RPC and Global HTTP Batch Endpoints.

  • Apache Beam SDK for Java, versions 2.0.0 to 2.4.0 (inclusive)
  • Apache Beam SDK for Python, versions 2.0.0 to 2.4.0 (inclusive)
  • Dataflow SDK for Java, versions 2.0.0 to 2.4.0 (inclusive)
  • Dataflow SDK for Python, 2.0.0 to 2.4.0 (inclusive)
    Previously, the date planned for this decommissioning was March 25, 2019, but in response to customer requests, we are extending this timeline. The new end date has yet to be finalized but is expected to happen in 2019. When decommissioning happens, you will no longer be able to submit new Dataflow jobs or update running Dataflow jobs that use the decommissioned SDKs. In addition, existing streaming jobs that use these SDK versions may fail.

Cited by https://cloud.google.com/dataflow/docs/support/sdk-version-support-status

Cast values which don't match to any rules as string

11 Apr 19:06
b67c7b0
Compare
Choose a tag to compare
Cast value which doesn't match to any rules as string (#22)

* force cast as string if a given value doesn't match to any rules

* Throw it away to parse integer and double

* Add testConvertToDatastoreValue

* Modify README

* Change default time zone for timestamp

Replace SimpleDateFormat with DateTimeFormatter

09 Apr 21:32
fcf3e36
Compare
Choose a tag to compare
Replace SimpleDateFormat with DateTimeFormatter (#21)

* Change java target version from 1.7 to 1.8

* Refactoring parseDate

* Modify parsers

* Remove openjdk7

* Modify Makefile, README and pom

* Add ./dev/get-app-version.sh

* Modify Makefile

Prepare for homebrew's tap release

23 Feb 06:31
89df693
Compare
Choose a tag to compare
0.4.1

Change version (#16)

Support a feature to specify indexed columns.

13 Feb 06:58
ed128e2
Compare
Choose a tag to compare
0.3

Support a feature to specify indexed columns. (#11)

Version 0.2

12 Oct 17:06
Compare
Choose a tag to compare
  • Dealing with nullable values more carefully

Version 0.1

11 Oct 21:48
Compare
Choose a tag to compare
  • Implement it on Apache Beam and Google Dataflow 2.1.1