Skip to content

Release v1.5.0
Compare
Choose a tag to compare
@uncleGen uncleGen released this 19 Nov 08:19
· 180 commits to master-2.x since this release
v1.5.0
19abd86

  • Improvement

    • Spark Structured Streaming support Loghub datasource.
    • Support parallel batch processing in loghub shard.
    • Cost too much time when update checkpoint in loghub direct api.
    • Add createRDD() in LoghubUtilsHelper.
    • Add java constructor for direct loghub dstream.

  • Bugfix

    • Fix wrong loghub RDD partition index.
    • Direct loghub dstream data dose not contain tag information.
    • Direct loghub dstream dose not support to process data from specific position.
    • OdpsUtils.runSQL connection timeout.
    • ODPS STRING type convert failed.
    • Failed to re-run structured loghub job.
    • structured loghub job failed with org.I0Itec.zkclient.exception.ZkNoNodeException.
    • Wrong endTime in LoghubBatchRDD.
Assets 2
Loading