Skip to content

tidb2dw should only has dependency on shared storage #101

@zhangjinpeng87

Description

@zhangjinpeng87

Right now the tidb2dw will connect to upstream TiDB to fetch some information like schema and column default value which break the simple dependency principle. The tidb2dw service should only have dependcy on the shared object storage like S3 and GCS, in this way, there should not have upstream database permission issue and network dependency issues since upstream clusters might in different VPC networks.

tidb -> ticdc ----->
                    --------> S3/GCS ------->  
                                              -------> tidb2dw -------> Snowflake/Redshift/...
                    --------> S3/GCS ------->
tidb -> ticdc ----->

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions