Skip to content

atum checkpoint with additional properties #333

Open
0 of 4 issues completed
Open
Epic
0 of 4 issues completed
@salamonpavel

Description

@salamonpavel

Background

Checkpoints can carry extra information that would be really useful for further processing and data mining.

Goal

With each checkpoints a Map[String, String] could be saved, name checkpoint's additional properties holding any data useful for the user.

Optional features

Checkpoint labels - perhaps they could be implemented as checkpoint properties with no value. To consider.
Automatic properties - some properties can be "switched on" on AtumAgent level and automatically added to each checkpoint created. Like Spark application id.
Querying checkpoints based on properties

Sub-issues

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    Projects

    Status

    📋 Backlog

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions