Skip to content

Live pipeline visualization #10

Open
@CJ-Wright

Description

@CJ-Wright

It would be great to visualize data's progress through the pipeline.

This could be accomplished by:

  1. Building a live updating graph plot
  2. Monkey patching the update methods on all the nodes with a function decorator. This decorator would turn the node yellow when data goes into the update and green when data came out. It may be possible to have it turn red if the data causes an exception.
def visualization_decorator(func):
    def inner(self, data):
        self.v.turn_yellow()
        try:
            func(data)
        except Exception as e:
            self.v.turn_red()
            raise e
        else:
            self.v.turn_green()

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions