-
Notifications
You must be signed in to change notification settings - Fork 14
Open
Description
Mobius/Ray Streaming might need users create independent actors these out of streaming DAG.
In our prevois design, job master will invoke and manage all lifecyle of independent actors, such as Parameter Server actor that supported for training inside.
Actually, different training infra need user-define independent actors so engine dev should design a more general api for creating and managing independent actors/vertices.
ctx = context.build_context(context_config)
ctx.independent_vertex(module_name = 'xx', class_name = 'xx', number = 10, config = {}, resources = {}, lazy=false)
For exmplae, we define a parameter server group:
ctx.independent_vertex(module_name = "penrose.ps_actor", class_name = "PsActor", number = 10)
Metadata
Metadata
Assignees
Labels
No labels