Skip to content

Conversation

pingsutw
Copy link
Member

@pingsutw pingsutw commented Sep 30, 2025

1000ms -> 750 ms

  • create grpc channel (200ms)
  • load proto (300ms)
  • load task + run code + upload outputs (200ms)

- Add client retrieval from init config in runtime.py
- Refactor controller thread startup logic with separate _wait method
- Ensure controller is properly initialized before running coroutines

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <[email protected]>
Signed-off-by: Kevin Su <[email protected]>
@pingsutw pingsutw changed the title Use same client instance in controller initialization Load the task and start the controller in parallel Sep 30, 2025
Signed-off-by: Kevin Su <[email protected]>
Signed-off-by: Kevin Su <[email protected]>
@pingsutw pingsutw marked this pull request as draft September 30, 2025 04:48
Signed-off-by: Kevin Su <[email protected]>
@pingsutw pingsutw changed the title Load the task and start the controller in parallel [WIP] Load the task and start the controller in parallel Sep 30, 2025
Signed-off-by: Kevin Su <[email protected]>
bundle = None
if tgz or pkl:
bundle = CodeBundle(tgz=tgz, pkl=pkl, destination=dest, computed_version=version)
init(org=org, project=project, domain=domain, image_builder="remote", **controller_kwargs)
Copy link
Member Author

@pingsutw pingsutw Sep 30, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We created a gRPC channel twice (init, create_controller). I think we should be able to reuse it in the controller.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant