Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: PDBDebugger and Parallelizable #1224

Open
zilto opened this issue Nov 12, 2024 · 1 comment
Open

docs: PDBDebugger and Parallelizable #1224

zilto opened this issue Nov 12, 2024 · 1 comment
Labels
documentation Improvements or additions to documentation Dynamic DAGs

Comments

@zilto
Copy link
Collaborator

zilto commented Nov 12, 2024

It should be noted the PDBDebugger doesn't work with parallel and multithreaded task-based execution. However, you can use it in combination with the SynchronousLocalTaskExecutor

import my_dataflow
from hamilton import driver
from hamilton.execution.executors import SynchronousLocalTaskExecutors
from hamilton.lifecycle import PDBDebugger

dr = (
  driver.Builder()
  .enable_dynamic_execution(allow_experimental_mode=True)
  .with_modules(my_dataflow)
  .with_adapters(PDBDebugger(...))
  .with_remote_executor(SynchronousLocalTaskExecutor())
  .build()
)

dr.execute(...)
@zilto zilto added documentation Improvements or additions to documentation Dynamic DAGs labels Nov 12, 2024
@elijahbenizzy
Copy link
Collaborator

It should work with threading, in theory, but it will usually provide a really annoying experience.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation Dynamic DAGs
Projects
None yet
Development

No branches or pull requests

2 participants