Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ENH: Fix issue with parallel execution of the same do-file on Unix systems. #3

Open
tobiasraabe opened this issue Jan 9, 2021 · 1 comment
Labels
enhancement New feature or request

Comments

@tobiasraabe
Copy link
Member

tobiasraabe commented Jan 9, 2021

Is your feature request related to a problem?

Stata produces log files which have the same name as the executed do-file when used in batch mode.

Parallelizing over the same do-file ...

  1. may create multiple workers which want to create the same log file at the same time.
  2. may overwrite the log produced by one task with the information from another task. Whether a task fails is partly inferred from the log file,

On Windows, there is a hacky and maybe not even intended work-around to rename the log file for every task which does not work on Unix.

Describe the solution you'd like

Nothing discussed so far.

@tobiasraabe tobiasraabe added the enhancement New feature or request label Jan 9, 2021
@tobiasraabe tobiasraabe pinned this issue Jan 9, 2021
@tobiasraabe tobiasraabe changed the title ENH: Investigate how pytask-stata can be run in parallel on UNIX systems. ENH: Fix issue with parallel execution of pytask-stata on Unix systems. Jan 10, 2021
@tobiasraabe
Copy link
Member Author

Use output redirection on Unix: https://stackoverflow.com/a/6482200.

@tobiasraabe tobiasraabe changed the title ENH: Fix issue with parallel execution of pytask-stata on Unix systems. ENH: Fix issue with parallel execution of the same do-file on Unix systems. Mar 10, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant