Run error occurs when updating algo list during workflow run

[itutu-tienday]

Updating the algo list while a workflow is running will result in a run error.

• Related
  • [No.220-1]Improved method of adding new wrapper functions #522

Error info

• Screenshot

  • https://github.com/user-attachments/assets/ec1c4b2e-9083-46cb-a95e-41e6b41db65b

• error log

  ERROR - smk_status_logger.py - {'level': 'debug', 'msg': 'Full Traceback (most recent call last):\n File "/Users/user1/miniforge3/envs/barebone-studio_poetry/lib/python3.8/site-packages/snakemake/dag.py", line 595, in check_and_touch_output\n wait_for_files(\n File "/Users/user1/miniforge3/envs/barebone-studio_poetry/lib/python3.8/site-packages/snakemake/io.py", line 878, in wait_for_files\n raise IOError(\nOSError: Missing files after 3 seconds. This might be due to filesystem latency. If that is the case, consider to increase the wait time with --latency-wait:\n/Volumes/optinist-storedir/output/1/fd825ceb/suite2p_file_convert_axgpevzu10/suite2p_file_convert.pkl\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "/Users/user1/miniforge3/envs/barebone-studio_poetry/lib/python3.8/site-packages/snakemake/scheduler.py", line 641, in _finish_jobs\n self.get_executor(job).handle_job_success(job)\n File "/Users/user1/miniforge3/envs/barebone-studio_poetry/lib/python3.8/site-packages/snakemake/executors/init.py", line 671, in handle_job_success\n super().handle_job_success(job)\n File "/Users/user1/miniforge3/envs/barebone-studio_poetry/lib/python3.8/site-packages/snakemake/executors/init.py", line 259, in handle_job_success\n job.postprocess(\n File "/Users/user1/miniforge3/envs/barebone-studio_poetry/lib/python3.8/site-packages/snakemake/jobs.py", line 1150, in postprocess\n self.dag.check_and_touch_output(\n File "/Users/user1/miniforge3/envs/barebone-studio_poetry/lib/python3.8/site-packages/snakemake/dag.py", line 602, in check_and_touch_output\n raise MissingOutputException(\nsnakemake.exceptions.MissingOutputException: Job 5 completed successfully, but some output files are missing. Missing files after 3 seconds. This might be due to filesystem latency. If that is the case, consider to increase the wait time with --latency-wait:\n/Volumes/optinist-storedir/output/1/fd825ceb/suite2p_file_convert_axgpevzu10/suite2p_file_convert.pkl\n', 'timestamp': 1740622809.5084422}

Countermeasure

• 1. Identify the cause of the error and take corrective measures.
• 2. As a supplementary measure, the algorithm list cannot be updated during run time.

[tsuchiyama-araya]

@itutu-tienday
お疲れ様です。
こちら調査しましたが、エラーになる原因は特定できませんでした。
そのため、Worfkflowを実行中にボタンも無効化する実装をしましたが、そちらの対応で大丈夫でしょうか？

[itutu-tienday]

@tsuchiyama-araya
Countermeasure の No.2 が対応されたということですね。
No.1 は要因を特定したほうが良いと思われます。 issue は 対応中のstatusとしましょう。

また、以下の調査内容の詳細をシェアしてください。

エラーになる原因は特定できませんでした。