Description
Describe the bug
At the end of the plotting process, the plotter attempts to copy the temporary plot file (*.plot.2.tmp) to the destination folder. If the destination folder is the same as the source folder, e.g. if you run chia plots create [...] -d foo
from the foo directory, everything goes fine until the last part, where you get Could not copy "./plot-k32-[...].plot.2.tmp" to "/mnt/foo/plot-k32-[...].plot.2.tmp". Error File exists. Retrying in five minutes.
. The error repeats in a loop every 5 minutes and you cannot Ctrl+C out of it, because interrupting only shortens the waiting part and you get the same message again.
The plot file itself seems to be fine after simply renaming it to plot-k32-[...].plot
.
To Reproduce
Steps to reproduce the behavior:
- Go to your
~/plots
folder, or wherever you're keeping your plots - Type
chia plots create -k32 -n1 -d $PWD -f [...] -p [...]
with the appropriate -f and -p keys - Wait for the plotting process to complete
- See error
Expected behavior
A plot should be created. Nowhere in the CLI plotting documentation it's stated that the temporary directory and the final directory have to be different. The copy should only take place if the final rename (from .plot.2.tmp to .plot) is across volumes, otherwise it should be just that (a rename).
Screenshots
Not a screenshot, but a log:
(venv) /mnt/d/plots$ chia plots create -k32 -n1 -d /mnt/d/plots/ -f a15b8372b084af2b9c501500c2b0e13d1506298372b50d37f83a9544fb13db33bc4da13b4cfa7ce533e5d992317bf7d4 -p 89072787df2bca9bf562221e13a580f563d40e3243150e32111431b8572e56fafd350144ce84cbb7c16131b2bfe565d2
2021-05-22T21:58:57.389 chia.plotting.create_plots : INFO Creating 1 plots of size 32, pool public key: 89072787df2bca9bf562221e13a580f563d40e3243150e32111431b8572e56fafd350144ce84cbb7c16131b2bfe565d2 farmer public key: a15b8372b084af2b9c501500c2b0e13d1506298372b50d37f83a9544fb13db33bc4da13b4cfa7ce533e5d992317bf7d4
2021-05-22T21:58:57.398 chia.plotting.create_plots : INFO Memo: 89072787df2bca9bf562221e13a580f563d40e3243150e32111431b8572e56fafd350144ce84cbb7c16131b2bfe565d2a15b8372b084af2b9c501500c2b0e13d1506298372b50d37f83a9544fb13db33bc4da13b4cfa7ce533e5d992317bf7d45d81160ec411b2b56d2bcea8521fc520ff9bbf721feead78905c2e12338ef147
2021-05-22T21:58:57.399 chia.plotting.create_plots : INFO Starting plot 1/1
Starting plotting progress into temporary dirs: . and .
ID: 6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd
Plot size is: 32
Buffer size is: 3389MiB
Using 128 buckets
Using 2 threads of stripe size 65536
Starting phase 1/4: Forward Propagation into tmp files... Sat May 22 21:58:57 2021
Computing table 1
F1 complete, time: 135.969 seconds. CPU (130.02%) Sat May 22 22:01:13 2021
Computing table 2
[...]
Total matches: 4294964292
Forward propagation table time: 1277.190 seconds. CPU (149.900%) Sat May 22 22:22:30 2021
Computing table 3
[...]
Total matches: 4294908177
Forward propagation table time: 1873.812 seconds. CPU (119.690%) Sat May 22 22:53:44 2021
Computing table 4
[...]
Total matches: 4294854782
Forward propagation table time: 2109.570 seconds. CPU (123.230%) Sat May 22 23:28:54 2021
Computing table 5
[...]
Total matches: 4294634249
Forward propagation table time: 2034.265 seconds. CPU (124.810%) Sun May 23 00:02:48 2021
Computing table 6
[...]
Total matches: 4294222792
Forward propagation table time: 1757.141 seconds. CPU (129.900%) Sun May 23 00:32:05 2021
Computing table 7
[...]
Total matches: 4293516870
Forward propagation table time: 1500.111 seconds. CPU (136.120%) Sun May 23 00:57:05 2021
Time for phase 1 = 10688.175 seconds. CPU (129.090%) Sun May 23 00:57:05 2021
Starting phase 2/4: Backpropagation into tmp files... Sun May 23 00:57:05 2021
[...]
Time for phase 2 = 4694.215 seconds. CPU (84.540%) Sun May 23 02:15:19 2021
Wrote: 268
Starting phase 3/4: Compression from tmp files into "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" ... Sun May 23 02:15:19 2021
Compressing tables 1 and 2
[...]
First computation pass time: 713.636 seconds. CPU (76.840%) Sun May 23 02:27:13 2021
[...]
Second computation pass time: 563.697 seconds. CPU (74.410%) Sun May 23 02:36:38 2021
Wrote 3429372434 entries
Total compress table time: 1278.563 seconds. CPU (75.740%) Sun May 23 02:36:38 2021
Compressing tables 2 and 3
[...]
First computation pass time: 883.787 seconds. CPU (83.300%) Sun May 23 02:51:22 2021
[...]
Second computation pass time: 584.363 seconds. CPU (75.590%) Sun May 23 03:01:06 2021
Wrote 3439805308 entries
Total compress table time: 1468.522 seconds. CPU (80.210%) Sun May 23 03:01:06 2021
Compressing tables 3 and 4
[...]
First computation pass time: 890.404 seconds. CPU (83.840%) Sun May 23 03:15:57 2021
[...]
Second computation pass time: 585.654 seconds. CPU (75.750%) Sun May 23 03:25:43 2021
Wrote 3465923635 entries
Total compress table time: 1476.788 seconds. CPU (80.590%) Sun May 23 03:25:43 2021
Compressing tables 4 and 5
[...]
First computation pass time: 904.989 seconds. CPU (83.320%) Sun May 23 03:40:48 2021
[...]
Second computation pass time: 595.915 seconds. CPU (75.640%) Sun May 23 03:50:45 2021
Wrote 3532548709 entries
Total compress table time: 1501.718 seconds. CPU (80.230%) Sun May 23 03:50:45 2021
Compressing tables 5 and 6
[...]
First computation pass time: 942.861 seconds. CPU (82.680%) Sun May 23 04:06:28 2021
[...]
Second computation pass time: 638.347 seconds. CPU (74.110%) Sun May 23 04:17:07 2021
Wrote 3712889147 entries
Total compress table time: 1581.616 seconds. CPU (79.210%) Sun May 23 04:17:07 2021
Compressing tables 6 and 7
[...]
First computation pass time: 752.733 seconds. CPU (64.630%) Sun May 23 04:29:39 2021
[...]
Second computation pass time: 769.147 seconds. CPU (71.060%) Sun May 23 04:42:29 2021
Wrote 4293516870 entries
Total compress table time: 1522.919 seconds. CPU (67.830%) Sun May 23 04:42:29 2021
Time for phase 3 = 8831.391 seconds. CPU (77.300%) Sun May 23 04:42:31 2021
Starting phase 4/4: Write Checkpoint tables into "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" ... Sun May 23 04:42:31 2021
Starting to write C1 and C3 tables
[...]
Finished writing C1 and C3 tables
Writing C2 table
Finished writing C2 table
Final table pointers:
P1: 0x10c
P2: 0x3747f6ee6
P3: 0x6b5ed27f3
P4: 0x9fdaee295
P5: 0xd5595229b
P6: 0x10d92d36fe
P7: 0x14e973472a
C1: 0x190918032a
C2: 0x19093237ce
C3: 0x190932387e
Time for phase 4 = 780.475 seconds. CPU (64.380%) Sun May 23 04:55:31 2021
Approximate working space used (without final file): 269.321 GiB
Final File size: 101.343 GiB
Total time = 24994.261 seconds. CPU (100.400%) Sun May 23 04:55:31 2021
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
[...]
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
Could not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
^CCould not copy "./plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp" to "/mnt/d/plots/plot-k32-2021-05-22-21-58-6354bd019ee1a0544e45391f5f46dfbb1e1d5c553810795d954a9b126f7522dd.plot.2.tmp". Error File exists. Retrying in five minutes.
As you can see, Ctrl+C only made the script repeat the attempt, not actually stop them. In the end, I just pkilled the python process responsible.
Desktop (please complete the following information):
- OS: Linux, WSL
- OS Version/Flavor: Debian Buster, Ubuntu Focal
- CPU: N/A
Additional context
If I'm reading this correctly, currently the plotting process requires full 269.321 GiB for the temporary files and 101.343 GiB for the final file resulting in 370.664 GiB total, even though it should actually only need the 269.321 GiB if the temporary and final file reside on the same volume and can be simply moved/renamed as an atomic operation. Whether the two paths reside on the same volume can be checked with os.stat(path).st_dev