QCTools report generation fails if file is over 200 minutes long

[iamdamosuzuki]

I've been meaning to report this for a while, but now with the -s option it's become a lot easier for me to run tests at home and pinpoint exactly when the problem happens. I noticed that QCTools reports would fail for longer files, but know I've found that the problem starts if the file is any long than 200 minutes long. 200 minute long files work, 201 minute long do not. I am generating the report concurrently with the file. I'll test and see if the same happens if the report is made after capture.

This is the error that I get when the capture is complete:

.................................................. 100 of 100 %12419.97 A-V: -0.017 fd=  13 aq=    0KB vq=    0KB sq=    0B f=0/0   
analyzing completed

generating QCTools report... 
.                                                  3 of 100 %
adding thumbnails to QCTools report... 
.................................................. 100 of 100 %
adding panels to QCTools report... 
.................................................. 100 of 100 %
generating QCTools report... done, in /Users/mmorel/Movies/vrecord_test/TSG_207Min.mkv.qctools.mkv
Vrecord is analyzing your video file. Please be patient.
-:45897.1: Premature end of data in tag frame line 45896

^
-:68839.1: Premature end of data in tag frame line 68837

^
-:45897.1: Premature end of data in tag frame line 45896

^
Vrecord is generating graphs from the QCTools data. One moment please.
-:137665.1: Premature end of data in tag frame line 137660

^
-:45897.1: Premature end of data in tag frame line 45896

^
-:13.1: Premature end of data in tag ffprobe line 3

^
           line 0: warning: Skipping data file with no valid points
           line 0: warning: Skipping data file with no valid points

multiplot> plot '/tmp/vrecord.Ydttxr.astats_A.csv' using 1:2:2 with boxes palette title 'Max Level', '' using 1:3:3 with boxes palette title 'Min Level'
                                                                                                                                                        ^
           line 0: x range is invalid

           line 0: warning: Skipping data file with no valid points

multiplot> plot '' using 1:4:4 with lines ls 15 title 'Peak Level (dB)'
                                                                       ^
           line 0: x range is invalid

           line 0: warning: Skipping data file with no valid points

multiplot> plot '' using 1:5:5 with lines ls 25 title 'Audio Phase'
                                                                   ^
           line 0: x range is invalid

           line 0: warning: Skipping data file with no valid points

multiplot> plot '/tmp/vrecord.PuTukG.signalstats.V.csv' using 1:3:3 with boxes palette title '% Outside of Broadcast Range'
                                                                                                                           ^
           line 0: x range is invalid

           line 0: warning: Skipping data file with no valid points

multiplot> plot '' using 1:2 with lines ls 10 title '% Temporal OUTliers'
                                                                         ^
           line 0: x range is invalid

           line 0: warning: Skipping data file with no valid points
           line 0: warning: Skipping data file with no valid points

multiplot> plot '' using 1:4:4 with boxes palette title 'SatMax', '' using 1:5 with lines ls 5 title 'SatAvg'
                                                                                                             ^
           line 0: x range is invalid

           line 0: warning: Skipping data file with no valid points
           line 0: warning: Skipping data file with no valid points
           line 0: warning: Skipping data file with no valid points

multiplot> plot '' using 1:6 with lines ls 5 title 'SSIM-Y', '' using 1:7 with lines ls 2 title 'SSIM-U', '' using 1:8 with lines ls 6 title 'SSIM-V'
                                                                                                                                                     ^
           line 0: x range is invalid

QCTools analysis is complete.

[iamdamosuzuki]

It looks like the problem also occurs when qctools reports are generated after capture. However, running qcli independently after creating the file works perfectly fine, so it doesn't appear to be a qctools issue.

[iamdamosuzuki]

It looks like this might be related to this issue: bavc/qctools#864

[JeromeMartinez]

We don't succeed to reproduce the issue outside of vrecord, could someone hint about how QCTools is used in vrecord, the difference (full command line?) compared to a launch directly from the command line?

[dericed]

@JeromeMartinez, here's the qcli command in vrecord. It's conditional for whether it's done during the capture via pipe or having the file analyzed after the capture.

vrecord/vrecord

Lines 2788 to 2789 in 3f2e7d4

	QCLI_COMMAND_PIPE=(qcli -f signalstats+aphasemeter+astats+ssim -i - -o "${QCTOOLS_REPORT}")
	QCLI_COMMAND_FILE=(qcli -f signalstats+aphasemeter+astats+ssim -i "${VRECORD_OUTPUT}" -o "${QCTOOLS_REPORT}")

[dericed]

@JeromeMartinez and I just changed it by adding https://github.com/amiaopensource/vrecord/pull/860/files