Library scan progress

[Le-zOU]

Please put plugin requests/bugs at: https://github.com/HaveAGitGat/Tdarr_Plugins

Is your feature request related to a problem? Please describe.
I do not know how many files have been scanned and how many are lelft to scan during initial scan

Describe the solution you'd like
A total of files detected + a current number of files scanned

Describe alternatives you've considered
none that I can think of :D

Additional context
I have a library with literally millions of files
Some are videos, some are not
The initial libray scan has been running for 2 weeks 24/7 now, and I can see how many files have been found
(Found: 8617520 Checking:0 Scanner mem: 3725.4MB/3782.0MB),
but I don't know how many are left to be scanned.

An initial count of files + number of files scanned + 'found to be processed' would be helpful

[HaveAGitGat]

The scanner has mostly likely crashed. If you run it on a smaller folder you'll see how it works- it first reads all files then processes them.

I've checked Tdarr with up to 4 million files in a library but haven't tried with 8 million. Probably a memory error.

[Le-zOU]

it still finds new files, and scanner mem grows, is there a way to check if it has crashed ?
Found: 8640510 Checking:0 Scanner mem: 3710.3MB/3785.9MB

[Le-zOU]

[HaveAGitGat]

Ok if the number is still increasing then it hasn't crashed. It must be either very slow disk read or code is not optimized when handling that number of files.

[Le-zOU]

it reads off a synology over 1Gb link thou

[HaveAGitGat]

It's not about network bandwidth it's about small reads of millions of files which can be very slow on HDDs.

But this is probably more related to how the scanner manages memory causing it to slow down a lot once reaching that number of files. I'll look to improve it if I get some time.