Remove manual moving step of data from upload to registration folder during Data upload #42
Description
What has happened
Multiple user report that they experience issue with the manual move of their dataset from the upload directory to the registration folder.
Additionally, since the folders are in the users home directory, this leads to subissues resulting from manual file/folder manipulation as reported in #39 and as can be seen below.
Possible solutions
A) Upload directly into registration directory with wait time
1.) Rewrite Data Scanner to allow for a distinct wait time after writing process has finished on the provided upload (Taking into account that users with spotty connections might have breaks in writing activity)
2.) Only show the registration folder to the user during the upload so they upload data directly into it
B) Provide Custom Upload Script with Marker Files simliar to data mover.
1.) Provide a custom script which the user has to execute, facilitating SFTP based upload if the user moves the directory into a distinct folder on their machine (Taking into account different operating systems)
2.) The script will after successful upload create a .Marker File within the registration folder
3.) Data scanner will start upload only if .Marker file was created within the directory.
Both solutions are not easy to implement but users would benefit greatly from making the upload process straightforward in the future