Feature Request: Manual Queue Check for External Data Insertions

[richard457]

I am writing to suggest a new feature to enhance the functionality of our database and queue system. Currently, when data is inserted into the database outside of standard SQL queries (e.g., via external tools or manual inserts), these changes are not automatically detected by the queue for upload. This can lead to inconsistencies or delays in data processing.

To address this, I propose the ability to specify certain tables in the repository that should be manually checked by the queue. This would allow the system to monitor these tables for any external changes and ensure that the data is picked up and processed accordingly.

For example, we could define a configuration or flag in the repository to indicate which tables require manual queue checks. This would provide greater flexibility and ensure that all data, regardless of how it is inserted, is properly handled.

I believe this feature would significantly improve data integrity and streamline our workflows. Let me know if you need further details or clarification.

Thank you for considering this request!