Skip to content

Is import data idempotent? #405

Answered by Freika
alangrafu asked this question in Q&A
Discussion options

You must be logged in to vote

Every point about to be recorded to the database is checked for uniqueness based on latitude, longitude, timestamp, and user_id. If you import a new file, all points will be imported. Only the new points will be imported if you import an updated version of the same file.

The downside of it is that all raw content of the files that are being imported via the web interface are being stored in the importa.raw_data column of the database, so having several slightly different files imported will take unnecessary place in the DB.

Otherwise you're good to go :)

Replies: 2 comments

Comment options

You must be logged in to vote
0 replies
Answer selected by Freika
Comment options

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants
Converted from issue

This discussion was converted from issue #396 on November 15, 2024 11:49.