Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

PRIMAP-HIST - S3 - Mapping #93

Open
S-AI-F opened this issue May 17, 2021 · 0 comments
Open

PRIMAP-HIST - S3 - Mapping #93

S-AI-F opened this issue May 17, 2021 · 0 comments
Assignees
@sebastienbourgeois
Labels
data-mapping This issue or pull request already exists

Comments

@S-AI-F
Copy link
Member

S-AI-F commented May 17, 2021

Once mapped json file stored in github repository is validated, you can update your mapping script by replacing input/output data with s3 buckets.

You have a specific folder by data source where you can put raw data and mapped generated data (in staging folder).

Doc:

data staging model: https://github.com/OpenGeoScales/ogs-connectors/wiki/2---Data-Model---Staging
data staging storage: https://github.com/OpenGeoScales/ogs-connectors/wiki/Datalake-AWS-S3
@S-AI-F S-AI-F transferred this issue from OpenGeoScales/ogs-connectors May 17, 2021
@S-AI-F S-AI-F added the data-mapping This issue or pull request already exists label May 17, 2021
sebastienbourgeois added a commit that referenced this issue Jun 19, 2021
@sebastienbourgeois
Uploading mapped data to S3 #93
09796ee
sebastienbourgeois added a commit that referenced this issue Jun 19, 2021
@sebastienbourgeois
Update code to upload the generated file by the program #93
ebb98d0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sebastienbourgeois sebastienbourgeois

Labels
data-mapping This issue or pull request already exists
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@S-AI-F @sebastienbourgeois