Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Development #67

Open
wants to merge 40 commits into
base: main
Choose a base branch
from
Open

Development #67

wants to merge 40 commits into from

Conversation

FjodorvRijsselberg
Copy link
Collaborator

No description provided.

ekoi and others added 30 commits September 30, 2024 14:00
@ekoi
Update readme.md
c8f17b9 
Add oai enricher service
Added refiner step to liss workflow.
2933bd4
@FjodorvRijsselberg
Merge pull request #66 from odissei-data/ODSP-233-liss-refiner
a44a0ec 
Added refiner step to liss workflow.
@FjodorvRijsselberg
Merge pull request #63 from odissei-data/ekoi-patch-1
884e4a9 
Update readme.md
Refactored docker setup for update to prefect 3.
f43ef9a
Updated workflow to create both images for the server and worker.
be635a7
Updated all packages and set prefect to version 3.
d04c066
Upgraded resources submodule to latest version.
656dd46
Changes to settings, deployment and start script for Prefect 3 and do…
b1c79c2 
…cker changes.
Changed default value for entry workflows top emtpy string to match e…
175b499 
…xpected default.
@FjodorvRijsselberg
Merge pull request #68 from odissei-data/ODSP-238-Prefect-major-versi…
8f9261d 
…on-bump

ODSP-238 prefect major version upgrade
@ekoi
Add extra param, "indentifiers.json" as file name of collected identi…
9519b82 
…fiers.
@ekoi
Add deletion pipeline dedicated to the Dataverse to Dataverse workflow
c67d349
@ekoi
Add deletion pipeline dedicated to the Dataverse to Dataverse workflow
ffde241
@ekoi
Add deletion pipeline dedicated to the Dataverse to Dataverse workflow
cfda5f1
@ekoi
Add deletion pipeline dedicated to the Dataverse to Dataverse workflow
19b5cc7
@ekoi
Add deletion pipeline dedicated to the Dataverse to Dataverse workflow
0d92a91
@ekoi
Add timestamp parameter: The timestamp from which to start harvesting.
f36206d
@ekoi
Add timestamp parameter: The timestamp from which to start harvesting.
72ca086
@ekoi
Add timestamp parameter: The timestamp from which to start harvesting.
8c90c1b
@ekoi
Add timestamp parameter: The timestamp from which to start harvesting.
10a64bd
@ekoi
Add timestamp parameter: The timestamp from which to start harvesting.
4cc2f22
@ekoi
Task update dataset: First delete then re-ingest
98d632c
Small bit of clean up.
f4a63ff
Using python 3.11 due to image issues for 3.12.
b22564e
The import for the prefect state changes, updated all uses.
99d0d74
@FjodorvRijsselberg
Merge pull request #64 from odissei-data/incremental-harvester
cd323d4 
Incremental harvester
Updated the entrypoint to use an env for the API URL>
bbda106
Ran poetry update and bumped the version.
ed4743f
Fix for the .env.
0d64062
Fjodor van Rijsselberg and others added 10 commits October 23, 2024 17:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@FjodorvRijsselberg @ekoi