[Enhancement] Migration from sonatype snapshots repo to ci.opensearch.org snapshots repo #5360
Description
[Enhancement] Migration from sonatype snapshots repo to ci.opensearch.org snapshots repo
Sonatype is having new policies of removing snapshots over 30 days.
Steps:
- Copy existing snapshots from
https://aws.oss.sonatype.org/content/repositories/snapshots/org/opensearch/tohttps://ci.opensearch.org/ci/dbc/snapshots/org/opensearch/ - Update all OS core + plugins + standalone repo to publish snapshots to new location
- Update all OS core + plugins + standalone repo to pull snapshots from new location
Additional request: browsing to make sure s3 is online
Thanks.
PRs:
- opensearch-build: publish-snapshot.sh ✅
- OpenSearch (core) ✅
- notifications ✅
- geospatial ✅
- search-relevance ✅ (no 2.19)
- opensearch-learning-to-rank-base ✅
- observability ✅
- opensearch-system-templates ✅
- Onboarding new maven snapshots publishing to s3 (system-templates) opensearch-system-templates#104
- [Backport 2.19] Onboarding new maven snapshots publishing to s3 (system-templates) opensearch-system-templates#105
- [Backport 3.3] Onboarding new maven snapshots publishing to s3 (system-templates) opensearch-system-templates#107
- job-scheduler ✅
- Onboarding new maven snapshots publishing to s3 (job-scheduler) job-scheduler#850
- [Backport 3.3] Onboarding new maven snapshots publishing to s3 (job-scheduler) job-scheduler#854
- [Backport 2.19] Onboarding new maven snapshots publishing to s3 (job-scheduler) job-scheduler#852
- Remove cron trigger on JS as maven snapshots is already on s3 job-scheduler#858
- reporting ✅
- common-utils ✅
- asynchronous-search ✅
- security-analytics ✅
- Onboarding new maven snapshots publishing to s3 (SA) security-analytics#1597
- [Backport 2.19] Onboarding new maven snapshots publishing to s3 (SA) security-analytics#1600
- Bump maven snapshot publishing to java 21 security-analytics#1601
- [Backport 2.19] Bump maven snapshot publishing to java 21 security-analytics#1602
- [Backport 3.3] Onboarding new maven snapshots publishing to s3 (SA) security-analytics#1603
- [Backport 3.3] Bump maven snapshot publishing to java 21 security-analytics#1604
- skills ✅
- alerting ✅
- k-NN ✅
- anomaly-detection ✅
- user-behavior-insights ✅ (no 2.19)
- neural-search ✅
- performance-analyzer ✅
- performance-analyzer-commons ✅ (no 2.19)
- performance-analyzer-rca (2.x only, main old)
- opensearch-remote-metadata-sdk ✅
- Onboarding new maven snapshots publishing to s3 (opensearch-remote-metadata-sdk) opensearch-remote-metadata-sdk#267
- [Backport 2.19] Onboarding new maven snapshots publishing to s3 (opensearch-remote-metadata-sdk) opensearch-remote-metadata-sdk#268
- [Backport 3.3] Onboarding new maven snapshots publishing to s3 (opensearch-remote-metadata-sdk) opensearch-remote-metadata-sdk#269
- index-management ✅
- custom-codecs ✅
- flow-framework ✅
- sql (SNAPSHOT_REPO_URL) ✅
- cross-cluster-replication ✅
- ml-commons ✅
- Onboard to s3 snapshots ml-commons#4320
- [Backport 2.19] Onboard to s3 snapshots ml-commons#4322
- [Backport 3.1] Onboard to s3 snapshots ml-commons#4327
- Use regex to publish maven snapshots based on branches ml-commons#4330
- [Backport 3.2] Onboard to s3 snapshots ml-commons#4329
- [Backport 3.3] Onboard to s3 snapshots ml-commons#4328
- security: ✅
- query-insights ✅
- jVector ✅ (no 2.19)
- protobufs: ✅ (no 2.19)
- New plugins ✅ (no 2.19)
- opensearch-plugin-template-java ✅
- opensearch-java: ✅
- spring-data-opensearch: ✅
- opensearch-spark (SNAPSHOT_REPO_URL):
⚠️ - Spark is using a very specific method of publishing which does not support s3 publishing, until they migrate to be the same as sql repo method.
- [Enhancement] Onboard to the same maven snapshots publishing method as sql to support s3 snapshots opensearch-spark#1282
- data-prepper: ⏳
- opensearch-testcontainers: ✅
- opensearch-hadoop (SNAPSHOT_REPO_URL): ✅
- opensearch-prometheus-exporter: ✅
- cluster-etcd: ✅
- opensearch-storage-encryption: ✅
- opensearch-api-specification: ✅
- opensearch-sdk-java:
⚠️ - sdk java havent even support OS3 as of now
- Onboarding new maven snapshots publishing to s3 (opensearch-sdk-java) opensearch-sdk-java#1034