New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement OpenSearch/Elasticsearch document source/destination/corpus #97

Open

johann-petrak opened this issue Apr 13, 2021 · 0 comments

Labels

Collaborator

johann-petrak commented Apr 13, 2021

(See https://github.com/opensearch-project/OpenSearch)

Make sure the Python elasticsearch packages are fully compatible with OpenSearch.

Destination:

handles how Document instances are getting stored and indexed.
- always store the actual document json (possibly with filtered annotation sets)
- in addition add fields for searching based on config options
- this may include annotation in context text fields (after filtering/checking for overlaps)
- store config information within the same index?

Source:

iterator of documents for some search

Corpus:

store as for destination
retrieve by document index
also use as source

johann-petrak added the enhancement label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment