Skip to content

Investigate GenerateEmbeddingsParallelHandler usage #2

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
demid-ns opened this issue Dec 23, 2024 · 0 comments
Open

Investigate GenerateEmbeddingsParallelHandler usage #2

demid-ns opened this issue Dec 23, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@demid-ns
Copy link
Member

demid-ns commented Dec 23, 2024 •
edited
Loading

Description

Evaluate the feasibility of using GenerateEmbeddingsParallelHandler in ProductIngestionCommandHandler to potentially optimize the ingestion process. Assess its stability, performance benefits, and compatibility with the current workflow.

Tasks

  • Review GenerateEmbeddingsParallelHandler and its limitations
  • Compare performance with the current approach
  • Decide whether to adopt it

Outcome

A decision on whether GenerateEmbeddingsParallelHandler should replace the current parallelization logic in ProductIngestionCommandHandler
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@demid-ns