Investigate GenerateEmbeddingsParallelHandler usage

[demid-ns]

Description

Evaluate the feasibility of using GenerateEmbeddingsParallelHandler in ProductIngestionCommandHandler to potentially optimize the ingestion process. Assess its stability, performance benefits, and compatibility with the current workflow.

Tasks

• Review GenerateEmbeddingsParallelHandler and its limitations
• Compare performance with the current approach
• Decide whether to adopt it

Outcome

A decision on whether GenerateEmbeddingsParallelHandler should replace the current parallelization logic in ProductIngestionCommandHandler