Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[exporterhelper] Add WithRequestQueue option to the exporter #8275

Conversation

dmitryax
Copy link
Member

@dmitryax dmitryax commented Aug 23, 2023

This is an alternative interface for enabling queue in the new exporter helper as suggested in #8248 (comment)

Tracking issue: #8122

@dmitryax dmitryax changed the title Exporter helper withqueue option [exporterhelper] refactor queue creation for WithQueue option Aug 23, 2023
@dmitryax dmitryax force-pushed the exporter-helper-withqueue-option branch from e39b085 to d3b012d Compare August 23, 2023 17:26
@dmitryax dmitryax force-pushed the exporter-helper-withqueue-option branch 2 times, most recently from 743f8d0 to c66cf3f Compare August 25, 2023 06:39
@dmitryax dmitryax added the Skip Changelog PRs that do not require a CHANGELOG.md entry label Aug 25, 2023
@dmitryax dmitryax changed the title [exporterhelper] refactor queue creation for WithQueue option [exporterhelper] Add WithQueue option to the exporter Aug 25, 2023
@codecov
Copy link

codecov bot commented Aug 25, 2023

Codecov Report

Attention: 1 lines in your changes are missing coverage. Please review.

Files Coverage Δ
exporter/exporterhelper/common.go 97.41% <100.00%> (+0.06%) ⬆️
...er/exporterhelper/internal/bounded_memory_queue.go 91.66% <100.00%> (+0.17%) ⬆️
...porter/exporterhelper/internal/persistent_queue.go 100.00% <100.00%> (ø)
...rter/exporterhelper/internal/persistent_storage.go 92.66% <100.00%> (ø)
...xporterhelper/internal/persistent_storage_batch.go 85.36% <100.00%> (ø)
exporter/exporterhelper/logs.go 86.04% <100.00%> (-0.17%) ⬇️
exporter/exporterhelper/metrics.go 86.04% <100.00%> (-0.17%) ⬇️
exporter/exporterhelper/queue/config.go 100.00% <100.00%> (ø)
...xporter/exporterhelper/queue/memoryqueue/config.go 100.00% <100.00%> (ø)
...porter/exporterhelper/queue/memoryqueue/factory.go 100.00% <100.00%> (ø)
... and 7 more

📢 Thoughts on this report? Let us know!.

dmitryax added a commit that referenced this pull request Aug 30, 2023
Make the queue initialization process consistent for both queue types.
Instead of having different workflows for memory and persistent queues,
this change breaks the initialization of both into two generic steps:
1. Queue factory: `NewBoundedMemoryQueue`, `NewPersistentQueue`
2. Start method: `queue.Start(context.Context, component.Host,
QueueSettings)`

This change:
- reduces coupling between `queuedRetrySender` and the queues;
- allows future refactoring of `queuedRetrySender`;
- allows future extraction of the queue package from the exporterhelper;
- makes it possible to have `WithRequestQueue` option for the new
exporter helper API as drafted in
#8275.
@dmitryax dmitryax force-pushed the exporter-helper-withqueue-option branch 5 times, most recently from beabbce to 52172a6 Compare August 31, 2023 16:03
@github-actions
Copy link
Contributor

This PR was marked stale due to lack of activity. It will be closed in 14 days.

@github-actions github-actions bot added the Stale label Sep 15, 2023
@github-actions
Copy link
Contributor

Closed as inactive. Feel free to reopen if this PR is still being worked on.

@github-actions github-actions bot closed this Sep 29, 2023
@dmitryax dmitryax reopened this Oct 1, 2023
@dmitryax dmitryax removed the Stale label Oct 1, 2023
@dmitryax dmitryax force-pushed the exporter-helper-withqueue-option branch 2 times, most recently from 37c8fc6 to 2d1aec3 Compare October 2, 2023 22:52
@dmitryax dmitryax marked this pull request as ready for review October 2, 2023 22:52
@dmitryax dmitryax requested review from a team and djaglowski October 2, 2023 22:52
@dmitryax dmitryax force-pushed the exporter-helper-withqueue-option branch 3 times, most recently from c7c1138 to 2324e1a Compare October 2, 2023 23:49
@dmitryax dmitryax removed the Skip Changelog PRs that do not require a CHANGELOG.md entry label Oct 3, 2023
@dmitryax dmitryax force-pushed the exporter-helper-withqueue-option branch 3 times, most recently from 5a349bf to d81d902 Compare October 5, 2023 01:07
@dmitryax dmitryax force-pushed the exporter-helper-withqueue-option branch 3 times, most recently from 7817f94 to a36cba4 Compare October 5, 2023 05:32
codeboten pushed a commit that referenced this pull request Oct 5, 2023
@dmitryax dmitryax force-pushed the exporter-helper-withqueue-option branch from a36cba4 to 0112f40 Compare October 5, 2023 16:54
@github-actions
Copy link
Contributor

This PR was marked stale due to lack of activity. It will be closed in 14 days.

@github-actions github-actions bot added the Stale label Oct 20, 2023
@dmitryax dmitryax removed the Stale label Oct 20, 2023
@dmitryax dmitryax force-pushed the exporter-helper-withqueue-option branch 3 times, most recently from 9eb77be to 6f0ed5f Compare October 25, 2023 23:04
@dmitryax dmitryax force-pushed the exporter-helper-withqueue-option branch 2 times, most recently from 2e821ec to bc58c7f Compare November 2, 2023 07:01
@dmitryax dmitryax changed the title [exporterhelper] Add WithQueue option to the exporter [exporterhelper] Add WithRequestQueue option to the exporter Nov 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant