Skip to content

updated tests for batch sending #96

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jan 3, 2025

Conversation

robinbryce
Copy link
Contributor

@robinbryce robinbryce commented Jan 2, 2025

This change delegates full responsibility for receiving, sending and disposition to tha handler. This is the only way to maximise the benefit of azure batch messaging in an application aware way. See this PR for example use https://github.com/datatrails/forestrie/pull/283

In particular, the serial disposition offered by this PR #64 results in N * 10's of ms per message delay between receives

With application aware disposition it is possible to reduce that to just 10's of ms

AB#9588

application level testing was performed using avid-events and forestrie, results and config posted here https://jitsuin.atlassian.net/wiki/spaces/ENG/pages/3544219652/10068+Performance+Testing?focusedCommentId=3571875842

eccles
eccles previously approved these changes Jan 2, 2025
@robinbryce robinbryce force-pushed the dev/robin/9588-batch-builder-receiver branch from c6ffe85 to 7356181 Compare January 2, 2025 14:46
@eccles eccles self-requested a review January 2, 2025 14:47
eccles
eccles previously approved these changes Jan 2, 2025
@wp0pw
Copy link
Contributor

wp0pw commented Jan 2, 2025

I have several questions, so hold your horses for a bit please :)

and remove the conditionality from the original receiver.
@robinbryce robinbryce merged commit 6a92ea4 into main Jan 3, 2025
2 checks passed
@robinbryce robinbryce deleted the dev/robin/9588-batch-builder-receiver branch January 3, 2025 11:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants