Skip to content

Conversation

keith-turner
Copy link
Contributor

Refactors the batch scanner code to make two improvements. First mapping ranges to scan servers or tservers was moved under one method. Second the process of mapping ranges to scan servers using the tablet location cache was improved. The tablet location cache used to organized data in a a way that was useful for immediate scans and eventual scans had to reorganize the data. A new method was added to the tablet location cache that passes the raw data to a consumer that can orgranize it in any way. This new method is used for scan servers.

Refactors the batch scanner code to make two improvements.  First
mapping ranges to scan servers or tservers was moved under one method.
Second the process of mapping ranges to scan servers using the tablet
location cache was improved.  The tablet location cache used to organized
data in a a way that was useful for immediate scans and eventual scans
had to reorganize the data.  A new method was added to the tablet
location cache that passes the raw data to a consumer that can orgranize
it in any way.  This new method is used for scan servers.
@keith-turner
Copy link
Contributor Author

This PR is similar to #3272 except its for the batch scanner, it also pulls code from #3143 into its own PR.

@dlmarion
Copy link
Contributor

dlmarion commented Apr 5, 2023

Looks good, kicking off full IT build for this.

@keith-turner keith-turner changed the base branch from main to elasticity April 5, 2023 20:26
@keith-turner
Copy link
Contributor Author

Looks good, kicking off full IT build for this.

Ok going to merge thjis w/ same reason as #3272

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

3 participants