Rebuild index based on current data, including updates#2408
Open
RobinTF wants to merge 70 commits intoad-freiburg:masterfrom
Open
Rebuild index based on current data, including updates#2408RobinTF wants to merge 70 commits intoad-freiburg:masterfrom
RobinTF wants to merge 70 commits intoad-freiburg:masterfrom
Conversation
Codecov Report❌ Patch coverage is Additional details and impacted files@@ Coverage Diff @@
## master #2408 +/- ##
==========================================
- Coverage 91.60% 91.21% -0.40%
==========================================
Files 483 484 +1
Lines 41386 41630 +244
Branches 5496 5523 +27
==========================================
+ Hits 37912 37971 +59
- Misses 1897 2079 +182
- Partials 1577 1580 +3 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
hannahbast
changed the title
RobinTF
force-pushed
the
rebuild-index-and-vocab
branch
from
5c40c11 to
5d942d7
Compare
The parameter does what it says, and is `false` by default
hannahbast
pushed a commit
that referenced
this pull request
Jan 19, 2026
…es (#2640) Implement the functions for recomputing the triple statistics, as preparation for #2408 (rebuild index) NOTE: This could also be used to recompute the triple statistics stored in the `.meta-data.json` file, either periodically in the background, or when they are requested via `cmd=stats`. That is work for a separate PR
marvin7122
pushed a commit
to marvin7122/qlever
that referenced
this pull request
Jan 22, 2026
…es (ad-freiburg#2640) Implement the functions for recomputing the triple statistics, as preparation for ad-freiburg#2408 (rebuild index) NOTE: This could also be used to recompute the triple statistics stored in the `.meta-data.json` file, either periodically in the background, or when they are requested via `cmd=stats`. That is work for a separate PR
hannahbast
pushed a commit
that referenced
this pull request
Jan 30, 2026
Implement the functions `IndexImpl::createPermutation` (to build a single permutation from a triple generator), `DeltaTriplesManager::getCurrentLocatedTriplesSharedStateWithVocab` (to have all the information needed to remap a permutation), and `Pattern::cloneAndRemap` (to rewrite the list of patterns). On the side, refactor and simplify `test/CompactStringVectorTest.cpp`. All this is preparation for #2408
This reverts commit 96b96f8.
Overview
Conformance check passed ✅No test result changes. |
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This is a WIP experiment to see how we can use QLever to build a new index based on current changes resulting from update operations. Not ready for production use yet.
A build can be triggered by
curl http://yourserver:port/?cmd=rebuild-index, which will build some files required for an index in the current working directory of the process called "tmp_index" that can be used to override the actual files in the actual directory of the index (expect bugs though it might not always work, or not at all).