Skip to content

[DRAFT DRAFT] Write delta triples to dedicated permutations.#2668

Draft
joka921 wants to merge 5 commits intoad-freiburg:masterfrom
joka921:update-permutation
Draft

[DRAFT DRAFT] Write delta triples to dedicated permutations.#2668
joka921 wants to merge 5 commits intoad-freiburg:masterfrom
joka921:update-permutation

Conversation

@joka921
Copy link
Member

@joka921 joka921 commented Jan 26, 2026

No description provided.

joka921 and others added 5 commits January 26, 2026 08:23
Signed-off-by: Johannes Kalmbach <[email protected]>
Signed-off-by: Johannes Kalmbach <[email protected]>
Signed-off-by: Johannes Kalmbach <[email protected]>
Complete the TODO in DeltaTriples::rebuildOnDiskDeltas to properly merge
existing on-disk delta triples with new in-memory delta triples.

Key changes:
- Fix metadata persistence: Write metadata to end of delta files following
  IndexMetaData format (serialize metadata + write offset)
- Fix metadata loading: Read offset from file end and deserialize metadata
- Add streaming merge: Implement k-way merge with deduplication using
  priority queue for memory efficiency
- Add readAllTriples: Read and combine all blocks from on-disk delta file
- Implement complete rebuild logic: Read old on-disk + new in-memory,
  merge with deduplication, write to temp files, atomic commit
- Fix commitTemporaryFiles: Check file existence before renaming

The implementation handles both regular and internal permutations, uses
atomic writes via temporary files, and fails safely without modifying
state if any operation fails.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <[email protected]>
@sparql-conformance
Copy link

Overview

Number of Tests Passed ✅ Intended ✅ Failed ❌ Not tested
547 450 73 24 0

Conformance check passed ✅

No test result changes.

Details: https://qlever.dev/sparql-conformance-ui?cur=36c3667d7bf085edc1a80c999381f09223803ee3&prev=230fdbdc39146a04015459bc5d21d17f2b23ea11

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant