Skip to content

Integrate lsm-tree #1526

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
4 tasks
geo2a opened this issue May 28, 2025 · 0 comments
Open
4 tasks

Integrate lsm-tree #1526

geo2a opened this issue May 28, 2025 · 0 comments
Assignees
Labels
leios-blocker A Leios question blocking some work lsm-tree

Comments

@geo2a
Copy link
Contributor

geo2a commented May 28, 2025

In preparation for LedgerHD and Leios, as well as to retire the LMDB backend for UTxO-HD, we need to integrate the lsm-tree library as the on-disk storage backend for UTxO-HD.

This is the meta-issue which we will use coordinate the integration effort.

Phase 0: getting the dependencies aligned

Currently, lsm-tree allows io-classes 1.6 and 1.7, but the Network packages are being upgraded from 1.5 directly to 1.8. io-classes 1.8 has introduced some breaking changes, so we have to update lsm-tree to 1.8 before we can integrate the library into Consensus, as we'll have to follow the Network and use io-classes 1.8.

The steps that are needed to start the integration process are the following:

  • wait until Network has integrated io-classes 1.8. Seems like this is going to happen soon, see io-classes-1.8 ouroboros-network#4951.
  • integrate io-classes 1.8 and io-classes 1.8-enabled Network into Consensus, as these task are intertwined I think
  • integrate io-classes 1.8 into lsm-tree. This task could be done in-parallel with the previous two.

Phase 1:

  • integrate lsm-trees into Consensus once everything uses io-classes 1.8

The description of this phase will be itemised further.

@geo2a geo2a added this to the Unknown quarter milestone May 28, 2025
@geo2a geo2a self-assigned this May 28, 2025
@geo2a geo2a mentioned this issue May 28, 2025
4 tasks
@geo2a geo2a added the lsm-tree label May 28, 2025
@dnadales dnadales added the leios-blocker A Leios question blocking some work label May 28, 2025
@dnadales dnadales moved this to 🏗 In progress in Consensus Team Backlog May 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
leios-blocker A Leios question blocking some work lsm-tree
Projects
Status: 🏗 In progress
Development

No branches or pull requests

2 participants