Skip to content

CNDB-14301: couple jvector file format and SAI version #1786

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

michaeljmarshall
Copy link
Member

@michaeljmarshall michaeljmarshall commented May 30, 2025

What is the issue

Fixes: https://github.com/riptano/cndb/issues/14301

What does this PR fix and why was it fixed

Make version EC and later use jvector file format 4. Also allow for some configurability in earlier versions just in case we have some clusters relying on that behavior via the cassandra.sai.jvector_version system property (defaults to 2 and is ignored for EC and later).

Copy link

Checklist before you submit for review

  • Make sure there is a PR in the CNDB project updating the Converged Cassandra version
  • Use NoSpamLogger for log lines that may appear frequently in the logs
  • Verify test results on Butler
  • Test coverage for new/modified code is > 80%
  • Proper code formatting
  • Proper title for each commit staring with the project-issue number, like CNDB-1234
  • Each commit has a meaningful description
  • Each commit is not very long and contains related changes
  • Renames, moves and reformatting are in distinct commits
  • All new files should contain the DataStax copyright header instead of the Apache License one

@michaeljmarshall
Copy link
Member Author

Companion CNDB test PR: https://github.com/riptano/cndb/pull/14303

@Override
public int jvectorFileFormatVersion()
{
// Before version EB, we used JVector format 2. Version DC introduced format 4, so we can start using it

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

according to my testing here https://github.com/riptano/cndb/issues/14247#issuecomment-2943230825 JVector 4.0.0.beta1 shipped with the March release does not support format 4 and at that time the default version was DC

we can map format 4 only to ED or later

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for catching this! You're right, my change is off-by-one

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is fixed now, please take a look.

Copy link

sonarqubecloud bot commented Jun 6, 2025

@cassci-bot
Copy link

❌ Build ds-cassandra-pr-gate/PR-1786 rejected by Butler


1 new test failure(s) in 3 builds
See build details here


Found 1 new test failures

Test Explanation Branch history Upstream history
o.a.c.u.b.BinLogTest.testTruncationReleasesLogS... regression 🔴🔴🔴 🔵🔵🔵🔵🔵🔵🔵

Found 7 known test failures

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants