[Enhancement]: [caching layer] In the default configuration, the FLAT/BIN_FLAT index will be lazy loaded and the data will be loaded to disk

[wangting0128]

Is there an existing issue for this?

• I have searched the existing issues

What would you like to be added?

Current behavior differences between 2.5 and 2.6

Why is this needed?

Need to ensure consistent behavior between 2.5 and 2.6

Anything else?

No response

[xiaofan-luan]

For FLAT and BIN_FLAT index, we don't need to load the raw data.

querynNode.mmap.vectorField should be consistent with HNSW and other index by default

[wangting0128]

For FLAT and BIN_FLAT index, we don't need to load the raw data.

querynNode.mmap.vectorField should be consistent with HNSW and other index by default

Please help confirm the current behavior
@zhengbuqian

[zhengbuqian]

@xiaofan-luan For FLAT and BIN_FLAT index, there is no index, and we load the raw data only and use that as the index. so those data are loaded like raw data when using HNSW, but should be treated as index.

[xiaofan-luan]

understand, this is the actual IVF index but only has reference id instead of the vector itself

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

[wangting0128]

keep it open