-
Notifications
You must be signed in to change notification settings - Fork 132
Description
Describe the bug
I'm following the instruction in https://docs.rapids.ai/api/cuvs/nightly/cuvs_bench/#end-to-end-large-scale-benchmarks-10m-vectors to run cuVS Bench with Deep-100M dataset.
Steps/Code to reproduce bug
- conda create --name cuvs_benchmarks_deep100m
- conda activate cuvs_benchmarks_deep100m
- conda install -c rapidsai -c conda-forge cuvs-bench=25.08 cuda-version=13.0*
- conda install -c rapidsai -c conda-forge cuvs-bench=25.08 cuda-version=12.0*
- python3 -m cuvs_bench.run --dataset deep-1B --algorithms cuvs_cagra --batch-size 10 -k 10
The deep dataset was downloaded manually and the groundtruth file was split into two files per the instructions in the cuVS Bench documentation.
Expected behavior
The graphs should get generated. After that, the Search should be successful. But, I find that the graph construction is stuck for a long time. I waited for > 24 hrs and step# 5 seems to be hung. From quick debugging, I found the kernel kern_sort
is continuously running.
Environment details (please complete the following information):
- Environment location: [Bare-metal, Docker, Cloud(specify cloud provider)]
- Method of RAFT install: [conda, Docker, or from source]
- If method of install is [Docker], provide
docker pull
&docker run
commands used
GPU : A100 80GB.
CUDA ver: 13.0
Driver Version: 580.82.07
Installation method: Conda
Environment: Bare Metal
- If method of install is [Docker], provide
Additional context
Add any other context about the problem here.
The Deep-100M dataset was working with the former RAFT Bench.
Metadata
Metadata
Assignees
Labels
Type
Projects
Status