Serialize Vamana index with SSD sector alignment per MSFT DiskANN format, generate quantized dataset for integration with DiskANN #846
Conversation
|
Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually. Contributors can view more details about this message here. |
|
/ok to test d0aabc6 |
…na_serialize_quantize_build
|
@jamxia155 I sincerely apologize for the delayed response here. We had some critical issues for release 25.06 that took several folks from the team over a week to resolve. Good news is that the release is now complete and we're available to help with timely reviews and guidance. I notice the last several commits are related to the cmake download of the test files. These will need to work both locally for users, as well as in CI. Are they working locally for you? |
Hi @cjnolet, those changes worked locally for me but are not working in the CI yet. However, I have since received helpful guidance from @bdice on the pattern that's currently used in cuGraph and I think I have a good handle on what needs to be done now. Thanks. |
…ntize_build' into jamxia_vamana_serialize_quantize_build
|
Approving binary size addition to |
…na_serialize_quantize_build
(This supersedes PR!703)
Added an optional input flag to
cuvs::neighbors::vamana::serializeto dump an input cuvs Vamana index to file with SSD sector alignment. File format follows MSFT DiskANN.Using the sector-aligned option also writes out the quantized dataset computed using user-supplied PQ codebooks file and rotation matrix file.