Skip to content

feat(turbo): add OPQ preprocessor - #717

Open
zzlin237 wants to merge 5 commits into
alibaba:mainfrom
zzlin237:refactor/turbo_opq
Open

feat(turbo): add OPQ preprocessor #717
zzlin237 wants to merge 5 commits into
alibaba:mainfrom
zzlin237:refactor/turbo_opq

Conversation

@zzlin237

@zzlin237 zzlin237 commented Sep 1, 2026

Copy link
Copy Markdown
Collaborator

The OPQ feature has been added to the Turbo Quantizer, with specific results as follows (recall/qps):

Sift

case ef32 ef64 ef128
pq_int4 0.474/5768 0.480/5258 0.480/4191
opq_pq_int4 0.466/5618 0.469/4935 0.470/3835
pq_int8 0.762/5065 0.773/4335 0.773/3508
opq_pq_int8 0.687/5206 0.689/4595 0.695/3686

Gist

case ef32 ef64 ef128
pq_int4 0.380/3760 0.401/3125 0.405/2250
opq_pq_int4 0.616/2175 0.652/1900 0.668/1572
pq_int8 0.683/1864 0.735/1637 0.755/1262
opq_pq_int8 0.712/1513 0.757/1340 0.782/1130

m=32, ef_construction=200, num_chunk=dim/4

# Conflicts:
#	src/turbo/quantizer/pq_fast_quantizer/pq_fast_quantizer.cc
#	src/turbo/quantizer/pq_fast_quantizer/pq_fast_quantizer.h
#	src/turbo/quantizer/pq_int4_quantizer/pq_int4_quantizer.cc
#	src/turbo/quantizer/pq_int4_quantizer/pq_int4_quantizer.h
#	src/turbo/quantizer/pq_int8_quantizer/pq_int8_quantizer.cc
#	src/turbo/quantizer/pq_int8_quantizer/pq_int8_quantizer.h
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant