AI & LLMs

You have 50M embeddings, need p99 under 50ms, and 95% recall is acceptable. Which vector index do you choose?

Vector index choice is a three-way trade between recall, latency and memory. At tens of millions of vectors with a tight latency budget and tolerance for approximate results, HNSW with quantization is the standard answer: exact search cannot meet the latency, and unquantized HNSW cannot meet the memory budget affordably.