|
res = self.model.encode(raw_text, show_progress_bar=False) |
When using faiss for candidate example selection, the vector inner product distance is the closest. Why not use cosine similarity? The embedding is not normalized, and the calculation results using the inner product will be affected by the vector modulus. Should it be modified to:
res = self.model.encode(raw_text, show_progress_bar=False, normalize_embeddings=True)
OpenICL/openicl/icl_retriever/icl_topk_retriever.py
Line 113 in 1613ae1
When using faiss for candidate example selection, the vector inner product distance is the closest. Why not use cosine similarity? The embedding is not normalized, and the calculation results using the inner product will be affected by the vector modulus. Should it be modified to: