Langchain-Chatchat向量检索方式

[zixiaotan21]

有点好奇Langchain-chatchat 的向量检索方式。
方法上，在程序中是采用倒排召回还是向量召回？
过程中，使用的是单路召回还是多路召回？

[dosubot]

Langchain-Chatchat utilizes vector retrieval for indexing local knowledge and converting questions into vectors, aiming to meet semantic search requirements. It doesn't explicitly mention the use of inverted indexing or vector recall methods in the documentation. However, the configuration VECTOR_SEARCH_TOP_K = 3 suggests a multi-path recall approach during vector retrieval, indicating that the system considers multiple potential matches by retrieving the top 3 vectors closest to the query vector. This setup implies a focus on enhancing the relevance and accuracy of the search results by evaluating several possible answers.

Details

Sources

• index.faiss和index.pkl这两个文件的具体作用是什么
• 如何选择Retriever
• 多路检索
• 如何提高知识库检索的正确性？
• 希望使用cosine sim来计算相似度，应该怎么用
• knowledge_base/samples/content/test_files/langchain-ChatGLM_closed.jsonl
• configs/kb_config.py.example
• server/agent/tools/search_knowledgebase_complex.py
• knowledge_base/samples/content/test_files/langchain-ChatGLM_open.jsonl
• server/reranker/reranker.py
• server/embeddings_api.py

About Dosu
This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

To continue the conversation, mention @dosu.

[zixiaotan21]

@dosu, 根据问题#3563的回答，现在是不支持多路检索/多路召回吗？
@zRzRzRzRzRzRzR 维护者你好，现在的版本是仍然不支持吗，之后的0.3版本考虑更新吗？

[dosubot]

Langchain-Chatchat currently supports multi-path retrieval/recall as indicated by its configuration to retrieve the top 3 most similar vectors for a given query. This setup allows the system to consider multiple potential matches, enhancing the relevance and accuracy of search results. The knowledge_base_chat function further processes these retrieved documents, potentially using a re-ranker to refine the selection based on relevance.

As for the upcoming 0.3 version and specific plans regarding the implementation or improvement of multi-path retrieval/recall, there's no publicly documented information available in the repository. For more detailed insights or future plans about multi-path retrieval/recall in Langchain-Chatchat, it might be beneficial to directly reach out to the maintainers.

@zrzrzrzrzrzrzrzr, could you provide more details on whether multi-path retrieval/recall will be supported or enhanced in the upcoming 0.3 version?

Details

Sources

• 如何提升知识库对话文档检索的准确率
• 多路检索
• 如何提高知识库检索的正确性？
• server/api.py
• server/chat/knowledge_base_chat.py
• configs/kb_config.py.example
• server/agent/custom_agent/ChatGLM3Agent.py
• server/chat/search_engine_chat.py

About Dosu
This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

To continue the conversation, mention @dosu.