Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DOCS]: Add wording to Text splitting & Chunking Preferences to explain current strategy #1447

Open
chrisn-au opened this issue May 18, 2024 · 1 comment
Labels
documentation Improvements or additions to documentation

Comments

@chrisn-au
Copy link

Description

Team, great project thx. Just getting up to speed. I have been struggling with understanding the appropriate strategy for chunking for my data. While I have no doubt there is a plan to add alternative chunking strategies in the short term I wanted to check you are ok with me doing a pull request to add some wording to the ext splitting & Chunking Preferences tab to explain that it uses LangChain's RecursiveCharacterTextSplit and a link to an explanation of that strategy - I am happy to do the pull request. Again awesome project - well done

@chrisn-au chrisn-au added the documentation Improvements or additions to documentation label May 18, 2024
@timothycarambat
Copy link
Member

I think a small link in the UI would be appropriate, but moreso a new page on a new page in the https://docs.useanything.com/anythingllm-setup/embedder-configuration/overview page to explain more would be the best solution.

Those docs are open source so lengthy or wordy descriptions should for sure be offloaded there! https://github.com/Mintplex-Labs/anythingllm-docs

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

2 participants