splitter.py

Functions

chunk_doc_to_docs(documents: list, extension: str = '.md', min_size: int = 800, vector_name=None, **kwargs)

Turns a Document object into a list of many Document chunks. If a document or chunk is smaller than min_size, it will be merged with adjacent documents or chunks.

choose_splitter(extension: str, chunk_size: int = 1024, chunk_overlap: int = 200, vector_name: str = None)

No docstring available.

Functions​

chunk_doc_to_docs(documents: list, extension: str = '.md', min_size: int = 800, vector_name=None, **kwargs)​

choose_splitter(extension: str, chunk_size: int = 1024, chunk_overlap: int = 200, vector_name: str = None)​

Functions

chunk_doc_to_docs(documents: list, extension: str = '.md', min_size: int = 800, vector_name=None, **kwargs)

choose_splitter(extension: str, chunk_size: int = 1024, chunk_overlap: int = 200, vector_name: str = None)