SentenceSplitter
SentenceSplitter
from llama_index.core.node_parser import SentenceSplitter
splitter = SentenceSplitter(chunk_size=512, chunk_overlap=50)
nodes = splitter.get_nodes_from_documents(documents, show_progress=True)
print(len(nodes), nodes[0].text[:80])NodeParser 家族还有 SemanticSplitterNodeParser、HierarchicalNodeParser 等;语义类切分同样需要 embedding 模型。