CharacterTextSplitter中的参数问题 #26936
Closed
wy371900521
started this conversation in
General
Replies: 1 comment
-
Generally going to request that questions are phrased in English. You can use chat gpt to translate to English if you want to ask a question |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
text_spliter = CharacterTextSplitter(
separator=',',
chunk_size=10,
chunk_overlap=2
)
result = text_spliter.split_text("今天天气好晴朗,处处好风光啊好风光蝴蝶儿忙啊,蜜蜂也忙,小鸟儿忙着,白云也忙")
print(result) # 运行结果 => ['今天天气好晴朗', ',处处好风光啊好风光蝴蝶儿忙啊', ',蜜蜂也忙', ',小鸟儿忙着', ',白云也忙']
其中 chunk_overlap 并没有起到作用
Beta Was this translation helpful? Give feedback.
All reactions