New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

文本中的换行（\n）很否自动去掉 #42

Open

liuzhen6835 opened this issue Jan 22, 2019 · 1 comment

liuzhen6835 commented Jan 22, 2019

如果是一个字符串，可以提前把 \n去掉，但是在一个文本中，比如text中，那就需要把text全部读出来，去掉\n在进行分词，很消耗内存。在文本中一个词中间换行，应该很常见的。

Owner

hankcs commented Jan 22, 2019

如果去掉\n，highlighter就会对不齐。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment