Tag Archives: tokenization

Adding white space to Chinese text : )

One of the key challenges in learning Chinese is that there is no white space in Chinese text. You have to visually identify words and when you don’t know many words this is particularly difficult. This is what Chinese text … Continue reading

Posted in Uncategorized | Tagged , , , , | 2 Comments