Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Changes made are as follows: - Reference to PyThaiNLP's dictionary-based tokenizer instead of `ssg`, due to the syllable-level tokenizer used in the current release (v1.0; 24 Jan 2021) is PyThaiNLP's dictionary-based tokenizer (newmm).
- Loading branch information