Skip to content

v0.9.4
Compare
Choose a tag to compare
@soldni soldni released this 21 Jan 03:34
· 75 commits to main since this release
v0.9.4
a44489f
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

What's Changed

  • Bump h2 from 0.3.20 to 0.3.24 by @dependabot in #101
  • BOS/EOS/PAD options in tokens cli; speed up tokenization by segmenting paragraphs. by @soldni in #102
  • Fixed Dangling CLI Options; E2E Tokenizer Tests by @soldni in #103

Full Changelog: v0.9.2...v0.9.4

Contributors

soldni and dependabot
Assets 2
Loading