Skip to content

v0.14.13
Compare
Choose a tag to compare
@jasonacox jasonacox released this 29 Aug 03:21
· 41 commits to main since this release
v0.14.13
c766f45

0.14.13 - TPS Calculation

  • Chatbot: Fix a bug that was counting null tokens.

0.14.12 - Toxic Filter

  • Chatbot: Add toxic filter option (uses environmental variable TOXIC_THRESHOLD) to analyze and filter out bad prompts. Uses LLM to evaluate and score prompt. Set variable between 0 and 1 or 99 to disable (default).
  • Chatbot: Add EXTRA_BODY variable (JSON string) to customize chat completion calls.

0.14.11 - OpenAI Support

  • Chatbot: Add logic to detect OpenAI URL and disable non-OpenAI stop_token_ids.

Full Changelog: v0.14.10...v0.14.13

Assets 2
Loading