Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add temperature sanity check as 0 is invalid (#1211)
A user was passing 0 and this results in a divide by zero in the SoftMax calculation, which results in +INF/NaN floating point results that are not obviously caused by a zero temperature. This lets users know at token selection time that the current temperature is invalid.
- Loading branch information