You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If one passes downcase: true option then tokenizer upcases first letter of each contraction. I'd expect that case for contractions is preserved, not upcased (the same as for other words)
The text was updated successfully, but these errors were encountered:
If one passes
downcase: true
option then tokenizer upcases first letter of each contraction. I'd expect that case for contractions is preserved, not upcased (the same as for other words)The text was updated successfully, but these errors were encountered: