Skip to content
Lint

Fix bug in Longest Matching tokenizer to preprocess spaces consistently #1948

Sign in to view logs

Fix bug in Longest Matching tokenizer to preprocess spaces consistently

Fix bug in Longest Matching tokenizer to preprocess spaces consistently #1948

Triggered via pull request January 10, 2025 15:02
@wannaphongwannaphong
opened #1062
wannaphong/fix-tokenizer
Status Success
Total duration 2m 50s
Artifacts –

lint.yml

on: pull_request
ruff
7s
ruff
Fit to window
Zoom out
Zoom in

Annotations

1 warning
ruff
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636