Skip to content
Back to pull request #433

Ensure tokenizer sizers with truncation parameters count their overflow encodings #644

Sign in to view logs

Ensure tokenizer sizers with truncation parameters count their overflow encodings

Ensure tokenizer sizers with truncation parameters count their overflow encodings #644

MSRV (1.75.0)

MSRV (1.75.0)
succeeded Oct 25, 2024 in 40s