Microsoft.DeepDev.TokenizerLib 1.3.2 Release
You can find the published NuGet package here.
You can find the Tokenizer.exe in the attached Tokenizer.zip.
To run performance benchmark, you can download the attached PerfBenchmark.zip.
You can find the published NuGet package here.
You can find the Tokenizer.exe in the attached Tokenizer.zip.
To run performance benchmark, you can download the attached PerfBenchmark.zip.