Skip to content

Commit

Permalink
Fix docs
Browse files Browse the repository at this point in the history
  • Loading branch information
kg583 committed May 29, 2024
1 parent 915d0a4 commit 6512ef1
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tivars/tokenizer/encoder.py
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ def encode(string: str, *,
:param string: The text string to encode
:param trie: The `TokenTrie` object to use for tokenization
:param mode: The tokenization mode to use (defaults to ``smart``)
:param normalize: Whether to apply NFKC normalization to the input before encoding (defaults to ``true``)
:param normalize: Whether to apply NFC normalization to the input before encoding (defaults to ``true``)
:return: A tuple of a stream of token bytes and a minimum `OsVersion`
"""

Expand Down

0 comments on commit 6512ef1

Please sign in to comment.