SpellRight › Spelling
Raretokenize
The correct spelling is tokenize.
How to pronounce tokenize
verb
IPA: /ˈtoʊ.kən.aɪz/
Say it like: Tok-eni-ze
The correct spelling is tokenize. To reduce to a set of tokens by lexical analysis.
Usage Examples
No usage examples in context are available for this word.
Definition
verb
- 1.To reduce to a set of tokens by lexical analysis.
- 2.To substitute sensitive data with meaningless placeholders.
- 3.To treat as a token minority.
Similar words
Words related in meaning — check their spelling too.