# tokenize

> English word · Verb · IPA /ˈtoʊ.kən.aɪz/

## Definitions
1. To reduce to a token or set of tokens by lexical analysis.
2. To substitute sensitive data with meaningless placeholders.
3. To treat as a token minority.

## Etymology
From token + -ize.

## Source
Compiled from Wiktionary via kaikki.org (CC BY-SA). Data vintage: 2026-05-06.
Canonical page: https://plainspell.com/en/word/tokenize