| |||
| лексический анализ текста (Alex_Odeychuk) | |||
| лексемизация (разбор данных на лексемы Alex_Odeychuk) | |||
| разметка (" In text mining or Full-Text Search, the process of identifying meaningful units within strings, either at word boundaries, morphemes, or stems, so that related tokens can be grouped. For example, although "San Francisco" is two words, it could be treated as a single token.") | |||
| выделение базовых элементов (ssn) | |||
токенизация (лексический анализ текста  jump-marketing.ru, habr.com bojana) | |||
|
tokenization : 4 Phrasen in 3 Thematiken |
| Digitale Währungen, Kryptowährungen, Blockchain | 1 |
| Finanzen | 1 |
| Künstliche Intelligenz | 2 |