 |
| |||
токенизация (лексический анализ текста  jump-marketing.ru, habr.com bojana) | |||
| разметка (" In text mining or Full-Text Search, the process of identifying meaningful units within strings, either at word boundaries, morphemes, or stems, so that related tokens can be grouped. For example, although "San Francisco" is two words, it could be treated as a single token.") | |||
| лексический анализ текста (Alex_Odeychuk) | |||
| выделение базовых элементов (ssn) | |||
| лексемизация (разбор данных на лексемы Alex_Odeychuk) | |||
|
tokenization : 4 短语, 3 学科 |
| 人工智能 | 2 |
| 数字货币、加密货币、区块链 | 1 |
| 财政 | 1 |