Subject | French | English |
comp., MS | segmentation du texte en unités lexicales | tokenization (" In text mining or Full-Text Search, the process of identifying meaningful units within strings, either at word boundaries, morphemes, or stems, so that related tokens can be grouped. For example, although "San Francisco" is two words, it could be treated as a single token.") |
ling. | unité lexicale | lexical item |
IT, tech. | unité lexicale | lexical unit |
IT, tech. | unité lexicale | lexical token |
ling. | unité lexicale | lexeme |
IT | unité lexicale du dictionnaire | dictionary entry |