Home
last modified time | relevance | path

Searched refs:token_unicode (Results 1 – 1 of 1) sorted by relevance

/external/libtextclassifier/utils/
Dtoken-feature-extractor.cc110 UnicodeText token_unicode = in ExtractDenseFeatures() local
112 const bool is_upper = unilib_.IsUpper(*token_unicode.begin()); in ExtractDenseFeatures()
141 UnicodeText token_unicode = in ExtractDenseFeatures() local
148 auto matcher = regex_patterns_[i]->Matcher(token_unicode); in ExtractDenseFeatures()