Home
last modified time | relevance | path

Searched refs:has_non_empty_token (Results 1 – 1 of 1) sorted by relevance

/external/tflite-support/tensorflow_lite_support/cc/text/tokenizers/
Dregex_tokenizer.cc74 bool has_non_empty_token = token.length() > 0; in Tokenize() local
79 if (has_non_empty_token) { in Tokenize()