Searched refs:WordpieceTokenizerResult (Results 1 – 4 of 4) sorted by relevance
62 WordpieceTokenizerResult BertTokenizer::TokenizeWordpiece( in TokenizeWordpiece()64 WordpieceTokenizerResult result; in TokenizeWordpiece()
53 struct WordpieceTokenizerResult : TokenizerResult { struct117 WordpieceTokenizerResult TokenizeWordpiece(const std::string& input);
74 WordpieceTokenizerResult result; in Tokenize()
49 struct WordpieceTokenizerResult struct