Searched refs:BuildTokenizer (Results 1 – 2 of 2) sorted by relevance
44 Tokenizer BuildTokenizer(const FeatureProcessorOptions* options,98 tokenizer_(internal::BuildTokenizer(options, unilib)) { in FeatureProcessor()
31 Tokenizer BuildTokenizer(const FeatureProcessorOptions* options, in BuildTokenizer() function