Searched refs:SplitTokensOnSelectionBoundaries (Results 1 – 3 of 3) sorted by relevance
/external/libtextclassifier/annotator/ |
D | feature-processor_test.cc | 91 internal::SplitTokensOnSelectionBoundaries({9, 12}, &tokens); in TEST_F() 108 internal::SplitTokensOnSelectionBoundaries({6, 12}, &tokens); in TEST_F() 124 internal::SplitTokensOnSelectionBoundaries({9, 23}, &tokens); in TEST_F() 140 internal::SplitTokensOnSelectionBoundaries({6, 23}, &tokens); in TEST_F() 155 internal::SplitTokensOnSelectionBoundaries({2, 9}, &tokens); in TEST_F()
|
D | feature-processor.h | 52 void SplitTokensOnSelectionBoundaries(CodepointSpan selection,
|
D | feature-processor.cc | 85 void SplitTokensOnSelectionBoundaries(CodepointSpan selection, in SplitTokensOnSelectionBoundaries() function 689 internal::SplitTokensOnSelectionBoundaries(input_span, tokens); in RetokenizeAndFindClick()
|