Home
last modified time | relevance | path

Searched refs:CodepointSpanToTokenSpan (Results 1 – 4 of 4) sorted by relevance

/external/libtextclassifier/annotator/
Dfeature-processor_test.cc944 TEST_F(FeatureProcessorTest, CodepointSpanToTokenSpan) { in TEST_F() argument
950 EXPECT_EQ(TokenSpan(0, 1), CodepointSpanToTokenSpan(tokens, {0, 5})); in TEST_F()
951 EXPECT_EQ(TokenSpan(1, 2), CodepointSpanToTokenSpan(tokens, {6, 23})); in TEST_F()
952 EXPECT_EQ(TokenSpan(2, 3), CodepointSpanToTokenSpan(tokens, {24, 29})); in TEST_F()
953 EXPECT_EQ(TokenSpan(0, 2), CodepointSpanToTokenSpan(tokens, {0, 23})); in TEST_F()
954 EXPECT_EQ(TokenSpan(1, 3), CodepointSpanToTokenSpan(tokens, {6, 29})); in TEST_F()
955 EXPECT_EQ(TokenSpan(0, 3), CodepointSpanToTokenSpan(tokens, {0, 29})); in TEST_F()
958 EXPECT_EQ(TokenSpan(0, 1), CodepointSpanToTokenSpan(tokens, {0, 5}, true)); in TEST_F()
959 EXPECT_EQ(TokenSpan(1, 2), CodepointSpanToTokenSpan(tokens, {6, 23}, true)); in TEST_F()
960 EXPECT_EQ(TokenSpan(2, 3), CodepointSpanToTokenSpan(tokens, {24, 29}, true)); in TEST_F()
[all …]
Dfeature-processor.cc334 TokenSpan CodepointSpanToTokenSpan(const std::vector<Token>& selectable_tokens, in CodepointSpanToTokenSpan() function
393 CodepointSpanToTokenSpan(selectable_tokens, span); in CenterTokenFromClick()
420 CodepointSpanToTokenSpan(selectable_tokens, span); in CenterTokenFromMiddleOfSelection()
Dfeature-processor.h76 TokenSpan CodepointSpanToTokenSpan(
Dannotator.cc1233 CodepointSpanToTokenSpan(*tokens, selection_indices); in ModelClassifyText()