Searched refs:token_match_start (Results 1 – 1 of 1) sorted by relevance
90 std::unordered_map<CodepointIndex, CodepointIndex> token_match_start; in SortedSymbolsForInput() local96 token_match_start[token_start] = prev_token_end; in SortedSymbolsForInput()159 MapCodepointToTokenPaddingIfPresent(token_match_start, span.first), in SortedSymbolsForInput()173 MapCodepointToTokenPaddingIfPresent(token_match_start, in SortedSymbolsForInput()