Searched refs:token_alignment (Results 1 – 1 of 1) sorted by relevance
43 const std::unordered_map<CodepointIndex, CodepointIndex>& token_alignment, in MapCodepointToTokenPaddingIfPresent() argument45 const auto it = token_alignment.find(start); in MapCodepointToTokenPaddingIfPresent()46 if (it != token_alignment.end()) { in MapCodepointToTokenPaddingIfPresent()