Searched refs:NormalizeString (Results 1 – 3 of 3) sorted by relevance
| /external/tflite-support/tensorflow_lite_support/custom_ops/kernel/sentencepiece/ |
| D | optimized_encoder_test.cc | 75 const auto [res_string, offsets] = NormalizeString("x y", *config); in TEST()
80 const auto [res_string, offsets] = NormalizeString("\tx y\n", *config); in TEST()
106 NormalizeString("ABAABAAABAAAA", *config); in TEST()
134 NormalizeString("XXABAABAAABAAAA", *config); in TEST()
|
| D | optimized_encoder.h | 39 std::tuple<std::string, std::vector<int>> NormalizeString(
|
| D | optimized_encoder.cc | 94 std::tuple<std::string, std::vector<int>> NormalizeString( in NormalizeString() function
231 std::tie(normalized_string, offsets) = NormalizeString(string, *config); in EncodeString()
|