Home
last modified time | relevance | path

Searched refs:kSpaceSymbol (Results 1 – 4 of 4) sorted by relevance

/external/libtextclassifier/native/utils/sentencepiece/
Dnormalizer.cc57 const StringPiece kSpaceSymbol = "\xe2\x96\x81"; in Normalize() local
65 normalized_input->append(kSpaceSymbol.data(), kSpaceSymbol.size()); in Normalize()
94 normalized_input->append(kSpaceSymbol.data(), kSpaceSymbol.size()); in Normalize()
108 const StringPiece space = escape_whitespaces_ ? kSpaceSymbol : " "; in Normalize()
/external/tflite-support/tensorflow_lite_support/custom_ops/kernel/sentencepiece/
Dsentencepiece_constants.h31 constexpr char kSpaceSymbol[] = "\xe2\x96\x81"; variable
Doptimized_encoder.cc30 const char kSpaceSymbol[] = "\xe2\x96\x81"; variable
133 return std::make_tuple(1, utils::string_view(kSpaceSymbol)); in NormalizeString()
Dmodel_converter.cc147 absl::StrReplaceAll(piece.piece(), {{kSpaceSymbol, " "}})); in ConvertSentencepieceModelToFlatBufferForDecoder()