Home
last modified time | relevance | path

Searched defs:add_eos (Results 1 – 4 of 4) sorted by relevance

/external/tflite-support/tensorflow_lite_support/custom_ops/python/
Dsentencepiece_tokenizer.py36 def __init__(self, model, reverse=False, add_bos=False, add_eos=False): argument
/external/tflite-support/tensorflow_lite_support/custom_ops/kernel/sentencepiece/
Doptimized_encoder.cc147 bool add_eos, bool reverse) { in EncodeNormalizedString()
221 bool add_bos, bool add_eos, bool reverse) { in EncodeString()
Dsentencepiece_tokenizer_op.cc76 const bool add_eos = add_eos_tensor.scalar<bool>()(); in Compute() local
Dsentencepiece_tokenizer_tflite.cc80 const bool add_eos = add_eos_tensor.data.b[0]; in Eval() local