Home
last modified time | relevance | path

Searched refs:internal_tokenizer_codepoint_ranges_ (Results 1 – 4 of 4) sorted by relevance

/aosp_15_r20/external/libtextclassifier/native/utils/
H A Dtokenizer.cc54 &internal_tokenizer_codepoint_ranges_); in Tokenizer()
214 internal_tokenizer_codepoint_ranges_)) { in InternalRetokenize()
H A Dtokenizer.h145 std::vector<CodepointRangeStruct> internal_tokenizer_codepoint_ranges_; variable
/aosp_15_r20/out/soong/.intermediates/external/libtextclassifier/native/libtextclassifier_fbgen_annotator_model/gen/annotator/
Dmodel_generated.h6254internal_tokenizer_codepoint_ranges_ : o.internal_tokenizer_codepoint_ranges) { internal_tokenizer… in GrammarTokenizerOptionsT() local
7098internal_tokenizer_codepoint_ranges_ : o.internal_tokenizer_codepoint_ranges) { internal_tokenizer… in FeatureProcessorOptionsT() local
/aosp_15_r20/out/soong/.intermediates/external/libtextclassifier/native/libtextclassifier_fbgen_actions_actions_model/gen/actions/
Dactions_model_generated.h3515internal_tokenizer_codepoint_ranges_ : o.internal_tokenizer_codepoint_ranges) { internal_tokenizer… in ActionsTokenizerOptionsT() local