Home
last modified time | relevance | path

Searched defs:token_text (Results 1 – 7 of 7) sorted by relevance

/aosp_15_r20/external/libtextclassifier/native/utils/
H A Dtokenizer-utils.h79 const std::string token_text = UnicodeText::UTF8Substring(start_it, it); in TokenizeWithFilter() local
96 const std::string token_text = in TokenizeWithFilter() local
/aosp_15_r20/external/libtextclassifier/native/annotator/number/
H A Dnumber.cc199 bool NumberAnnotator::TryParseNumber(const UnicodeText& token_text, in TryParseNumber()
236 const UnicodeText token_text = in FindAll() local
/aosp_15_r20/external/icing/icing/query/advanced_query_parser/
H A Dlexer.cc191 std::string token_text(raw_token_text); in ConsumeStringLiteral() local
/aosp_15_r20/external/libtextclassifier/native/annotator/pod_ner/
H A Dpod-ner-impl.cc359 const std::string token_text = in PrepareText() local
/aosp_15_r20/external/pytorch/torch/csrc/jit/frontend/
H A Dsource_range.h323 const c10::string_view token_text() const { in token_text() function
/aosp_15_r20/external/grpc-grpc/third_party/upb/upb/io/
H A Dtokenizer.c137 upb_String token_text; member
/aosp_15_r20/external/rust/android-crates-io/crates/grpcio-sys/grpc/third_party/upb/upb/io/
Dtokenizer.c157 upb_String token_text; member