Home
last modified time | relevance | path

Searched refs:codepoint_ranges_ (Results 1 – 2 of 2) sorted by relevance

/aosp_15_r20/external/libtextclassifier/native/utils/
H A Dtokenizer.cc43 codepoint_ranges_.emplace_back(range->UnPack()); in Tokenizer()
47 codepoint_ranges_.begin(), codepoint_ranges_.end(), in Tokenizer()
64 codepoint_ranges_.begin(), codepoint_ranges_.end(), codepoint, in FindTokenizationRange()
78 if (it != codepoint_ranges_.end() && (*it)->start <= codepoint && in FindTokenizationRange()
H A Dtokenizer.h139 codepoint_ranges_; variable