Searched defs:use_kv_cache (Results 1 – 5 of 5) sorted by relevance
26 bool use_kv_cache, in TextDecoderRunner()
20 bool use_kv_cache, in TextPrefiller()
26 bool use_kv_cache, in TextTokenGenerator()
71 use_kv_cache, argument
96 use_kv_cache: bool = False # Use key/value cache variable in ModelArgs