Searched defs:QuantizedKVCache (Results 1 – 2 of 2) sorted by relevance
30 class QuantizedKVCache(nn.Module): class
25 kv_cache: Union[KVCache, QuantizedKVCache], argument