Searched defs:first_output_token (Results 1 – 2 of 2) sorted by relevance
224 const auto first_output_token = argmax(logits_type, logits, vocab_size); in digest_prompt() local317 const auto first_output_token = prefill_res.get(); in inference() local
233 const auto first_output_token = argmax(logits_type, logits, vocab_size); in digest_prompt() local325 const auto first_output_token = prefill_res.get(); in inference() local