Searched refs:clean_up_tokenization_spaces (Results 1 – 3 of 3) sorted by relevance
663 clean_up_tokenization_spaces: bool = None,674 clean_up_tokenization_spaces = (675 clean_up_tokenization_spaces676 if clean_up_tokenization_spaces is not None677 else self.clean_up_tokenization_spaces679 if clean_up_tokenization_spaces:
174 clean_up_tokenization_spaces=False, argument220 clean_up_tokenization_spaces=clean_up_tokenization_spaces,
87 clean_up_tokenization_spaces=False,