Searched refs:tokenize_function (Results 1 – 1 of 1) sorted by relevance
28 def tokenize_function(examples): function31 tokenized_datasets = dataset.map(tokenize_function, batched=True)