Home
last modified time | relevance | path

Searched refs:model_parallel_size (Results 1 – 2 of 2) sorted by relevance

/aosp_15_r20/external/executorch/examples/models/llama/
H A Dllama_transformer.py271 model_parallel_size = 1
272 self.n_local_heads = self.n_heads // model_parallel_size
273 self.n_local_kv_heads = self.n_kv_heads // model_parallel_size
/aosp_15_r20/external/pytorch/test/distributed/_composable/test_composability/
H A Dtest_2d_composability.py392 def init_model(self, device_type, model_parallel_size=2): argument
403 (world_size // model_parallel_size, model_parallel_size),