Searched refs:layer_scale_init_value (Results 1 – 1 of 1) sorted by relevance
49 def __init__(self, dim, drop_path=0.0, layer_scale_init_value=1e-6): argument64 layer_scale_init_value * torch.ones((dim, 1, 1)), requires_grad=True66 if layer_scale_init_value > 0126 layer_scale_init_value=1e-6, argument147 layer_scale_init_value=layer_scale_init_value,