# Pipeline Parallelism for PyTorch

`torch.distributed.pipelining` is a package for implementing pipeline parallelism on your model.

Our documentation is available [here](https://pytorch.org/docs/main/distributed.pipelining.html).

![pipeline_diagram_web](https://github.com/pytorch/PiPPy/assets/6676466/c93e2fe7-1cd4-49a2-9fd8-231ec9905e0c)