# PyTorch

```{toctree}
:hidden:

general
state_dict
mixed_precision
distributed_data_parallel
ddp_under_the_hood
dp_ddp
fsdp
tensor_parallelism
pipeline_parallelism
device_mesh
```

- [PyTorch General](general.md)
- [Mixed Precision](mixed_precision.md)
- [Distributed data parallel](distributed_data_parallel.md)
- [DDP under the hood](ddp_under_the_hood.md)
- [DP vs DDP](dp_ddp.md)
- [FSDP](fsdp.md)
- [Tensor Parallelism](tensor_parallelism.md)
- [Pipeline Parallelism](pipeline_parallelism.md)
- [Device Mesh](device_mesh.md)