[[- PyTorch -]] #### Dataloader - Number of Workers 'num_workers' - Controls how many subprocesses are created to lead data in parallel, $0$ means data is only loaded in main process. - Heuristic - set num of workers to approx number of CPU cores - Large datasets and/or datasets with many complicated transformations can benefit from more workers