I’ve been using SageMaker for a while and have performed several experiments already with distributed training. I am wondering if it is possible to test and run SageMaker distributed training in local mode (using SageMaker Notebook Instances)?
No, not possible yet. local mode does not support the distributed training with
local_gpufor Gzip compression, Pipe Mode, or manifest files for inputs