How to install smdistributed?

[rohan-varma]

What did you find confusing? Please describe.
I installed sagemaker with pip install sagemaker --update, and am attempting to use distributed model parallel with pytorch. However, I'm unable to import smdistributed.

The docs https://sagemaker.readthedocs.io/en/stable/api/training/smp_versions/v1.2.0/smd_model_parallel_pytorch.html don't have installation instructions for smdistributed. I was wondering how do I get smdistributed installed? Thank you!

I am also looking at https://docs.amazonaws.cn/en_us/sagemaker/latest/dg/model-parallel-customize-training-script-pt.html which directs me to https://sagemaker.readthedocs.io/en/stable/api/training/smp_versions/v1.2.0/smd_model_parallel_common_api.html#smp.init to initialize the sagemaker distributed environment. But again I'm not sure how to get the smdistributed library.

https://github.com/aws/amazon-sagemaker-examples has some smdistributed examples but doesn't provide any clear installation instructions. environment.yml in that repo seems to indicate all that's needed is sagemaker which I have installed.

Describe how documentation can be improved
Could not find clear installation instructions for smdistributed, would it be possible to add these?

Additional context
Add any other context or screenshots about the documentation request here.

[juliensimon]

Hi,

the easiest way is to either use or start from one of the built-in TensorFlow/PyTorch containers.

You can also build your own, starting from the SageMaker Training Toolkit at https://github.com/aws/sagemaker-training-toolkit.

More details at https://docs.aws.amazon.com/sagemaker/latest/dg/model-parallel-use-api.html
and https://docs.aws.amazon.com/sagemaker/latest/dg/data-parallel-use-api.html

[TEChopra1000]

Note: SageMaker distributed is not currently supported in the Chinese regions. I'm adding this note because I see that you've pointed to a doc in the China region.

[rohan-varma]

Note: SageMaker distributed is not currently supported in the Chinese regions. I'm adding this note because I see that you've pointed to a doc in the China region.

I see, I'm actually not sure why I ended up at a .cn link. I think google somehow directed me to the .cn domain when I entered in my search query