Amazon SageMaker model parallel library now accelerates PyTorch FSDP workloads by up to 20%
AWS Machine Learning
DECEMBER 22, 2023
Customers are now pre-training and fine-tuning LLMs ranging from 1 billion to over 175 billion parameters to optimize model performance for applications across industries, from healthcare to finance and marketing. For more information on how to enable SMP with your existing PyTorch FSDP training scripts, refer to Get started with SMP.
Let's personalize your content