AWS Machine Learning

NOVEMBER 14, 2024

Customers can use the SageMaker Studio UI or APIs to specify the SageMaker Model Registry model to be shared and grant access to specific AWS accounts or to everyone in the organization. The MLE is notified to set up a model group for new model development.

Government 108

Government Management APIs Accountability 108

AWS Machine Learning

FEBRUARY 29, 2024

The AI platform managed service, built on SageMaker Studio, seamlessly aligns with Deutsche Bahn’s group-wide platform strategy. During this orchestration flow, an Azure Active Directory (AD) group for the data analytics team is provisioned with the AD group name corresponding to the domain name.

APIs 133

APIs Construction Transportation Analytics 133

AWS Machine Learning

JULY 17, 2024

In this post, we’re using the APIs for AWS Support , AWS Trusted Advisor , and AWS Health to programmatically access the support datasets and use the Amazon Q Business native Amazon Simple Storage Service (Amazon S3) connector to index support data and provide a prebuilt chatbot web experience. Synchronize the data source to index the data.

Scripts 129

Scripts APIs Enterprise Accountability 129

AWS Machine Learning

JULY 25, 2024

A document’s ACL contains information such as the user’s email address and the local groups or federated groups (if Microsoft SharePoint is integrated with an identity provider (IdP) such as Azure Active Directory/Entra ID) that have access to the document.

Scripts 118

Scripts APIs Engineering Enterprise 118

AWS Machine Learning

MAY 30, 2024

AWS Prototyping successfully delivered a scalable prototype, which solved CBRE’s business problem with a high accuracy rate (over 95%) and supported reuse of embeddings for similar NLQs, and an API gateway for integration into CBRE’s dashboards. The following diagram illustrates the web interface and API management layer.

Real estate 135

Real estate APIs Metrics Construction 135

AWS Machine Learning

SEPTEMBER 11, 2023

The solution will use Terraform to create: A VPC with subnets, security groups, as well as VPC endpoints to support VPC only mode for the SageMaker Domain. TCP traffic within the security group. This is required to communicate with the SageMaker API. A SageMaker Domain in VPC only mode with a user profile.

Scripts 130

Scripts APIs Management Best practices 130

AWS Machine Learning

MAY 23, 2024

The SMP library uses NVIDIA Megatron to implement expert parallelism and support training MoE models, and runs on top of PyTorch Fully Sharded Data Parallel (FSDP) APIs. For example, if you set the degree to 2, SMP will assign half of the eight experts to each data parallel group. In this example, we use SageMaker training jobs.

APIs 136

APIs Engineering Scripts Construction 136

AWS Machine Learning

SEPTEMBER 8, 2023

Amazon Rekognition makes it easy to add image analysis capability to your applications without any machine learning (ML) expertise and comes with various APIs to fulfil use cases such as object detection, content moderation, face detection and analysis, and text and celebrity recognition, which we use in this example.

APIs 131

APIs Scripts Entertainment Personalization 131

AWS Machine Learning

MAY 31, 2023

In such cases, data scientists have to provide these parameters to their ML model training and deployment code manually, by noting down subnets, security groups, and KMS keys. Additionally, each API call can have its own configurations. See Supported APIs and parameters for a complete list of supported API calls and parameters.

APIs 114

APIs Scripts Accountability Enterprise 114

AWS Machine Learning

DECEMBER 21, 2022

Depending on the design of your feature groups and their scale, you can experience training query performance improvements of 10x to 100x by using this new capability. SageMaker Feature Store automatically builds an AWS Glue Data Catalog during feature group creation. Creating feature groups using Iceberg table format.

Scripts 94

Scripts Engineering APIs Big data 94

AWS Machine Learning

SEPTEMBER 18, 2023

Each stage in the ML workflow is broken into discrete steps, with its own script that takes input and output parameters. Ingesting features into the feature store contains the following steps: Define a feature group and create the feature group in the feature store. See the following code: @ray.remote(num_cpus=0.5)

Scripts 134

Scripts APIs Government Construction 134

AWS Machine Learning

NOVEMBER 14, 2024

Amazon SageMaker Feature Store – Amazon SageMaker Feature Store allows you to tag your feature groups and search for feature groups using tags. You can add tags when creating a new feature group or edit the tags of an existing feature group. Use AWS Resource Groups to find noncompliant tags on account resources.

Government 116

Government Best practices Accountability APIs 116

AWS Machine Learning

FEBRUARY 13, 2024

SageMaker Feature Store now makes it effortless to share, discover, and access feature groups across AWS accounts. With this launch, account owners can grant access to select feature groups by other accounts using AWS Resource Access Manager (AWS RAM). For a deep dive, refer to Cross account feature group discoverability and access.

Accountability 134

Accountability Government Engineering Scripts 134

AWS Machine Learning

JANUARY 5, 2024

Continuous integration and continuous delivery (CI/CD) pipeline – Using the customer’s GitHub repository enabled code versioning and automated scripts to launch pipeline deployment whenever new versions of the code are committed. Wipro has used the input filter and join functionality of SageMaker batch transformation API.

Management 137

Management APIs Engineering Government 137

AWS Machine Learning

MAY 31, 2023

Triton with PyTorch backend The PyTorch backend is designed to run TorchScript models using the PyTorch C++ API. Alternatively, you can use ensemble models or business logic scripting. For instructions on how to secure your account with an IAM administrator user, see Creating your first IAM admin user and user group.

APIs 121

APIs Scripts Engineering Accountability 121

AWS Machine Learning

OCTOBER 25, 2022

Model weights are available via scripts in the GitHub repository , and the MSAs are hosted by the Registry of Open Data on AWS (RODA). We use aws-do-eks , an open-source project that provides a large collection of easy-to-use and configurable scripts and tools to enable you to provision EKS clusters and run your inference.

APIs 96

APIs Scripts Banking Engineering 96

AWS Machine Learning

APRIL 17, 2024

This solution deploys an Amazon EKS cluster with a node group that includes Inf1 instances. The AMI type of the node group is AL2_x86_64_GPU , which uses the Amazon EKS optimized accelerated Amazon Linux AMI. Solution overview The following diagram illustrates the solution architecture. or later NPM version 10.0.0

APIs 131

APIs Metrics Accountability Management 131

AWS Machine Learning

JUNE 19, 2024

The Slack application sends the event to Amazon API Gateway , which is used in the event subscription. API Gateway forwards the event to an AWS Lambda function. Create a new group and add the app BedrockSlackIntegration. The following diagram illustrates the solution architecture. Choose Save Changes.

APIs 105

APIs Engineering Accountability Scripts 105

AWS Machine Learning

MAY 8, 2023

In this post, we address these limitations by implementing the access control outside of the MLflow server and offloading authentication and authorization tasks to Amazon API Gateway , where we implement fine-grained access control mechanisms at the resource level using Identity and Access Management (IAM). Adds an IAM authorizer.

APIs 92

APIs Government Accountability Scripts 92

AWS Machine Learning

AUGUST 4, 2023

When a version of the model in the Amazon SageMaker Model Registry is approved, the endpoint is exposed as an API with Amazon API Gateway using a custom Salesforce JSON Web Token (JWT) authorizer. frameworks to restrict client access to your APIs. For API Name , leave as default (it’s automatically populated).

APIs 96

APIs Scripts Management Accountability 96

AWS Machine Learning

NOVEMBER 15, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

APIs 120

APIs Government Best practices Metrics 120

AWS Machine Learning

MARCH 23, 2023

Applications and services can call the deployed endpoint directly or through a deployed serverless Amazon API Gateway architecture. To learn more about real-time endpoint architectural best practices, refer to Creating a machine learning-powered REST API with Amazon API Gateway mapping templates and Amazon SageMaker.

Scripts 127

Scripts APIs Government Analytics 127

AWS Machine Learning

NOVEMBER 1, 2024

Dru on the backend decodes log data, deciphers error codes, and invokes API calls to troubleshoot. This approach allowed us to break the problem down into multiple steps: Identify the API route. Generate and invoke private API calls. For example, “Show me my backup failures for the past 72 hours, grouped by server.”

APIs 118

APIs Scripts Engineering Government 118

AWS Machine Learning

JULY 25, 2024

This solution is applicable if you’re using managed nodes or self-managed node groups (which use Amazon EC2 Auto Scaling groups ) on Amazon EKS. First, it will mark the affected instance in the relevant Auto Scaling group as unhealthy, which will invoke the Auto Scaling group to stop the instance and launch a replacement.

Construction 123

Construction Metrics Scripts Engineering 123

AWS Machine Learning

DECEMBER 5, 2024

Create a SageMaker training plan using the AWS CLI Complete the following steps to create a training plan using the AWS CLI: Start by calling the API, passing your capacity requirements as input parameters, to search for all matching training plan offerings. You can start using your plan once it transitions to the Active state.

APIs 107

APIs Engineering Scripts Wait times 107

AWS Machine Learning

JUNE 27, 2023

The ML components for data ingestion, preprocessing, and model training were available as disjointed Python scripts and notebooks, which required a lot of manual heavy lifting on the part of engineers. The initial solution also required the support of a technical third party, to release new models swiftly and efficiently.

Engineering 125

Engineering APIs Scripts Entertainment 125

AWS Machine Learning

JANUARY 12, 2023

Amazon API Gateway with AWS Lambda integration that converts the input text to the target language using the Amazon Translate SDK. The following steps set up API Gateway, Lambda, and Amazon Translate resources using the AWS CDK. Take note of the API key and the API endpoint created during the deployment. Prerequisites.

Customer Support 102

Customer Support APIs Scripts Enterprise 102

AWS Machine Learning

AUGUST 17, 2023

Option B: Use a SageMaker Processing job with Spark In this option, we use a SageMaker Processing job with a Spark script to load the original dataset from Amazon Redshift, perform feature engineering, and ingest the data into SageMaker Feature Store. You decide which feature groups to use for your models.

APIs 94

APIs Engineering Scripts Analytics 94

AWS Machine Learning

OCTOBER 2, 2023

For this we use AWS Step Functions , a serverless workflow service that provides us with API integrations to quickly orchestrate and visualize the steps in our workflow. Finally, the labels are stored in a feature group in SageMaker Feature Store. Use the scripts created in step one as part of the processing and training steps.

Scripts 129

Scripts Construction Engineering APIs 129

AWS Machine Learning

SEPTEMBER 26, 2024

This text-to-video API generates high-quality, realistic videos quickly from text and images. Customizable environment – SageMaker HyperPod offers the flexibility to customize your cluster environment using lifecycle scripts. Video generation has become the latest frontier in AI research, following the success of text-to-image models.

Scripts 128

Scripts APIs Metrics Management 128

AWS Machine Learning

OCTOBER 24, 2024

These agentic workflows decompose the natural language query-based tasks into multiple actionable steps with iterative feedback loops and self-reflection to produce the final result using tools and APIs. Create and associate an action group with an API schema and a Lambda function. Examples given later in the post.)

APIs 101

APIs Best practices Construction Engineering 101

AWS Machine Learning

OCTOBER 27, 2022

This represents a group of one or more instances of a specific instance type, designed to carry a logical role (like data processing or neural network optimization. You can have two or more groups, and specify a custom name for each instance group, the instance type, and the number of instances for each instance group.

Scripts 91

Scripts Benchmark Metrics Transportation 91

Whitepages Pro

APRIL 4, 2019

Our latest product innovation, Transaction Risk API , was officially launched a couple of weeks ago at Merchant Risk Council (MRC) 2019. Introducing our Transaction Risk API. The Transaction Risk API was built by data scientists for data scientists and designed for easy integration into models. The new era or “Fraud 3.0”

APIs 45

APIs Scripts Marketing Customer Experience 45

AWS Machine Learning

NOVEMBER 30, 2023

SageMaker makes it easy to deploy models into production directly through API calls to the service. It’s a low-level API available for Java, C++, Go, JavaScript, Node.js, PHP, Ruby, and Python. It’s a low-level API available for Java, C++, Go, JavaScript, Node.js, PHP, Ruby, and Python.

Benchmark 134

Benchmark APIs Scripts Engineering 134

AWS Machine Learning

JUNE 12, 2024

This solution uses an Amazon Cognito user pool as an OAuth-compatible identity provider (IdP), which is required in order to exchange a token with AWS IAM Identity Center and later on interact with the Amazon Q Business APIs. Amazon Q uses the chat_sync API to carry out the conversation. You can also find the script on the GitHub repo.

APIs 138

APIs Enterprise Accountability Feedback 138

AWS Machine Learning

DECEMBER 29, 2022

Users can also interact with data with ODBC, JDBC, or the Amazon Redshift Data API. If you’d like to use the traditional SageMaker Studio experience with Amazon Redshift, refer to Using the Amazon Redshift Data API to interact from an Amazon SageMaker Jupyter notebook. The CloudFormation script created a database called sagemaker.

APIs 134

APIs Analytics Engineering Scripts 134

AWS Machine Learning

JANUARY 10, 2023

Note that the model container also includes any custom inference code or scripts that you have passed for inference. Make sure to check what container you’re using and if there are any framework-specific optimizations you can add within the script or as environment variables to inject in the container.

Best practices 99

Best practices Scripts APIs Metrics 99