AWS Machine Learning

MAY 16, 2024

The main AWS services used are SageMaker, Amazon EMR , AWS CodeBuild , Amazon Simple Storage Service (Amazon S3), Amazon EventBridge , AWS Lambda , and Amazon API Gateway. Real-time recommendation inference The inference phase consists of the following steps: The client application makes an inference request to the API gateway.

Personalization 112

Personalization APIs Scripts Technical Support 112

AWS Machine Learning

JULY 17, 2024

In this post, we’re using the APIs for AWS Support , AWS Trusted Advisor , and AWS Health to programmatically access the support datasets and use the Amazon Q Business native Amazon Simple Storage Service (Amazon S3) connector to index support data and provide a prebuilt chatbot web experience. Synchronize the data source to index the data.

Scripts 112

Scripts APIs Enterprise Accountability 112

AWS Machine Learning

MARCH 15, 2023

The best practice for migration is to refactor these legacy codes using the Amazon SageMaker API or the SageMaker Python SDK. SageMaker runs the legacy script inside a processing container. Step Functions is a serverless workflow service that can control SageMaker APIs directly through the use of the Amazon States Language.

Scripts 132

Scripts APIs Engineering Construction 132

AWS Machine Learning

JULY 25, 2024

A document’s ACL contains information such as the user’s email address and the local groups or federated groups (if Microsoft SharePoint is integrated with an identity provider (IdP) such as Azure Active Directory/Entra ID) that have access to the document.

Scripts 98

Scripts APIs Engineering Enterprise 98

AWS Machine Learning

NOVEMBER 14, 2024

Amazon SageMaker Feature Store – Amazon SageMaker Feature Store allows you to tag your feature groups and search for feature groups using tags. You can add tags when creating a new feature group or edit the tags of an existing feature group. Use AWS Resource Groups to find noncompliant tags on account resources.

Government 91

Government Best practices Accountability APIs 91

AWS Machine Learning

OCTOBER 24, 2024

These agentic workflows decompose the natural language query-based tasks into multiple actionable steps with iterative feedback loops and self-reflection to produce the final result using tools and APIs. Create and associate an action group with an API schema and a Lambda function. Examples given later in the post.)

APIs 90

APIs Best practices Construction Engineering 90

AWS Machine Learning

FEBRUARY 29, 2024

The AI platform managed service, built on SageMaker Studio, seamlessly aligns with Deutsche Bahn’s group-wide platform strategy. During this orchestration flow, an Azure Active Directory (AD) group for the data analytics team is provisioned with the AD group name corresponding to the domain name.

APIs 117

APIs Construction Transportation Analytics 117

AWS Machine Learning

MAY 30, 2024

AWS Prototyping successfully delivered a scalable prototype, which solved CBRE’s business problem with a high accuracy rate (over 95%) and supported reuse of embeddings for similar NLQs, and an API gateway for integration into CBRE’s dashboards. The following diagram illustrates the web interface and API management layer.

Real estate 123

Real estate APIs Metrics Construction 123

AWS Machine Learning

DECEMBER 21, 2022

Depending on the design of your feature groups and their scale, you can experience training query performance improvements of 10x to 100x by using this new capability. SageMaker Feature Store automatically builds an AWS Glue Data Catalog during feature group creation. Creating feature groups using Iceberg table format.

Scripts 80

Scripts Engineering APIs Big data 80

AWS Machine Learning

MAY 23, 2024

The SMP library uses NVIDIA Megatron to implement expert parallelism and support training MoE models, and runs on top of PyTorch Fully Sharded Data Parallel (FSDP) APIs. For example, if you set the degree to 2, SMP will assign half of the eight experts to each data parallel group. In this example, we use SageMaker training jobs.

APIs 125

APIs Engineering Scripts Construction 125

AWS Machine Learning

SEPTEMBER 11, 2023

The solution will use Terraform to create: A VPC with subnets, security groups, as well as VPC endpoints to support VPC only mode for the SageMaker Domain. TCP traffic within the security group. This is required to communicate with the SageMaker API. A SageMaker Domain in VPC only mode with a user profile.

Scripts 114

Scripts APIs Management Best practices 114

AWS Machine Learning

JUNE 19, 2024

The Slack application sends the event to Amazon API Gateway , which is used in the event subscription. API Gateway forwards the event to an AWS Lambda function. Create a new group and add the app BedrockSlackIntegration. The following diagram illustrates the solution architecture. Choose Save Changes.

APIs 122

APIs Engineering Accountability Big data 122

AWS Machine Learning

AUGUST 4, 2023

When a version of the model in the Amazon SageMaker Model Registry is approved, the endpoint is exposed as an API with Amazon API Gateway using a custom Salesforce JSON Web Token (JWT) authorizer. frameworks to restrict client access to your APIs. For API Name , leave as default (it’s automatically populated).

APIs 85

APIs Scripts Management Accountability 85

Whitepages Pro

APRIL 4, 2019

Our latest product innovation, Transaction Risk API , was officially launched a couple of weeks ago at Merchant Risk Council (MRC) 2019. Introducing our Transaction Risk API. The Transaction Risk API was built by data scientists for data scientists and designed for easy integration into models. The new era or “Fraud 3.0”

APIs 45

APIs Scripts Marketing Customer Experience 45

AWS Machine Learning

MAY 8, 2023

In this post, we address these limitations by implementing the access control outside of the MLflow server and offloading authentication and authorization tasks to Amazon API Gateway , where we implement fine-grained access control mechanisms at the resource level using Identity and Access Management (IAM). Adds an IAM authorizer.

APIs 77

APIs Government Accountability Scripts 77

AWS Machine Learning

SEPTEMBER 8, 2023

Amazon Rekognition makes it easy to add image analysis capability to your applications without any machine learning (ML) expertise and comes with various APIs to fulfil use cases such as object detection, content moderation, face detection and analysis, and text and celebrity recognition, which we use in this example.

APIs 115

APIs Scripts Entertainment Personalization 115

AWS Machine Learning

MAY 31, 2023

In such cases, data scientists have to provide these parameters to their ML model training and deployment code manually, by noting down subnets, security groups, and KMS keys. Additionally, each API call can have its own configurations. See Supported APIs and parameters for a complete list of supported API calls and parameters.

APIs 93

APIs Scripts Accountability Enterprise 93

AWS Machine Learning

OCTOBER 2, 2024

In addition, they use the developer-provided instruction to create an orchestration plan and then carry out the plan by invoking company APIs and accessing knowledge bases using Retrieval Augmented Generation (RAG) to provide an answer to the user’s request. In Part 1, we focus on creating accurate and reliable agents.

Best practices 94

Best practices APIs Metrics Benchmark 94

AWS Machine Learning

NOVEMBER 19, 2024

Similarly, in tasks like code generation and suggestions through chat-based applications, users might not specify the APIs they want to use. Instead, they often request help in resolving a general issue or in generating code that utilizes proprietary APIs and SDKs. For this post, we use Meta Llama3.1

Automotive 88

Automotive Scripts APIs Engineering 88

AWS Machine Learning

NOVEMBER 15, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

APIs 84

APIs Government Best practices Metrics 84

AWS Machine Learning

AUGUST 17, 2023

Option B: Use a SageMaker Processing job with Spark In this option, we use a SageMaker Processing job with a Spark script to load the original dataset from Amazon Redshift, perform feature engineering, and ingest the data into SageMaker Feature Store. You decide which feature groups to use for your models.

APIs 81

APIs Engineering Scripts Analytics 81

AWS Machine Learning

OCTOBER 25, 2022

Model weights are available via scripts in the GitHub repository , and the MSAs are hosted by the Registry of Open Data on AWS (RODA). We use aws-do-eks , an open-source project that provides a large collection of easy-to-use and configurable scripts and tools to enable you to provision EKS clusters and run your inference.

APIs 84

APIs Scripts Banking Engineering 84

AWS Machine Learning

SEPTEMBER 18, 2023

Each stage in the ML workflow is broken into discrete steps, with its own script that takes input and output parameters. Ingesting features into the feature store contains the following steps: Define a feature group and create the feature group in the feature store. See the following code: @ray.remote(num_cpus=0.5)

Scripts 118

Scripts APIs Government Construction 118

AWS Machine Learning

JULY 25, 2024

This solution is applicable if you’re using managed nodes or self-managed node groups (which use Amazon EC2 Auto Scaling groups ) on Amazon EKS. First, it will mark the affected instance in the relevant Auto Scaling group as unhealthy, which will invoke the Auto Scaling group to stop the instance and launch a replacement.

Construction 107

Construction Metrics Scripts Engineering 107

AWS Machine Learning

SEPTEMBER 26, 2024

This text-to-video API generates high-quality, realistic videos quickly from text and images. Customizable environment – SageMaker HyperPod offers the flexibility to customize your cluster environment using lifecycle scripts. Video generation has become the latest frontier in AI research, following the success of text-to-image models.

Scripts 113

Scripts APIs Metrics Management 113

AWS Machine Learning

FEBRUARY 13, 2024

SageMaker Feature Store now makes it effortless to share, discover, and access feature groups across AWS accounts. With this launch, account owners can grant access to select feature groups by other accounts using AWS Resource Access Manager (AWS RAM). For a deep dive, refer to Cross account feature group discoverability and access.

Accountability 123

Accountability Government Engineering Scripts 123

AWS Machine Learning

OCTOBER 17, 2024

The data science team can, for example, use the shared EFS directory to store their Jupyter notebooks, analysis scripts, and other project-related files. You should have an AWS CloudTrail log file that logs the SageMaker API CreateUserProfile. The template configures the Lambda function with this security group.

Government 108

Government Accountability APIs Engineering 108

AWS Machine Learning

APRIL 17, 2024

This solution deploys an Amazon EKS cluster with a node group that includes Inf1 instances. The AMI type of the node group is AL2_x86_64_GPU , which uses the Amazon EKS optimized accelerated Amazon Linux AMI. Solution overview The following diagram illustrates the solution architecture. or later NPM version 10.0.0

APIs 116

APIs Metrics Accountability Management 116

AWS Machine Learning

MAY 31, 2023

Triton with PyTorch backend The PyTorch backend is designed to run TorchScript models using the PyTorch C++ API. Alternatively, you can use ensemble models or business logic scripting. For instructions on how to secure your account with an IAM administrator user, see Creating your first IAM admin user and user group.

APIs 101

APIs Scripts Engineering Accountability 101

AWS Machine Learning

JANUARY 5, 2024

Continuous integration and continuous delivery (CI/CD) pipeline – Using the customer’s GitHub repository enabled code versioning and automated scripts to launch pipeline deployment whenever new versions of the code are committed. Wipro has used the input filter and join functionality of SageMaker batch transformation API.

Management 128

Management APIs Engineering Government 128

Totango

APRIL 26, 2021

System Browser Scripts settings – You can now enable/disable session recordings in Global Settings -> General. You can also enable a walkthrough script with a script UR L. . SCIM User API Improvements: Support API capabilities to update team members in Groups / Teams. .

Scripts 62

Scripts APIs Customer retention Enterprise 62

AWS Machine Learning

AUGUST 29, 2023

The data scientist then needs to review and manually approve the latest version of the model in the Amazon SageMaker Studio UI or via an API call using the AWS Command Line Interface (AWS CLI) or AWS SDK for Python (Boto3) before the new version of model can be utilized for inference.

Scripts 80

Scripts APIs Enterprise Accountability 80

AWS Machine Learning

JANUARY 12, 2023

Amazon API Gateway with AWS Lambda integration that converts the input text to the target language using the Amazon Translate SDK. The following steps set up API Gateway, Lambda, and Amazon Translate resources using the AWS CDK. Take note of the API key and the API endpoint created during the deployment. Prerequisites.

Customer Support 87

Customer Support APIs Scripts Enterprise 87

AWS Machine Learning

OCTOBER 27, 2022

This represents a group of one or more instances of a specific instance type, designed to carry a logical role (like data processing or neural network optimization. You can have two or more groups, and specify a custom name for each instance group, the instance type, and the number of instances for each instance group.

Scripts 76

Scripts Benchmark Metrics Transportation 76

AWS Machine Learning

MARCH 23, 2023

Applications and services can call the deployed endpoint directly or through a deployed serverless Amazon API Gateway architecture. To learn more about real-time endpoint architectural best practices, refer to Creating a machine learning-powered REST API with Amazon API Gateway mapping templates and Amazon SageMaker.

Scripts 113

Scripts APIs Government Analytics 113

AWS Machine Learning

JUNE 27, 2023

The ML components for data ingestion, preprocessing, and model training were available as disjointed Python scripts and notebooks, which required a lot of manual heavy lifting on the part of engineers. The initial solution also required the support of a technical third party, to release new models swiftly and efficiently.

Engineering 112

Engineering APIs Scripts Entertainment 112

AWS Machine Learning

OCTOBER 31, 2022

The intuition behind this design is that partitioning training states across the entire data-parallel group may not be required to train a model with tens of billions of parameters. To get started, follow Modify a PyTorch Training Script to adapt SMPs’ APIs in your training script. return loss. Prepare the dataset.

Scripts 70

Scripts Benchmark APIs Engineering 70