article thumbnail

Use AWS PrivateLink to set up private access to Amazon Bedrock

AWS Machine Learning

It allows developers to build and scale generative AI applications using FMs through an API, without managing infrastructure. Customers are building innovative generative AI applications using Amazon Bedrock APIs using their own proprietary data.

APIs 131
article thumbnail

Secure Amazon SageMaker Studio presigned URLs Part 2: Private API with JWT authentication

AWS Machine Learning

In this post, we will continue to build on top of the previous solution to demonstrate how to build a private API Gateway via Amazon API Gateway as a proxy interface to generate and access Amazon SageMaker presigned URLs. The user invokes createStudioPresignedUrl API on API Gateway along with a token in the header.

APIs 81
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Govern generative AI in the enterprise with Amazon SageMaker Canvas

AWS Machine Learning

To use a specific LLM from Amazon Bedrock, SageMaker Canvas uses the model ID of the chosen LLM as part of the API calls. Limit access to all Amazon Bedrock models To restrict access to all Amazon Bedrock models, you can modify the SageMaker role to explicitly deny these APIs. This way, users can only invoke the allowed models.

article thumbnail

Getting started with cross-region inference in Amazon Bedrock

AWS Machine Learning

Moreover, this capability prioritizes the connected Amazon Bedrock API source/primary region when possible, helping to minimize latency and improve responsiveness. Compatibility with existing Amazon Bedrock API No additional routing or data transfer cost and you pay the same price per token for models as in your source/primary region.

APIs 137
article thumbnail

Architecture to AWS CloudFormation code using Anthropic’s Claude 3 on Amazon Bedrock

AWS Machine Learning

The workflow consists of the following steps: The user uploads an architecture image (JPEG or PNG) on the Streamlit application, invoking the Amazon Bedrock API to generate a step-by-step explanation of the architecture using the Anthropic’s Claude 3 Sonnet model. The following diagram illustrates the step-by-step process.

article thumbnail

Bring legacy machine learning code into Amazon SageMaker using AWS Step Functions

AWS Machine Learning

The best practice for migration is to refactor these legacy codes using the Amazon SageMaker API or the SageMaker Python SDK. Step Functions is a serverless workflow service that can control SageMaker APIs directly through the use of the Amazon States Language. We do so using AWS SDK for Python (Boto3) CreateProcessingJob API calls.

Scripts 125
article thumbnail

Build a multilingual automatic translation pipeline with Amazon Translate Active Custom Translation

AWS Machine Learning

We demonstrate how to use the AWS Management Console and Amazon Translate public API to deliver automatic machine batch translation, and analyze the translations between two language pairs: English and Chinese, and English and Spanish. In this post, we present a solution that D2L.ai

APIs 79