Remove APIs Remove Big data Remove Metrics
article thumbnail

Achieve operational excellence with well-architected generative AI solutions using Amazon Bedrock

AWS Machine Learning

It’s a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like Anthropic, Cohere, Meta, Mistral AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

article thumbnail

Centralize model governance with SageMaker Model Registry Resource Access Manager sharing

AWS Machine Learning

Customers can use the SageMaker Studio UI or APIs to specify the SageMaker Model Registry model to be shared and grant access to specific AWS accounts or to everyone in the organization. We will start by using the SageMaker Studio UI and then by using APIs.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Governing the ML lifecycle at scale: Centralized observability with Amazon SageMaker and Amazon CloudWatch

AWS Machine Learning

Amazon SageMaker Model Monitor allows you to automatically monitor ML models in production, and alerts you when data and model quality issues appear. SageMaker Model Monitor emits per-feature metrics to Amazon CloudWatch , which you can use to set up dashboards and alerts. Enable CloudWatch cross-account observability.

article thumbnail

How DPG Media uses Amazon Bedrock and Amazon Transcribe to enhance video metadata with AI-powered pipelines

AWS Machine Learning

To evaluate the transcription accuracy quality, the team compared the results against ground truth subtitles on a large test set, using the following metrics: Word error rate (WER) – This metric measures the percentage of words that are incorrectly transcribed compared to the ground truth. A lower MER signifies better accuracy.

article thumbnail

Improve governance of models with Amazon SageMaker unified Model Cards and Model Registry

AWS Machine Learning

Because SageMaker Model Cards and SageMaker Model Registry were built on separate APIs, it was challenging to associate the model information and gain a comprehensive view of the model development lifecycle. SageMaker Model Registry catalogs your models along with their versions and associated metadata and metrics for training and evaluation.

article thumbnail

Improve visibility into Amazon Bedrock usage and performance with Amazon CloudWatch

AWS Machine Learning

A new automatic dashboard for Amazon Bedrock was added to provide insights into key metrics for Amazon Bedrock models. From here you can gain centralized visibility and insights to key metrics such as latency and invocation metrics. Optionally, you can select a specific model to isolate the metrics to one model.

Metrics 122
article thumbnail

How Amp on Amazon used data to increase customer engagement, Part 2: Building a personalized show recommendation platform using Amazon SageMaker

AWS Machine Learning

This is Part 2 of a series on using data analytics and ML for Amp and creating a personalized show recommendation list platform. The platform has shown a 3% boost to customer engagement metrics tracked (liking a show, following a creator, enabling upcoming show notifications) since its launch in May 2022.