Remove APIs Remove Engineering Remove SaaS
article thumbnail

Build a video insights and summarization engine using generative AI with Amazon Bedrock

AWS Machine Learning

This post presents a solution where you can upload a recording of your meeting (a feature available in most modern digital communication services such as Amazon Chime ) to a centralized video insights and summarization engine. This post provides guidance on how you can create a video insights and summarization engine using AWS AI/ML services.

article thumbnail

Build a multi-tenant generative AI environment for your enterprise on AWS

AWS Machine Learning

In the first part of the series, we showed how AI administrators can build a generative AI software as a service (SaaS) gateway to provide access to foundation models (FMs) on Amazon Bedrock to different lines of business (LOBs). It also uses a number of other AWS services such as Amazon API Gateway , AWS Lambda , and Amazon SageMaker.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Enhance deployment guardrails with inference component rolling updates for Amazon SageMaker AI inference

AWS Machine Learning

For more information about the SageMaker AI API, refer to the SageMaker AI API Reference. 8B-Instruct to DeepSeek-R1-Distill-Llama-8B, but the new model version has different API expectations. In this use case, you have configured a CloudWatch alarm to monitor for 4xx errors, which would indicate API compatibility issues.

APIs 101
article thumbnail

Secure a generative AI assistant with OWASP Top 10 mitigation

AWS Machine Learning

These steps might involve both the use of an LLM and external data sources and APIs. Agent plugin controller This component is responsible for the API integration to external data sources and APIs. The LLM agent is an orchestrator of a set of steps that might be necessary to complete the desired request.

APIs 107
article thumbnail

Unleashing the power of generative AI: Verisk’s journey to an Instant Insight Engine for enhanced customer support

AWS Machine Learning

The software as a service (SaaS) platform offers out-of-the-box solutions for life, annuity, employee benefits, and institutional annuity providers. Verisk has embraced this technology and has developed their own Instant Insight Engine, or AI companion, that provides an enhanced self-service capability to their FAST platform.

article thumbnail

Transforming credit decisions using generative AI with Rich Data Co and AWS

AWS Machine Learning

Its software-as-a-service (SaaS) solution empowers leading banks and lenders with deep customer insights and AI-driven decision-making capabilities. Our initial approach combined prompt engineering and traditional Retrieval Augmented Generation (RAG). Tools Tools extend agent capabilities beyond the FM.

article thumbnail

Model customization, RAG, or both: A case study with Amazon Nova

AWS Machine Learning

Fine-tune an Amazon Nova model using the Amazon Bedrock API In this section, we provide detailed walkthroughs on fine-tuning and hosting customized Amazon Nova models using Amazon Bedrock. We first provided a detailed walkthrough on how to fine-tune, host, and conduct inference with customized Amazon Nova through the Amazon Bedrock API.

APIs 112