AWS Machine Learning

JULY 31, 2024

The new ApplyGuardrail API enables you to assess any text using your preconfigured guardrails in Amazon Bedrock, without invoking the FMs. In this post, we demonstrate how to use the ApplyGuardrail API with long-context inputs and streaming outputs. For example, you can now use the API with models hosted on Amazon SageMaker.

APIs 127

APIs Banking Best practices Engineering 127

AWS Machine Learning

SEPTEMBER 13, 2024

Intricate workflows that require dynamic and complex API orchestration can often be complex to manage. In this post, we explore how chaining domain-specific agents using Amazon Bedrock Agents can transform a system of complex API interactions into streamlined, adaptive workflows, empowering your business to operate with agility and precision.

APIs 132

APIs Enterprise Best practices Accountability 132

AWS Machine Learning

JANUARY 24, 2025

In this post, we show you an example of a generative AI assistant application and demonstrate how to assess its security posture using the OWASP Top 10 for Large Language Model Applications , as well as how to apply mitigations for common threats. These steps might involve both the use of an LLM and external data sources and APIs.

APIs 110

APIs Scripts Best practices Management 110

AWS Machine Learning

OCTOBER 30, 2024

Additionally, we discuss how to handle integrations with AWS Lambda and Amazon CloudWatch after enabling Global Resiliency. Enabling Global Resiliency for an Amazon Lex bot is straightforward using the AWS Management Console , AWS Command Line Interface (AWS CLI), or APIs. These are supported in the AWS CLI and AWS SDKs.

Chatbots 107

Chatbots Interactive Voice Response APIs Telecommunications 107

AWS Machine Learning

DECEMBER 18, 2024

In this post, well demonstrate how to configure an Amazon Q Business application and add a custom plugin that gives users the ability to use a natural language interface provided by Amazon Q Business to query real-time data and take actions in ServiceNow. AWS Have an AWS account with administrative access. Choose Next.

APIs 87

APIs Enterprise Accountability Government 87

AWS Machine Learning

JANUARY 22, 2025

Amazon Bedrock Flows offers an intuitive visual builder and a set of APIs to seamlessly link foundation models (FMs), Amazon Bedrock features, and AWS services to build and automate user-defined generative AI workflows at scale. Test the flow Youre now ready to test the flow through the Amazon Bedrock console or API.

APIs 128

APIs Transportation Best practices Enterprise 128

AWS Machine Learning

AUGUST 2, 2024

With GraphStorm, you can build solutions that directly take into account the structure of relationships or interactions between billions of entities, which are inherently embedded in most real-world data, including fraud detection scenarios, recommendations, community detection, and search/retrieval problems. Specifically, GraphStorm 0.3

APIs 117

APIs Benchmark Construction Enterprise 117

AWS Machine Learning

MARCH 25, 2025

Finally, we explore how to set up rolling updates in different scenarios. For more information about the SageMaker AI API, refer to the SageMaker AI API Reference. Customer experience Lets explore how rolling updates work in practice with several common scenarios, using different-sized LLMs.

APIs 86

APIs Engineering Accountability Metrics 86

AWS Machine Learning

JANUARY 28, 2025

In this post, we show how to use FMEval and Amazon SageMaker to programmatically evaluate LLMs. It functions as a standalone HTTP server that provides various REST API endpoints for monitoring, recording, and visualizing experiment runs. This allows you to keep track of your ML experiments.

Management 105

Management APIs Engineering Metrics 105

AWS Machine Learning

SEPTEMBER 20, 2024

Amazon Bedrock agents use LLMs to break down tasks, interact dynamically with users, run actions through API calls, and augment knowledge using Amazon Bedrock Knowledge Bases. In this post, we demonstrate how to use Amazon Bedrock Agents with a web search API to integrate dynamic web content in your generative AI application.

APIs 106

APIs Chatbots Construction Engineering 106

AWS Machine Learning

FEBRUARY 28, 2025

This post explains how to integrate Smartsheet with Amazon Q Business to use natural language and generative AI capabilities for enhanced insights. You can integrate Smartsheet to Amazon Q Business through the AWS Management Console , AWS Command Line Interface (AWS CLI), or the CreateDataSource API. A Smartsheet access token.

APIs 67

APIs Enterprise Accountability Management 67

AWS Machine Learning

DECEMBER 9, 2024

Prerequisites You need an AWS account with an AWS Identity and Access Management (IAM) role with permissions to manage resources created as part of the solution. For details, see Creating an AWS account. Note that MLflow tracking starts from the mlflow.start_run() API. You can now open the private-mlflow.ipynb notebook.

Metrics 96

Metrics APIs Engineering Accountability 96

AWS Machine Learning

NOVEMBER 21, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

APIs 111

APIs Call Center Engineering Personalization 111

AWS Machine Learning

DECEMBER 11, 2024

Earlier this year, we published the first in a series of posts about how AWS is transforming our seller and customer journeys using generative AI. Weve seen our sales teams use this capability to do things like consolidate meeting notes from multiple team members, analyze business reports, and develop account strategies.

Sales 102

Sales Accountability APIs CRM 102

AWS Machine Learning

FEBRUARY 21, 2025

Solution overview Our solution implements a verified semantic cache using the Amazon Bedrock Knowledge Bases Retrieve API to reduce hallucinations in LLM responses while simultaneously improving latency and reducing costs. The function checks the semantic cache (Amazon Bedrock Knowledge Bases) using the Retrieve API.

Engineering 120

Engineering APIs Analytics Enterprise 120

AWS Machine Learning

NOVEMBER 21, 2024

Take, for instance, text-to-video generation, where models need to learn not just what to generate but how to maintain consistency and natural flow across time. This granular input helps models learn how to produce speech that sounds natural, with appropriate pacing and emotional consistency. We demonstrate how to use Wavesurfer.js

APIs 95

APIs Feedback Telecommunications Management 95

AWS Machine Learning

JANUARY 24, 2025

The workflow steps are as follows: The user submits an Amazon Bedrock fine-tuning job within their AWS account, using IAM for resource access. The fine-tuning job initiates a training job in the model deployment accounts. Provide your account, bucket name, and VPC settings. Choose Create policy.

Best practices 113

Best practices Accountability industry standards Metrics 113

AWS Machine Learning

OCTOBER 29, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies such as AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon through a single API, along with a broad set of capabilities you need to build generative AI applications with security, privacy, and responsible AI.

Best practices 111

Best practices Feedback Metrics APIs 111

AWS Machine Learning

FEBRUARY 21, 2025

The solution uses the FMs tool use capabilities, accessed through the Amazon Bedrock Converse API. This enables the FMs to not just process text, but to actively engage with various external tools and APIs to perform complex document analysis tasks. For more details on how tool use works, refer to The complete tool use workflow.

APIs 86

APIs Healthcare Consulting Consulting 86

AWS Machine Learning

FEBRUARY 13, 2024

SageMaker Feature Store now makes it effortless to share, discover, and access feature groups across AWS accounts. With this launch, account owners can grant access to select feature groups by other accounts using AWS Resource Access Manager (AWS RAM).

Accountability 128

Accountability Government Engineering Scripts 128

AWS Machine Learning

NOVEMBER 13, 2024

The Amazon Bedrock single API access, regardless of the models you choose, gives you the flexibility to use different FMs and upgrade to the latest model versions with minimal code changes. Amazon Titan FMs provide customers with a breadth of high-performing image, multimodal, and text model choices, through a fully managed API.

Engineering 115

Engineering Management APIs Healthcare 115

AWS Machine Learning

FEBRUARY 25, 2025

This post shows how to configure an Amazon Q Business custom connector and derive insights by creating a generative AI-powered conversation experience on AWS using Amazon Q Business while using access control lists (ACLs) to restrict access to documents based on user permissions. secrets_manager_client = boto3.client('secretsmanager')

Enterprise 93

Enterprise Engineering APIs Accountability 93

AWS Machine Learning

MARCH 19, 2025

The question is no longer whether to adopt generative AI, but how to move from promising pilots to production-ready systems that deliver real business value. As we gather for NVIDIA GTC, organizations of all sizes are at a pivotal moment in their AI journey. The results speak for themselvestheir inference stack achieves up to 3.1

Healthcare 118

Healthcare Enterprise APIs Transportation 118

AWS Machine Learning

FEBRUARY 9, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon via a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

SaaS 144

SaaS APIs Government Accountability 144

AWS Machine Learning

FEBRUARY 11, 2025

Step Functions orchestrates AWS services like AWS Lambda and organization APIs like DataStore to ingest, process, and store data securely. For example, the Datastore API might require certain input like date periods to query data. Configure IAM Identity Center You can only have one IAM Identity Center instance per account.

Enterprise 92

Enterprise Engineering APIs Best practices 92

AWS Machine Learning

NOVEMBER 20, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

Construction 116

Construction APIs Metrics Accountability 116

AWS Machine Learning

FEBRUARY 12, 2025

Amazon Bedrock is a fully managed service that makes FMs from leading AI startups and Amazon available through an API, so you can choose from a wide range of FMs to find the model that is best suited for your use case. In this post, we explore how to use Amazon Bedrock to generate synthetic training data to fine-tune an LLM.

APIs 75

APIs Management Benchmark Scripts 75

AWS Machine Learning

NOVEMBER 22, 2024

Cloud providers have recognized the need to offer model inference through an API call, significantly streamlining the implementation of AI within applications. Although a single API call can address simple use cases, more complex ones may necessitate the use of multiple calls and integrations with other services.

APIs 90

APIs Technology Management Enterprise 90

AWS Machine Learning

JULY 2, 2024

In this post, we provide an operational overview of the solution, and then describe how to set it up with the following services: Amazon Bedrock and a knowledge base to generate responses from user questions based on enterprise data sources. The request is sent by the web application to the API. installed Node.js

APIs 136

APIs Scripts Enterprise Engineering 136

AWS Machine Learning

MARCH 27, 2025

We dive deep into this process on how to use XML tags to structure the prompt and guide Amazon Bedrock in generating a balanced label dataset with high accuracy. In the following sections, we explain how to take an incremental and measured approach to improve Anthropics Claude 3.5 Sonnet prediction accuracy through prompt engineering.

Education 92

Education Engineering APIs Enterprise 92

AWS Machine Learning

NOVEMBER 15, 2024

We gave practical tips, based on hands-on experience with customer use cases, on how to improve text-only RAG solutions, from optimizing the retriever to mitigating and detecting hallucinations. We first introduce routers, and how they can help managing diverse data sources. This post focuses on doing RAG on heterogeneous data formats.

APIs 118

APIs Engineering Chatbots Construction 118

AWS Machine Learning

FEBRUARY 11, 2025

This solution demonstrates how to create an AI-powered virtual meteorologist that can answer complex weather-related queries in natural language. We use various AWS services to deploy a complete solution that you can use to interact with an API providing real-time weather information. In this solution, we use Amazon Bedrock Agents.

APIs 82

APIs Enterprise Accountability Management 82

AWS Machine Learning

JANUARY 14, 2025

In this post, we show how to extend Amazon Bedrock Agents to hybrid and edge services such as AWS Outposts and AWS Local Zones to build distributed Retrieval Augmented Generation (RAG) applications with on-premises data for improved model outcomes. Through the frontend application, the user prompts the chatbot interface with a question.

APIs 98

APIs Chatbots Enterprise Healthcare 98

AWS Machine Learning

MARCH 3, 2025

In this post, we walk through how to discover, deploy, and use the Pixtral 12B model for a variety of real-world vision use cases. To learn more about how IAM works with Amazon Bedrock Marketplace, refer to Set up Amazon Bedrock Marketplace. To begin using Pixtral 12B, choose Deploy.

Benchmark 89

Benchmark APIs Enterprise Construction 89

AWS Machine Learning

MARCH 6, 2025

Amazon Bedrock is a fully managed service that offers a choice of high-performing Foundation Models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon via a single API, along with a broad set of capabilities you need to build generative AI applications with security, privacy, and responsible AI.

Metrics 86

Metrics Enterprise APIs Engineering 86

AWS Machine Learning

MARCH 18, 2025

Beyond Amazon Bedrock models, the service offers the flexible ApplyGuardrails API that enables you to assess text using your pre-configured guardrails without invoking FMs, allowing you to implement safety controls across generative AI applicationswhether running on Amazon Bedrock or on other systemsat both input and output levels.

Government 85

Government APIs Enterprise Technology 85

AWS Machine Learning

SEPTEMBER 12, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon through a unified API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

Healthcare 128

Healthcare APIs Accountability Enterprise 128