APIs and Management - Customer Contact Central

Enhance customer support with Amazon Bedrock Agents by integrating enterprise data APIs

AWS Machine Learning

NOVEMBER 7, 2024

In this post, we guide you through integrating Amazon Bedrock Agents with enterprise data APIs to create more personalized and effective customer support experiences. An automotive retailer might use inventory management APIs to track stock levels and catalog APIs for vehicle compatibility and specifications.

APIs

APIs Enterprise Automotive Customer Support

Track LLM model evaluation using Amazon SageMaker managed MLflow and FMEval

AWS Machine Learning

JANUARY 28, 2025

Ultimately, this systematic approach to managing models, prompts, and datasets contributes to the development of more reliable and transparent generative AI applications. MLflow is an open source platform for managing the end-to-end ML lifecycle, including experimentation, reproducibility, and deployment.

Management

Management APIs Engineering Metrics

Create a generative AI–powered custom Google Chat application using Amazon Bedrock

AWS Machine Learning

OCTOBER 31, 2024

The custom Google Chat app, configured for HTTP integration, sends an HTTP request to an API Gateway endpoint. Before processing the request, a Lambda authorizer function associated with the API Gateway authenticates the incoming message. The following figure illustrates the high-level design of the solution.

APIs

APIs Scripts Accountability Construction

Build a multi-tenant generative AI environment for your enterprise on AWS

AWS Machine Learning

NOVEMBER 7, 2024

It also uses a number of other AWS services such as Amazon API Gateway , AWS Lambda , and Amazon SageMaker. It contains services used to onboard, manage, and operate the environment, for example, to onboard and off-board tenants, users, and models, assign quotas to different tenants, and authentication and authorization microservices.

Enterprise

Enterprise APIs Government Accountability

CallMiner Product Innovation Series: September 2023

Callminer

SEPTEMBER 8, 2023

Bruce McMahon, VP of Product Management, shares updates from the 2023.09 release including enhancements to bulk export API capabilities, giving customers even more control over their data.

APIs

APIs Management

Integrate generative AI capabilities into Microsoft Office using Amazon Bedrock

AWS Machine Learning

MARCH 19, 2025

One can quickly host such application on the AWS Cloud without managing the underlying infrastructure, for example, with Amazon Simple Storage Service (S3) and Amazon CloudFront. Note that these APIs use objects as namespaces, alleviating the need for explicit imports. For testing, one can sideload an Office Add-in.

APIs

APIs Automotive Accountability Analytics

Build a reverse image search engine with Amazon Titan Multimodal Embeddings in Amazon Bedrock and AWS managed services

AWS Machine Learning

NOVEMBER 13, 2024

The Amazon Bedrock single API access, regardless of the models you choose, gives you the flexibility to use different FMs and upgrade to the latest model versions with minimal code changes. Amazon Titan FMs provide customers with a breadth of high-performing image, multimodal, and text model choices, through a fully managed API.

Engineering

Engineering Management APIs Healthcare

Build a video insights and summarization engine using generative AI with Amazon Bedrock

AWS Machine Learning

OCTOBER 29, 2024

To enable the video insights solution, the architecture uses a combination of AWS services, including the following: Amazon API Gateway is a fully managed service that makes it straightforward for developers to create, publish, maintain, monitor, and secure APIs at scale.

Engineering

Engineering APIs Sales Enterprise

Streamline workflow orchestration of a system of enterprise APIs using chaining with Amazon Bedrock Agents

AWS Machine Learning

SEPTEMBER 13, 2024

Intricate workflows that require dynamic and complex API orchestration can often be complex to manage. Using natural language processing (NLP) and OpenAPI specs, Amazon Bedrock Agents dynamically manages API sequences, minimizing dependency management complexities.

APIs

APIs Enterprise Best practices Accountability

Transcribe, translate, and summarize live streams in your browser with AWS AI and generative AI services

AWS Machine Learning

NOVEMBER 13, 2024

Recognizing this need, we have developed a Chrome extension that harnesses the power of AWS AI and generative AI services, including Amazon Bedrock , an AWS managed service to build and scale generative AI applications with foundation models (FMs). For additional details, refer to Creating a new user in the AWS Management Console.

APIs

APIs Scripts Accountability Entertainment

Use the ApplyGuardrail API with long-context inputs and streaming outputs in Amazon Bedrock

AWS Machine Learning

JULY 31, 2024

The new ApplyGuardrail API enables you to assess any text using your preconfigured guardrails in Amazon Bedrock, without invoking the FMs. In this post, we demonstrate how to use the ApplyGuardrail API with long-context inputs and streaming outputs. For example, you can now use the API with models hosted on Amazon SageMaker.

APIs

APIs Banking Best practices Engineering

Introducing multi-turn conversation with an agent node for Amazon Bedrock Flows (preview)

AWS Machine Learning

JANUARY 22, 2025

Amazon Bedrock Flows offers an intuitive visual builder and a set of APIs to seamlessly link foundation models (FMs), Amazon Bedrock features, and AWS services to build and automate user-defined generative AI workflows at scale. Amazon Bedrock Agents offers a fully managed solution for creating, deploying, and scaling AI agents on AWS.

APIs

APIs Transportation Best practices Enterprise

Using natural language in Amazon Q Business: From searching and creating ServiceNow incidents and knowledge articles to generating insights

AWS Machine Learning

DECEMBER 18, 2024

Enterprises that have adopted ServiceNow can improve their operations and boost user productivity by using Amazon Q Business for various use cases, including incident and knowledge management. For a complete list of AWS Identity and Access Management (IAM) roles for Amazon Q Business, see IAM roles for Amazon Q Business.

APIs

APIs Enterprise Accountability Government

Considerations for addressing the core dimensions of responsible AI for Amazon Bedrock applications

AWS Machine Learning

NOVEMBER 15, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

APIs

APIs Government Best practices Metrics

Secure a generative AI assistant with OWASP Top 10 mitigation

AWS Machine Learning

JANUARY 24, 2025

Generative AI scoping framework Start by understanding where your generative AI application fits within the spectrum of managed vs. custom. These steps might involve both the use of an LLM and external data sources and APIs. The LLM agent is an orchestrator of a set of steps that might be necessary to complete the desired request.

APIs

APIs Scripts Best practices Management

GraphStorm 0.3: Scalable, multi-task learning on graphs with user-friendly APIs

AWS Machine Learning

AUGUST 2, 2024

adds new APIs to customize GraphStorm pipelines: you now only need 12 lines of code to implement a custom node classification training loop. Based on customer feedback for the experimental APIs we released in GraphStorm 0.2, introduces refactored graph ML pipeline APIs. Specifically, GraphStorm 0.3 In addition, GraphStorm 0.3

APIs

APIs Benchmark Construction Enterprise

Achieve multi-Region resiliency for your conversational AI chatbots with Amazon Lex

AWS Machine Learning

OCTOBER 30, 2024

With Global Resiliency, you no longer need to manually manage separate bots across Regions, because the feature automatically replicates and keeps Regional configurations in sync. Enabling Global Resiliency for an Amazon Lex bot is straightforward using the AWS Management Console , AWS Command Line Interface (AWS CLI), or APIs.

Chatbots

Chatbots Interactive Voice Response APIs Telecommunications

Benchmarking Amazon Nova and GPT-4o models with FloTorch

AWS Machine Learning

MARCH 11, 2025

Amazon Bedrock APIs make it straightforward to use Amazon Titan Text Embeddings V2 for embedding data. The implementation used the universal gateway provided by the FloTorch enterprise version to enable consistent API calls using the same function and to track token count and latency metrics uniformly. get("message", {}).get("content")

Benchmark

Benchmark APIs Enterprise Scripts

Build a Multi-Agent System with LangGraph and Mistral on AWS

AWS Machine Learning

MARCH 6, 2025

By using the power of LLMs and combining them with specialized tools and APIs, agents can tackle complex, multistep tasks that were previously beyond the reach of traditional AI systems. LangGraph is essential to our solution by providing a well-organized method to define and manage the flow of information between agents.

APIs

APIs Scripts Enterprise Management

Integrate dynamic web content in your generative AI application using a web search API and Amazon Bedrock Agents

AWS Machine Learning

SEPTEMBER 20, 2024

Amazon Bedrock agents use LLMs to break down tasks, interact dynamically with users, run actions through API calls, and augment knowledge using Amazon Bedrock Knowledge Bases. In this post, we demonstrate how to use Amazon Bedrock Agents with a web search API to integrate dynamic web content in your generative AI application.

APIs

APIs Chatbots Construction Engineering

Knowledge Bases for Amazon Bedrock now supports custom prompts for the RetrieveAndGenerate API and configuration of the maximum number of retrieved results

AWS Machine Learning

APRIL 9, 2024

In this post, we discuss two new features of Knowledge Bases for Amazon Bedrock specific to the RetrieveAndGenerate API: configuring the maximum number of results and creating custom prompts with a knowledge base prompt template. You can now choose these as query options alongside the search type. First, we set numberOfResults = 5.

APIs

APIs Engineering Healthcare Education

Using responsible AI principles with Amazon Bedrock Batch Inference

AWS Machine Learning

NOVEMBER 21, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

APIs

APIs Call Center Engineering Personalization

Streamline generative AI development in Amazon Bedrock with Prompt Management and Prompt Flows (preview)

AWS Machine Learning

JULY 10, 2024

Today, we’re excited to introduce two powerful new features for Amazon Bedrock: Prompt Management and Prompt Flows, in public preview. You can use the Prompt Management and Flows features graphically on the Amazon Bedrock console or Amazon Bedrock Studio, or programmatically through the Amazon Bedrock SDK APIs.

Management

Management APIs Chatbots Best practices

Pixtral-12B-2409 is now available on Amazon Bedrock Marketplace

AWS Machine Learning

MARCH 3, 2025

An AWS Identity and Access Management (IAM) role to access Amazon Bedrock Marketplace and Amazon SageMaker endpoints. You can find detailed usage instructions, including sample API calls and code snippets for integration. Our prompt and input payload are as follows: system_prompt='''You are a catalog manager for an ecommerce portal.

Benchmark

Benchmark APIs Enterprise Construction

Orchestrate generative AI workflows with Amazon Bedrock and AWS Step Functions

AWS Machine Learning

NOVEMBER 22, 2024

Cloud providers have recognized the need to offer model inference through an API call, significantly streamlining the implementation of AI within applications. Although a single API call can address simple use cases, more complex ones may necessitate the use of multiple calls and integrations with other services.

APIs

APIs Technology Management Enterprise

Orchestrate an intelligent document processing workflow using tools in Amazon Bedrock

AWS Machine Learning

FEBRUARY 21, 2025

The solution uses the FMs tool use capabilities, accessed through the Amazon Bedrock Converse API. This enables the FMs to not just process text, but to actively engage with various external tools and APIs to perform complex document analysis tasks. For more details on how tool use works, refer to The complete tool use workflow.

APIs

APIs Healthcare Consulting Consulting

Improve the productivity of your customer support and project management teams using Amazon Q Business and Atlassian Jira

AWS Machine Learning

JULY 29, 2024

Effective customer support and project management are critical aspects of providing effective customer relationship management. You also need to hire and staff a large team to build, maintain, and manage such a system. You can authenticate Amazon Q Business to Jira using basic authentication with a Jira ID and Jira API token.

Customer Support

Customer Support APIs Management Enterprise

Implement RAG while meeting data residency requirements using AWS hybrid and edge services

AWS Machine Learning

JANUARY 14, 2025

The orchestration includes the ability to invoke AWS Lambda functions to invoke other FMs, opening the ability to run self-managed FMs at the edge. The embedding model, which is hosted on the same EC2 instance as the local LLM API inference server, converts the text chunks into vector representations.

APIs

APIs Chatbots Enterprise Healthcare

Modernizing data science lifecycle management with AWS and Wipro

AWS Machine Learning

JANUARY 5, 2024

Many organizations have been using a combination of on-premises and open source data science solutions to create and manage machine learning (ML) models. Data science and DevOps teams may face challenges managing these isolated tool stacks and systems. Wipro is an AWS Premier Tier Services Partner and Managed Service Provider (MSP).

Management

Management APIs Engineering Government

How AWS sales uses Amazon Q Business for customer engagement

AWS Machine Learning

DECEMBER 11, 2024

We discuss how our sales teams are using it today, compare the benefits of Amazon Q Business as a managed service to the do-it-yourself option, review the data sources available and high-level technical design, and talk about some of our future plans. The following screenshot shows an example of an interaction with Field Advisor.

Sales

Sales Accountability APIs CRM

Mistral-Small-24B-Instruct-2501 is now available on SageMaker Jumpstart and Amazon Bedrock Marketplace

AWS Machine Learning

FEBRUARY 24, 2025

SageMaker JumpStart overview SageMaker JumpStart is a fully managed service that offers state-of-the-art foundation models for various use cases such as content writing, code generation, question answering, copywriting, summarization, classification, and information retrieval. It doesnt support Converse APIs or other Amazon Bedrock tooling.

APIs

APIs Enterprise Benchmark Feedback

From innovation to impact: How AWS and NVIDIA enable real-world generative AI success

AWS Machine Learning

MARCH 19, 2025

They use a highly optimized inference stack built with NVIDIA TensorRT-LLM and NVIDIA Triton Inference Server to serve both their search application and pplx-api, their public API service that gives developers access to their proprietary models. The results speak for themselvestheir inference stack achieves up to 3.1

Healthcare

Healthcare Enterprise APIs Transportation

Lesson #25: Customer Sample Lists Are the Most Challenging Part of Any VoC Program—And AI Could Help (Eventually)

PeopleMetrics

MARCH 7, 2025

Heres how AI might improve customer sample management: 1. The Reality: AI Isnt Fully There Yet Lets be clearmost companies are not using AI for sample list management today. Manual exports, batch uploads, and IT-driven API connections are still the norm. Push for API-driven automation to reduce manual work.

APIs

APIs Surveys CRM Feedback

Dynamic metadata filtering for Amazon Bedrock Knowledge Bases with LangChain

AWS Machine Learning

MARCH 4, 2025

Amazon Bedrock Knowledge Bases offers a fully managed Retrieval Augmented Generation (RAG) feature that connects large language models (LLMs) to internal data sources. It also provides developers with greater control over the LLMs outputs, including the ability to include citations and manage sensitive information.

APIs

APIs Best practices Management Personalization

Create an end-to-end serverless digital assistant for semantic search with Amazon Bedrock

AWS Machine Learning

JULY 2, 2024

Organizations also require the implementation of common security practices such as identity and access management, to make sure that only authorized and authenticated users are allowed to perform specific actions or access specific resources. The request is sent by the web application to the API.

APIs

APIs Scripts Enterprise Engineering

Streamline work insights with the Amazon Q Business connector for Smartsheet

AWS Machine Learning

FEBRUARY 28, 2025

Amazon Q Business is a fully managed, generative AIpowered assistant that empowers enterprises to unlock the full potential of their data and organizational knowledge. Smartsheet, the AI-enhanced enterprise-grade work management platform, helps users manage projects, programs, and processes at scale.

APIs

APIs Enterprise Accountability Management

Build an internal SaaS service with cost and usage tracking for foundation models on Amazon Bedrock

AWS Machine Learning

FEBRUARY 9, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon via a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

SaaS

SaaS APIs Government Accountability

Derive generative AI powered insights from Alation Cloud Services using Amazon Q Business Custom Connector

AWS Machine Learning

FEBRUARY 25, 2025

Additionally, you might need to hire and staff a large team to build, maintain, and manage such a system. Amazon Q Business is a fully managed generative AI-powered assistant that can answer questions, provide summaries, generate content, and securely complete tasks based on data and information in your enterprise systems.

Enterprise

Enterprise Engineering APIs Accountability

Accelerating ML experimentation with enhanced security: AWS PrivateLink support for Amazon SageMaker with MLflow

AWS Machine Learning

DECEMBER 9, 2024

SageMaker is a comprehensive, fully managed ML service designed to provide data scientists and ML engineers with the tools they need to handle the entire ML workflow. Amazon SageMaker with MLflow is a capability in SageMaker that enables users to create, manage, analyze, and compare their ML experiments seamlessly.

Metrics

Metrics APIs Engineering Accountability

Streamline RAG applications with intelligent metadata filtering using Amazon Bedrock

AWS Machine Learning

NOVEMBER 20, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

Construction

Construction APIs Metrics Accountability

Building a virtual meteorologist using Amazon Bedrock Agents

AWS Machine Learning

FEBRUARY 11, 2025

Although weather information is accessible through multiple channels, businesses that heavily rely on meteorological data require robust and scalable solutions to effectively manage and use these critical insights and reduce manual processes. This Lambda function used a weather API to fetch up-to-date meteorological data.

APIs

APIs Enterprise Accountability Management

Reducing hallucinations in LLM agents with a verified semantic cache using Amazon Bedrock Knowledge Bases

AWS Machine Learning

FEBRUARY 21, 2025

Solution overview Our solution implements a verified semantic cache using the Amazon Bedrock Knowledge Bases Retrieve API to reduce hallucinations in LLM responses while simultaneously improving latency and reducing costs. The function checks the semantic cache (Amazon Bedrock Knowledge Bases) using the Retrieve API.

Engineering

Engineering APIs Analytics Enterprise

How Formula 1® uses generative AI to accelerate race-day issue resolution

AWS Machine Learning

FEBRUARY 18, 2025

During these live events, F1 IT engineers must triage critical issues across its services, such as network degradation to one of its APIs. This impacts downstream services that consume data from the API, including products such as F1 TV, which offer live and on-demand coverage of every race as well as real-time telemetry.

APIs

APIs Engineering Metrics Big data

Amazon Q Business simplifies integration of enterprise knowledge bases at scale

AWS Machine Learning

FEBRUARY 11, 2025

Large-scale data ingestion is crucial for applications such as document analysis, summarization, research, and knowledge management. By using Amazon Q Business, which simplifies the complexity of developing and managing ML infrastructure and models, the team rapidly deployed their chat solution.

Enterprise

Enterprise Engineering APIs Best practices

Enhance customer support with Amazon Bedrock Agents by integrating enterprise data APIs

Track LLM model evaluation using Amazon SageMaker managed MLflow and FMEval

Trending Sources

Create a generative AI–powered custom Google Chat application using Amazon Bedrock

Build a multi-tenant generative AI environment for your enterprise on AWS

CallMiner Product Innovation Series: September 2023

Integrate generative AI capabilities into Microsoft Office using Amazon Bedrock

Build a reverse image search engine with Amazon Titan Multimodal Embeddings in Amazon Bedrock and AWS managed services

Build a video insights and summarization engine using generative AI with Amazon Bedrock

Streamline workflow orchestration of a system of enterprise APIs using chaining with Amazon Bedrock Agents

Transcribe, translate, and summarize live streams in your browser with AWS AI and generative AI services

Use the ApplyGuardrail API with long-context inputs and streaming outputs in Amazon Bedrock

Introducing multi-turn conversation with an agent node for Amazon Bedrock Flows (preview)

Using natural language in Amazon Q Business: From searching and creating ServiceNow incidents and knowledge articles to generating insights

Considerations for addressing the core dimensions of responsible AI for Amazon Bedrock applications

Secure a generative AI assistant with OWASP Top 10 mitigation

GraphStorm 0.3: Scalable, multi-task learning on graphs with user-friendly APIs

Achieve multi-Region resiliency for your conversational AI chatbots with Amazon Lex

Benchmarking Amazon Nova and GPT-4o models with FloTorch

Build a Multi-Agent System with LangGraph and Mistral on AWS

Integrate dynamic web content in your generative AI application using a web search API and Amazon Bedrock Agents

Knowledge Bases for Amazon Bedrock now supports custom prompts for the RetrieveAndGenerate API and configuration of the maximum number of retrieved results

Using responsible AI principles with Amazon Bedrock Batch Inference

Streamline generative AI development in Amazon Bedrock with Prompt Management and Prompt Flows (preview)

Pixtral-12B-2409 is now available on Amazon Bedrock Marketplace

Orchestrate generative AI workflows with Amazon Bedrock and AWS Step Functions

Orchestrate an intelligent document processing workflow using tools in Amazon Bedrock

Improve the productivity of your customer support and project management teams using Amazon Q Business and Atlassian Jira

Implement RAG while meeting data residency requirements using AWS hybrid and edge services

Modernizing data science lifecycle management with AWS and Wipro

How AWS sales uses Amazon Q Business for customer engagement

Mistral-Small-24B-Instruct-2501 is now available on SageMaker Jumpstart and Amazon Bedrock Marketplace

From innovation to impact: How AWS and NVIDIA enable real-world generative AI success

Lesson #25: Customer Sample Lists Are the Most Challenging Part of Any VoC Program—And AI Could Help (Eventually)

Dynamic metadata filtering for Amazon Bedrock Knowledge Bases with LangChain

Create an end-to-end serverless digital assistant for semantic search with Amazon Bedrock

Streamline work insights with the Amazon Q Business connector for Smartsheet

Build an internal SaaS service with cost and usage tracking for foundation models on Amazon Bedrock

Derive generative AI powered insights from Alation Cloud Services using Amazon Q Business Custom Connector

Accelerating ML experimentation with enhanced security: AWS PrivateLink support for Amazon SageMaker with MLflow

Streamline RAG applications with intelligent metadata filtering using Amazon Bedrock

Building a virtual meteorologist using Amazon Bedrock Agents

Reducing hallucinations in LLM agents with a verified semantic cache using Amazon Bedrock Knowledge Bases

How Formula 1® uses generative AI to accelerate race-day issue resolution

Amazon Q Business simplifies integration of enterprise knowledge bases at scale

Stay Connected