AWS Machine Learning

MARCH 6, 2025

By using the power of LLMs and combining them with specialized tools and APIs, agents can tackle complex, multistep tasks that were previously beyond the reach of traditional AI systems. Whenever local database information is unavailable, it triggers an online search using the Tavily API. Its used by the weather_agent() function.

APIs 123

APIs Scripts Enterprise Management 123

AWS Machine Learning

JULY 31, 2024

The new ApplyGuardrail API enables you to assess any text using your preconfigured guardrails in Amazon Bedrock, without invoking the FMs. In this post, we demonstrate how to use the ApplyGuardrail API with long-context inputs and streaming outputs. For example, you can now use the API with models hosted on Amazon SageMaker.

APIs 131

APIs Banking Best practices Engineering 131

AWS Machine Learning

JANUARY 24, 2025

In this post, we show you an example of a generative AI assistant application and demonstrate how to assess its security posture using the OWASP Top 10 for Large Language Model Applications , as well as how to apply mitigations for common threats. These steps might involve both the use of an LLM and external data sources and APIs.

APIs 116

APIs Scripts Best practices Management 116

AWS Machine Learning

NOVEMBER 14, 2024

Customers can use the SageMaker Studio UI or APIs to specify the SageMaker Model Registry model to be shared and grant access to specific AWS accounts or to everyone in the organization. We will demonstrate how to set up a central model registry based on the architecture we described in the previous sections.

Government 103

Government Management APIs Accountability 103

AWS Machine Learning

SEPTEMBER 13, 2024

Intricate workflows that require dynamic and complex API orchestration can often be complex to manage. In this post, we explore how chaining domain-specific agents using Amazon Bedrock Agents can transform a system of complex API interactions into streamlined, adaptive workflows, empowering your business to operate with agility and precision.

APIs 135

APIs Enterprise Best practices Accountability 135

AWS Machine Learning

OCTOBER 29, 2024

Furthermore, these notes are usually personal and not stored in a central location, which is a lost opportunity for businesses to learn what does and doesn’t work, as well as how to improve their sales, purchasing, and communication processes. It also supports audio files so you have flexibility around the type of call recordings you use.

Engineering 114

Engineering APIs Sales Enterprise 114

AWS Machine Learning

AUGUST 2, 2024

adds new APIs to customize GraphStorm pipelines: you now only need 12 lines of code to implement a custom node classification training loop. For more details about how to run graph multi-task learning with GraphStorm, refer to Multi-task Learning in GraphStorm in our documentation. introduces refactored graph ML pipeline APIs.

APIs 121

APIs Benchmark Construction Enterprise 121

AWS Machine Learning

NOVEMBER 15, 2024

In this post, we introduce the core dimensions of responsible AI and explore considerations and strategies on how to address these dimensions for Amazon Bedrock applications. When using the RetrieveAndGenerate API, the output includes the generated response, the source attribution, and the retrieved text chunks.

APIs 114

APIs Government Best practices Metrics 114

AWS Machine Learning

NOVEMBER 13, 2024

The solution also uses Amazon Cognito user pools and identity pools for managing authentication and authorization of users, Amazon API Gateway REST APIs, AWS Lambda functions, and an Amazon Simple Storage Service (Amazon S3) bucket. The summary is stored inside an S3 bucket, which can be emptied using the extension’s Clean Up feature.

APIs 134

APIs Scripts Accountability Entertainment 134

AWS Machine Learning

APRIL 10, 2025

You can get started without any prior machine learning (ML) experience, and Amazon Personalize allows you to use APIs to build sophisticated personalization capabilities. In this post, we demonstrate how to use Amazon Personalize and Amazon Bedrock to generate personalized outreach emails for individual users using a video-on-demand use case.

Personalization 100

Personalization APIs Advertising Accountability 100

AWS Machine Learning

OCTOBER 30, 2024

Additionally, we discuss how to handle integrations with AWS Lambda and Amazon CloudWatch after enabling Global Resiliency. Enabling Global Resiliency for an Amazon Lex bot is straightforward using the AWS Management Console , AWS Command Line Interface (AWS CLI), or APIs. These are supported in the AWS CLI and AWS SDKs.

Chatbots 112

Chatbots Interactive Voice Response APIs Telecommunications 112

AWS Machine Learning

JANUARY 22, 2025

Amazon Bedrock Flows offers an intuitive visual builder and a set of APIs to seamlessly link foundation models (FMs), Amazon Bedrock features, and AWS services to build and automate user-defined generative AI workflows at scale. Test the flow Youre now ready to test the flow through the Amazon Bedrock console or API.

APIs 132

APIs Transportation Best practices Enterprise 132

AWS Machine Learning

MARCH 19, 2025

This could be APIs, code functions, or schemas and structures required by your end application. To add fine-grained control to how tools are used, we have released a feature for tool choice for Amazon Nova models. Based on the users query, Amazon Nova will select the appropriate tool and tell you how to use it.

APIs 99

APIs Engineering Chatbots Best practices 99

AWS Machine Learning

DECEMBER 4, 2024

This includes setting up Amazon API Gateway , AWS Lambda functions, and Amazon Athena to enable querying the structured sales data. Navigate to the AWS Secrets Manager console and find the secret -api-keys. Each subsequent section will guide you through exactly when and how to use these files.

APIs 108

APIs Sales Surveys Analytics 108

AWS Machine Learning

APRIL 10, 2025

In this post, we demonstrate how to effectively perform model customization and RAG with Amazon Nova models as a baseline. Fine-tune an Amazon Nova model using the Amazon Bedrock API In this section, we provide detailed walkthroughs on fine-tuning and hosting customized Amazon Nova models using Amazon Bedrock.

APIs 120

APIs Metrics Best practices Construction 120

AWS Machine Learning

JANUARY 28, 2025

In this post, we show how to use FMEval and Amazon SageMaker to programmatically evaluate LLMs. It functions as a standalone HTTP server that provides various REST API endpoints for monitoring, recording, and visualizing experiment runs. This allows you to keep track of your ML experiments.

Management 112

Management APIs Engineering Metrics 112

AWS Machine Learning

SEPTEMBER 20, 2024

Amazon Bedrock agents use LLMs to break down tasks, interact dynamically with users, run actions through API calls, and augment knowledge using Amazon Bedrock Knowledge Bases. In this post, we demonstrate how to use Amazon Bedrock Agents with a web search API to integrate dynamic web content in your generative AI application.

APIs 107

APIs Chatbots Construction Engineering 107

AWS Machine Learning

MARCH 25, 2025

Finally, we explore how to set up rolling updates in different scenarios. For more information about the SageMaker AI API, refer to the SageMaker AI API Reference. Customer experience Lets explore how rolling updates work in practice with several common scenarios, using different-sized LLMs.

APIs 110

APIs Engineering Accountability Metrics 110

AWS Machine Learning

DECEMBER 18, 2024

In this post, well demonstrate how to configure an Amazon Q Business application and add a custom plugin that gives users the ability to use a natural language interface provided by Amazon Q Business to query real-time data and take actions in ServiceNow. The other fields are automatically generated by the ServiceNow OAuth server.

APIs 91

APIs Enterprise Accountability Government 91

AWS Machine Learning

DECEMBER 2, 2024

In this post, we explore the new scale to zero feature for SageMaker inference endpoints, demonstrating how to implement and use this capability to optimize costs and manage resources more effectively. Now that we understand when to use the scale to zero feature, let’s dive into how to optimize its performance and implement it effectively.

APIs 108

APIs Best practices Metrics Engineering 108

AWS Machine Learning

FEBRUARY 21, 2025

The solution uses the FMs tool use capabilities, accessed through the Amazon Bedrock Converse API. This enables the FMs to not just process text, but to actively engage with various external tools and APIs to perform complex document analysis tasks. For more details on how tool use works, refer to The complete tool use workflow.

APIs 91

APIs Healthcare Consulting Consulting 91

AWS Machine Learning

MARCH 26, 2025

In the following sections, we provide guidance on how to use these new private model hub features using the Amazon SageMaker SDK and Amazon SageMaker Studio console. To learn more about how to manage models using private hubs, see Manage Amazon SageMaker JumpStart foundation model access with private hubs.

APIs 104

APIs Enterprise Government Accountability 104

AWS Machine Learning

NOVEMBER 13, 2024

The Amazon Bedrock single API access, regardless of the models you choose, gives you the flexibility to use different FMs and upgrade to the latest model versions with minimal code changes. Amazon Titan FMs provide customers with a breadth of high-performing image, multimodal, and text model choices, through a fully managed API.

Engineering 119

Engineering Management APIs Healthcare 119

AWS Machine Learning

NOVEMBER 21, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

APIs 114

APIs Call Center Engineering Personalization 114

AWS Machine Learning

MARCH 4, 2025

invoke(inputs["query"])) ) return retrieval_chain Option 2: Access the underlying Boto3 API The Boto3 API is able to directly retrieve with a dynamic retrieval_config. For Amazon Bedrock: Use IAM roles and policies to control access to Bedrock resources and APIs.

APIs 111

APIs Best practices Management Personalization 111

AWS Machine Learning

NOVEMBER 22, 2024

Cloud providers have recognized the need to offer model inference through an API call, significantly streamlining the implementation of AI within applications. Although a single API call can address simple use cases, more complex ones may necessitate the use of multiple calls and integrations with other services.

APIs 94

APIs Technology Management Enterprise 94

AWS Machine Learning

MARCH 19, 2025

The question is no longer whether to adopt generative AI, but how to move from promising pilots to production-ready systems that deliver real business value. As we gather for NVIDIA GTC, organizations of all sizes are at a pivotal moment in their AI journey. The results speak for themselvestheir inference stack achieves up to 3.1

Healthcare 144

Healthcare Enterprise APIs Transportation 144

AWS Machine Learning

NOVEMBER 21, 2024

Take, for instance, text-to-video generation, where models need to learn not just what to generate but how to maintain consistency and natural flow across time. This granular input helps models learn how to produce speech that sounds natural, with appropriate pacing and emotional consistency. We demonstrate how to use Wavesurfer.js

APIs 100

APIs Feedback Telecommunications Management 100

AWS Machine Learning

FEBRUARY 12, 2025

Amazon Bedrock is a fully managed service that makes FMs from leading AI startups and Amazon available through an API, so you can choose from a wide range of FMs to find the model that is best suited for your use case. In this post, we explore how to use Amazon Bedrock to generate synthetic training data to fine-tune an LLM.

APIs 79

APIs Management Benchmark Scripts 79

AWS Machine Learning

MARCH 27, 2025

In this post, we explore how to modify your Regional access controls to specifically allow Amazon Bedrock cross-Region inference while maintaining broader Regional restrictions for other AWS services. v2 using the Amazon Bedrock console or the API by assuming the custom IAM role mentioned in the previous step ( Bedrock-Access-CRI ).

Accountability 120

Accountability Government APIs Enterprise 120

AWS Machine Learning

APRIL 9, 2024

In this post, we discuss two new features of Knowledge Bases for Amazon Bedrock specific to the RetrieveAndGenerate API: configuring the maximum number of results and creating custom prompts with a knowledge base prompt template. You can now choose these as query options alongside the search type. The citations are also listed for reference.

APIs 137

APIs Engineering Healthcare Education 137

AWS Machine Learning

MARCH 6, 2025

Amazon Bedrock is a fully managed service that offers a choice of high-performing Foundation Models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon via a single API, along with a broad set of capabilities you need to build generative AI applications with security, privacy, and responsible AI.

Metrics 118

Metrics Enterprise APIs Engineering 118

AWS Machine Learning

NOVEMBER 15, 2024

We gave practical tips, based on hands-on experience with customer use cases, on how to improve text-only RAG solutions, from optimizing the retriever to mitigating and detecting hallucinations. We first introduce routers, and how they can help managing diverse data sources. This post focuses on doing RAG on heterogeneous data formats.

APIs 122

APIs Engineering Chatbots Construction 122

AWS Machine Learning

MARCH 27, 2025

We dive deep into this process on how to use XML tags to structure the prompt and guide Amazon Bedrock in generating a balanced label dataset with high accuracy. In the following sections, we explain how to take an incremental and measured approach to improve Anthropics Claude 3.5 Sonnet prediction accuracy through prompt engineering.

Education 113

Education Engineering APIs Enterprise 113

AWS Machine Learning

FEBRUARY 21, 2025

Solution overview Our solution implements a verified semantic cache using the Amazon Bedrock Knowledge Bases Retrieve API to reduce hallucinations in LLM responses while simultaneously improving latency and reducing costs. The function checks the semantic cache (Amazon Bedrock Knowledge Bases) using the Retrieve API.

Engineering 125

Engineering APIs Analytics Enterprise 125

AWS Machine Learning

APRIL 10, 2025

By choosing View API , you can also access the model using code examples in the AWS Command Line Interface (AWS CLI) and AWS SDKs. For more information on generating JSON using the Converse API, refer to Generating JSON with the Amazon Bedrock Converse API. Additionally, Pixtral Large supports the Converse API and tool usage.

APIs 105

APIs Management Marketing Engineering 105

AWS Machine Learning

JANUARY 14, 2025

In this post, we show how to extend Amazon Bedrock Agents to hybrid and edge services such as AWS Outposts and AWS Local Zones to build distributed Retrieval Augmented Generation (RAG) applications with on-premises data for improved model outcomes. Through the frontend application, the user prompts the chatbot interface with a question.

APIs 104

APIs Chatbots Enterprise Healthcare 104