AWS Machine Learning

JANUARY 4, 2024

In this post, we provide an introduction to text to SQL (Text2SQL) and explore use cases, challenges, design patterns, and best practices. Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) via a single API, enabling to easily build and scale Gen AI applications.

Best practices 139

Best practices Enterprise Engineering APIs 139

AWS Machine Learning

JANUARY 24, 2025

In this post, we show you an example of a generative AI assistant application and demonstrate how to assess its security posture using the OWASP Top 10 for Large Language Model Applications , as well as how to apply mitigations for common threats. These steps might involve both the use of an LLM and external data sources and APIs.

APIs 108

APIs Scripts Best practices Management 108

AWS Machine Learning

SEPTEMBER 13, 2024

Intricate workflows that require dynamic and complex API orchestration can often be complex to manage. In this post, we explore how chaining domain-specific agents using Amazon Bedrock Agents can transform a system of complex API interactions into streamlined, adaptive workflows, empowering your business to operate with agility and precision.

APIs 131

APIs Enterprise Best practices Accountability 131

AWS Machine Learning

DECEMBER 18, 2024

Although were using admin privileges for the purpose of this post, its a security best practice to apply least privilege permissions and grant only the permissions required to perform a task. This involves creating an OAuth API endpoint in ServiceNow and using the web experience URL from Amazon Q Business as the callback URL.

APIs 86

APIs Enterprise Accountability Government 86

AWS Machine Learning

JANUARY 28, 2025

Using SageMaker with MLflow to track experiments The fully managed MLflow capability on SageMaker is built around three core components: MLflow tracking server This component can be quickly set up through the Amazon SageMaker Studio interface or using the API for more granular configurations.

Management 104

Management APIs Engineering Metrics 104

AWS Machine Learning

MARCH 25, 2024

Amazon Transcribe can be used for transcription of customer care calls, multiparty conference calls, and voicemail messages, as well as subtitle generation for recorded and live videos, to name just a few examples. Applications must have valid credentials to sign API requests to AWS services.

Best practices 107

Best practices APIs Transportation Personalization 107

AWS Machine Learning

MARCH 14, 2024

By the end, you will have solid guidelines and a helpful flow chart for determining the best method to develop your own FM-powered applications, grounded in real-life examples. The following screenshot shows an example of a zero-shot prompt with the Anthropic Claude 2.1 In these instructions, we didn’t provide any examples.

Best practices 131

Best practices Engineering Chatbots Enterprise 131

AWS Machine Learning

AUGUST 2, 2024

adds new APIs to customize GraphStorm pipelines: you now only need 12 lines of code to implement a custom node classification training loop. To help you get started with the new API, we have published two Jupyter notebook examples: one for node classification, and one for a link prediction task. Specifically, GraphStorm 0.3

APIs 115

APIs Benchmark Construction Enterprise 115

AWS Machine Learning

JANUARY 27, 2025

Solution overview To get started with Nova Canvas and Nova Reel, you can either use the Image/Video Playground on the Amazon Bedrock console or access the models through APIs. Example: A blue sports car parked in front of a grand villa. Example: Rendered in a cinematic style with vivid, high-contrast details.

Engineering 98

Engineering Best practices Entertainment APIs 98

AWS Machine Learning

MARCH 4, 2025

Solution overview The following code is an example metadata filter for Amazon Bedrock Knowledge Bases. We have provided example documents and metadata in the accompanying GitHub repo for you to upload. This example data contains user answers to an online questionnaire about travel preferences.

APIs 85

APIs Best practices Management Personalization 85

AWS Machine Learning

MARCH 6, 2023

In this post, we dive into tips and best practices for successful LLM training on Amazon SageMaker Training. The post covers all the phases of an LLM training workload and describes associated infrastructure features and best practices. Some of the best practices in this post refer specifically to ml.p4d.24xlarge

Best practices 101

Best practices APIs Transportation Scripts 101

AWS Machine Learning

OCTOBER 2, 2024

This two-part series explores best practices for building generative AI applications using Amazon Bedrock Agents. This data provides a benchmark for expected agent behavior, including the interaction with existing APIs, knowledge bases, and guardrails connected with the agent.

Best practices 97

Best practices APIs Metrics Accountability 97

AWS Machine Learning

FEBRUARY 12, 2025

Amazon Bedrock , a fully managed service offering high-performing foundation models from leading AI companies through a single API, has recently introduced two significant evaluation capabilities: LLM-as-a-judge under Amazon Bedrock Model Evaluation and RAG evaluation for Amazon Bedrock Knowledge Bases. keys()) & set(metrics2.keys())

Metrics 93

Metrics Engineering APIs Benchmark 93

AWS Machine Learning

APRIL 9, 2024

In this post, we discuss two new features of Knowledge Bases for Amazon Bedrock specific to the RetrieveAndGenerate API: configuring the maximum number of results and creating custom prompts with a knowledge base prompt template. Additionally, you can add custom instructions and examples tailored to your specific workflows.

APIs 134

APIs Engineering Healthcare Education 134

AWS Machine Learning

MARCH 27, 2025

We also showcase a real-world example for predicting the root cause category for support cases. For the use case of labeling the support root cause categories, its often harder to source examples for categories such as Software Defect, Feature Request, and Documentation Improvement for labeling than it is for Customer Education.

Education 91

Education Engineering APIs Enterprise 91

AWS Machine Learning

JULY 7, 2022

You liked the overall experience and now want to deploy the bot in your production environment, but aren’t sure about best practices for Amazon Lex. In this post, we review the best practices for developing and deploying Amazon Lex bots, enabling you to streamline the end-to-end bot lifecycle and optimize your operations.

Best practices 94

Best practices Metrics APIs Accountability 94

AWS Machine Learning

MARCH 19, 2025

This could be APIs, code functions, or schemas and structures required by your end application. In this post, we discuss tool use and the new tool choice feature, with example use cases. For example, if a user asks What is the weather in Seattle? For example, if a user asks What is the weather in Seattle?

APIs 71

APIs Engineering Chatbots Best practices 71

AWS Machine Learning

NOVEMBER 1, 2024

In this post, we explore the best practices and lessons learned for fine-tuning Anthropic’s Claude 3 Haiku on Amazon Bedrock. Structured outputs – For example, when you have 10,000 labeled examples specific to your use case and need Anthropic’s Claude 3 Haiku to accurately identify them. Sonnet across various tasks.

Best practices 95

Best practices APIs Finance Engineering 95

AWS Machine Learning

AUGUST 19, 2022

Because many data scientists may lack experience in the acceleration training process, in this post we show you the factors that matter for fast deep learning model training and the best practices of acceleration training for TensorFlow 1.x We discuss best practices in the following areas: Accelerate training on a single instance.

Best practices 93

Best practices APIs Scripts Advertising 93

Help Scout

JULY 29, 2021

The 18 FAQ examples below will give you a great basis of ideas to work from to make your knowledge base content exceptional. 18 great examples of effective FAQ pages and content We’ve found companies across multiple industries with FAQ examples that we find inspiring and super helpful. Below are our 18 favorites.

Self service 142

Self service Education Telecommunications APIs 142

AWS Machine Learning

FEBRUARY 11, 2025

First we discuss end-to-end large-scale data integration with Amazon Q Business, covering data preprocessing, security guardrail implementation, and Amazon Q Business best practices. The following diagram illustrates an example architecture for ingesting data through an endpoint interfacing with a large corpus.

Enterprise 91

Enterprise Engineering APIs Best practices 91

AWS Machine Learning

JANUARY 10, 2023

This post describes the best practices for load testing a SageMaker endpoint to find the right configuration for the number of instances and size. The entire set of code for the example is available in the following GitHub repository. Overview of solution. MemoryUtilization , on the other hand, is in the range of 0–100%.

Best practices 93

Best practices Scripts APIs Metrics 93

AWS Machine Learning

NOVEMBER 15, 2024

For example, a technician could query the system about a specific machine part, receiving both textual maintenance history and annotated images showing wear patterns or common failure points, enhancing their ability to diagnose and resolve issues efficiently. In practice, the router module can be implemented with an initial LLM call.

APIs 117

APIs Engineering Chatbots Construction 117

AWS Machine Learning

FEBRUARY 5, 2025

Through this practical example, well illustrate how startups can harness the power of LLMs to enhance customer experiences and the simplicity of Nemo Guardrails to guide the LLMs driven conversation toward the desired outcomes. model API exposed by SageMaker JumpStart properly. The Llama 3.1

Chatbots 99

Chatbots Construction Best practices APIs 99

AWS Machine Learning

NOVEMBER 21, 2024

For example, in speech generation, an unnatural pause might last only a fraction of a second, but its impact on perceived quality is significant. This setup follows AWS best practices for least-privilege access, making sure CloudFront can only access the specific UI files needed for the annotation interface. val(option).text(option));

APIs 95

APIs Feedback Telecommunications Management 95

AWS Machine Learning

FEBRUARY 7, 2025

The implementation uses Slacks event subscription API to process incoming messages and Slacks Web API to send responses. The following screenshot shows an example. The incoming event from Slack is sent to an endpoint in API Gateway, and Slack expects a response in less than 3 seconds, otherwise the request fails.

Entertainment 77

Entertainment APIs Technology Feedback 77

AWS Machine Learning

FEBRUARY 9, 2024

For example, they may need to track the usage of FMs across teams, chargeback costs and provide visibility to the relevant cost center in the LOB. For example, if only specific FMs may be approved for use. We use API keys to restrict and monitor API access for teams. Each team is assigned an API key for access to the FMs.

SaaS 144

SaaS APIs Government Accountability 144

AWS Machine Learning

SEPTEMBER 18, 2024

Amazon Bedrock enables access to powerful generative AI models like Stable Diffusion through a user-friendly API. For example, it can fill in a line drawing with colors, lighting, and a background that makes sense for the subject. The user chooses Call API to invoke API Gateway to begin processing on the backend.

APIs 128

APIs Entertainment Best practices Advertising 128

AWS Machine Learning

FEBRUARY 28, 2025

The following are examples of questions you can ask Amazon Q Business to gain actionable insights: Project status updates Get quick insights into project health Whats the status of the website redesign project? In this example, were using Smartsheet to track tasks for a software development project. A Smartsheet access token.

APIs 66

APIs Enterprise Accountability Management 66

AWS Machine Learning

OCTOBER 30, 2023

It allows developers to build and scale generative AI applications using FMs through an API, without managing infrastructure. You can choose from various FMs from Amazon and leading AI startups such as AI21 Labs, Anthropic, Cohere, and Stability AI to find the model that’s best suited for your use case.

APIs 141

APIs Big data Accountability Enterprise 141

AWS Machine Learning

OCTOBER 2, 2024

Because this is an emerging area, best practices, practical guidance, and design patterns are difficult to find in an easily consumable basis. This integration makes sure enterprises can take advantage of the full power of generative AI while adhering to best practices in operational excellence.

Government 123

Government APIs Enterprise Best practices 123

Inbenta

APRIL 29, 2020

Indeed, the development of a chatbot implies creating new jobs such as the one of Botmaster for example. Lack of expertise on chatbot best practices regarding ergonomic or editorial. Our ebook will give you all the tips and best practices to carry out this project. How long does it take to deploy an AI chatbot?

Chatbots 140

Chatbots APIs Construction Best practices 140

AWS Machine Learning

AUGUST 26, 2024

The GenASL web app invokes the backend services by sending the S3 object key in the payload to an API hosted on Amazon API Gateway. API Gateway instantiates an AWS Step Functions The state machine orchestrates the AI/ML services Amazon Transcribe and Amazon Bedrock and the NoSQL data store Amazon DynamoDB using AWS Lambda functions.

APIs 120

APIs Calibration Best practices Metrics 120

AWS Machine Learning

MAY 17, 2024

This includes task context, data that you pass to the model, conversation and action history, instructions, and even examples. Example overview To illustrate this example, consider a retail company that allows purchasers to post product reviews on their website. Hence the example uses Step Functions for workflow orchestration.

APIs 135

APIs Construction Engineering Enterprise 135

AWS Machine Learning

JULY 10, 2024

You can use the Prompt Management and Flows features graphically on the Amazon Bedrock console or Amazon Bedrock Studio, or programmatically through the Amazon Bedrock SDK APIs. Alternatively, you can use the CreateFlow API for a programmatic creation of flows that help you automate processes and development pipelines.

Management 128

Management APIs Chatbots Best practices 128

AWS Machine Learning

FEBRUARY 25, 2025

For example, What are the top sections of the HR benefits policies? As a security best practice, storing the client application data in Secrets Manager is recommended. Create sample Alation policies In our example, you would create three different sets of Alation policies for a fictional organization named Unicorn Rentals.

Enterprise 92

Enterprise Engineering APIs Accountability 92

AWS Machine Learning

SEPTEMBER 12, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon through a unified API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

Healthcare 127

Healthcare APIs Accountability Enterprise 127