AWS Machine Learning

MARCH 6, 2023

In this post, we dive into tips and best practices for successful LLM training on Amazon SageMaker Training. The post covers all the phases of an LLM training workload and describes associated infrastructure features and best practices. Some of the best practices in this post refer specifically to ml.p4d.24xlarge

Best practices 105

Best practices APIs Transportation Scripts 105

AWS Machine Learning

AUGUST 19, 2022

Because many data scientists may lack experience in the acceleration training process, in this post we show you the factors that matter for fast deep learning model training and the best practices of acceleration training for TensorFlow 1.x We discuss best practices in the following areas: Accelerate training on a single instance.

Best practices 101

Best practices APIs Scripts Advertising 101

AWS Machine Learning

OCTOBER 2, 2024

This two-part series explores best practices for building generative AI applications using Amazon Bedrock Agents. This data provides a benchmark for expected agent behavior, including the interaction with existing APIs, knowledge bases, and guardrails connected with the agent.

Best practices 97

Best practices APIs Metrics Accountability 97

AWS Machine Learning

JULY 7, 2022

You liked the overall experience and now want to deploy the bot in your production environment, but aren’t sure about best practices for Amazon Lex. In this post, we review the best practices for developing and deploying Amazon Lex bots, enabling you to streamline the end-to-end bot lifecycle and optimize your operations.

Best practices 98

Best practices Metrics APIs Accountability 98

AWS Machine Learning

NOVEMBER 1, 2024

In this post, we explore the best practices and lessons learned for fine-tuning Anthropic’s Claude 3 Haiku on Amazon Bedrock. Structured outputs – For example, when you have 10,000 labeled examples specific to your use case and need Anthropic’s Claude 3 Haiku to accurately identify them. Sonnet across various tasks.

Best practices 96

Best practices APIs Finance Engineering 96

AWS Machine Learning

NOVEMBER 14, 2024

A tag value (for example, Production ) is also case sensitive, like the keys. For example, tagging resources with their environment allows automating tasks like stopping non-production instances after hours. For example, tags like environment or owner help identify technical attributes. Tag keys and values are case sensitive.

Government 107

Government Best practices Accountability APIs 107

AWS Machine Learning

APRIL 9, 2024

In this post, we discuss two new features of Knowledge Bases for Amazon Bedrock specific to the RetrieveAndGenerate API: configuring the maximum number of results and creating custom prompts with a knowledge base prompt template. Additionally, you can add custom instructions and examples tailored to your specific workflows.

APIs 133

APIs Engineering Healthcare Education 133

AWS Machine Learning

JANUARY 10, 2023

This post describes the best practices for load testing a SageMaker endpoint to find the right configuration for the number of instances and size. The entire set of code for the example is available in the following GitHub repository. Overview of solution. MemoryUtilization , on the other hand, is in the range of 0–100%.

Best practices 100

Best practices Scripts APIs Metrics 100

Help Scout

JULY 29, 2021

The 18 FAQ examples below will give you a great basis of ideas to work from to make your knowledge base content exceptional. 18 great examples of effective FAQ pages and content We’ve found companies across multiple industries with FAQ examples that we find inspiring and super helpful. Below are our 18 favorites.

Self service 142

Self service Education Telecommunications APIs 142

AWS Machine Learning

FEBRUARY 9, 2024

For example, they may need to track the usage of FMs across teams, chargeback costs and provide visibility to the relevant cost center in the LOB. For example, if only specific FMs may be approved for use. We use API keys to restrict and monitor API access for teams. Each team is assigned an API key for access to the FMs.

SaaS 144

SaaS APIs Government Accountability 144

AWS Machine Learning

SEPTEMBER 18, 2024

Amazon Bedrock enables access to powerful generative AI models like Stable Diffusion through a user-friendly API. For example, it can fill in a line drawing with colors, lighting, and a background that makes sense for the subject. The user chooses Call API to invoke API Gateway to begin processing on the backend.

APIs 127

APIs Best practices Entertainment Advertising 127

AWS Machine Learning

OCTOBER 2, 2024

Because this is an emerging area, best practices, practical guidance, and design patterns are difficult to find in an easily consumable basis. This integration makes sure enterprises can take advantage of the full power of generative AI while adhering to best practices in operational excellence.

Government 127

Government APIs Enterprise Best practices 127

AWS Machine Learning

JANUARY 22, 2025

Amazon Bedrock Flows offers an intuitive visual builder and a set of APIs to seamlessly link foundation models (FMs), Amazon Bedrock features, and AWS services to build and automate user-defined generative AI workflows at scale. For our example, we chose Amazons Nova Lite model and set the temperature inference parameter to 0.1

APIs 129

APIs Transportation Best practices Enterprise 129

AWS Machine Learning

OCTOBER 30, 2023

It allows developers to build and scale generative AI applications using FMs through an API, without managing infrastructure. You can choose from various FMs from Amazon and leading AI startups such as AI21 Labs, Anthropic, Cohere, and Stability AI to find the model that’s best suited for your use case.

APIs 141

APIs Big data Accountability Enterprise 141

Inbenta

APRIL 29, 2020

Indeed, the development of a chatbot implies creating new jobs such as the one of Botmaster for example. Lack of expertise on chatbot best practices regarding ergonomic or editorial. Our ebook will give you all the tips and best practices to carry out this project. How long does it take to deploy an AI chatbot?

Chatbots 140

Chatbots APIs Construction Best practices 140

AWS Machine Learning

NOVEMBER 15, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

APIs 110

APIs Government Best practices Metrics 110

AWS Machine Learning

NOVEMBER 7, 2024

It also uses a number of other AWS services such as Amazon API Gateway , AWS Lambda , and Amazon SageMaker. It contains services used to onboard, manage, and operate the environment, for example, to onboard and off-board tenants, users, and models, assign quotas to different tenants, and authentication and authorization microservices.

Enterprise 112

Enterprise APIs Government Accountability 112

AWS Machine Learning

JULY 10, 2024

You can use the Prompt Management and Flows features graphically on the Amazon Bedrock console or Amazon Bedrock Studio, or programmatically through the Amazon Bedrock SDK APIs. Alternatively, you can use the CreateFlow API for a programmatic creation of flows that help you automate processes and development pipelines.

Management 131

Management APIs Chatbots Best practices 131

AWS Machine Learning

JANUARY 28, 2025

Using SageMaker with MLflow to track experiments The fully managed MLflow capability on SageMaker is built around three core components: MLflow tracking server This component can be quickly set up through the Amazon SageMaker Studio interface or using the API for more granular configurations.

Management 113

Management APIs Engineering Metrics 113

AWS Machine Learning

AUGUST 26, 2024

The GenASL web app invokes the backend services by sending the S3 object key in the payload to an API hosted on Amazon API Gateway. API Gateway instantiates an AWS Step Functions The state machine orchestrates the AI/ML services Amazon Transcribe and Amazon Bedrock and the NoSQL data store Amazon DynamoDB using AWS Lambda functions.

APIs 119

APIs Calibration Best practices Metrics 119

AWS Machine Learning

OCTOBER 29, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies such as AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon through a single API, along with a broad set of capabilities you need to build generative AI applications with security, privacy, and responsible AI.

Best practices 112

Best practices Feedback Metrics APIs 112

AWS Machine Learning

JANUARY 24, 2025

In this post, we show you an example of a generative AI assistant application and demonstrate how to assess its security posture using the OWASP Top 10 for Large Language Model Applications , as well as how to apply mitigations for common threats. These steps might involve both the use of an LLM and external data sources and APIs.

APIs 114

APIs Scripts Best practices Management 114

AWS Machine Learning

MAY 17, 2024

This includes task context, data that you pass to the model, conversation and action history, instructions, and even examples. Example overview To illustrate this example, consider a retail company that allows purchasers to post product reviews on their website. Hence the example uses Step Functions for workflow orchestration.

APIs 135

APIs Construction Engineering Enterprise 135

AWS Machine Learning

JULY 30, 2024

For example, it enables user subscription management across Amazon Q offerings and consolidates Amazon Q billing from across multiple AWS accounts. Additionally, Q Business conversation APIs employ a layer of privacy protection by leveraging trusted identity propagation enabled by IAM Identity Center. Finally, you have an OAuth 2.0

APIs 131

APIs Enterprise Accountability Management 131

AWS Machine Learning

FEBRUARY 9, 2023

In this post, we discuss the benefits of the AnalyzeDocument Signatures feature and how the AnalyzeDocument Signatures API helps detect signatures in documents. Lastly, we share some best practices for using this feature. In the following example, we detect signatures on an employment verification letter.

APIs 103

APIs Best practices Banking Enterprise 103

AWS Machine Learning

JANUARY 27, 2025

Solution overview To get started with Nova Canvas and Nova Reel, you can either use the Image/Video Playground on the Amazon Bedrock console or access the models through APIs. Example: A blue sports car parked in front of a grand villa. Example: Rendered in a cinematic style with vivid, high-contrast details.

Engineering 109

Engineering Best practices Entertainment APIs 109

AWS Machine Learning

SEPTEMBER 12, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon through a unified API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

Healthcare 126

Healthcare APIs Accountability Enterprise 126

AWS Machine Learning

SEPTEMBER 28, 2023

A Generative AI Gateway can help large enterprises control, standardize, and govern FM consumption from services such as Amazon Bedrock , Amazon SageMaker JumpStart , third-party model providers (such as Anthropic and their APIs), and other model providers outside of the AWS ecosystem. What is a Generative AI Gateway?

APIs 118

APIs Government Enterprise Engineering 118

AWS Machine Learning

DECEMBER 18, 2024

Although were using admin privileges for the purpose of this post, its a security best practice to apply least privilege permissions and grant only the permissions required to perform a task. This involves creating an OAuth API endpoint in ServiceNow and using the web experience URL from Amazon Q Business as the callback URL.

APIs 97

APIs Enterprise Accountability Government 97

AWS Machine Learning

OCTOBER 19, 2023

In this post, we discuss how to use the Custom Moderation feature in Amazon Rekognition to enhance the accuracy of your pre-trained content moderation API. The unique ID of the trained adapter can be provided to the existing DetectModerationLabels API operation to process images using this adapter.

APIs 131

APIs Best practices Advertising Accountability 131

AWS Machine Learning

NOVEMBER 2, 2023

Amazon Bedrock is a fully managed service that makes foundation models from leading AI startups and Amazon available via easy-to-use API interfaces. The solution also uses the grammatical error correction API and the paraphrase API from AI21 to recommend word and sentence corrections.

APIs 129

APIs Education Transportation Accountability 129

AWS Machine Learning

NOVEMBER 17, 2023

The structured prompts include a sequence of question-thought-action-observation examples. The action is an API that the model can invoke from an allowed set of APIs. Action groups are mapped to an AWS Lambda function and related API schema to perform API calls. The following diagram depicts the agent structure.

APIs 115

APIs Customer Service Construction Analytics 115

AWS Machine Learning

APRIL 22, 2024

It provides examples of use cases and best practices for using generative AI’s potential to accelerate sustainability and ESG initiatives, as well as insights into the main operational challenges of generative AI for sustainability. Following this step and evaluating your system thoroughly is essential before deployment.

Best practices 138

Best practices Benchmark Transportation Engineering 138

AWS Machine Learning

APRIL 18, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon with a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

Scripts 127

Scripts Best practices Engineering Accountability 127

AWS Machine Learning

MAY 7, 2024

Amazon Transcribe The transcription for the entire video is generated using the StartTranscriptionJob API. The raw transcripts are further processed to be stored using timestamps, as shown in the following example. The metadata generated for each video by the APIs is processed and stored with timestamps.

APIs 135

APIs Advertising Entertainment Metrics 135

AWS Machine Learning

FEBRUARY 8, 2024

At the forefront of this evolution sits Amazon Bedrock , a fully managed service that makes high-performing foundation models (FMs) from Amazon and other leading AI companies available through an API. The code and resources required for deployment are available in the amazon-bedrock-examples repository.

APIs 139

APIs Scripts Enterprise Management 139

aircall

MAY 28, 2021

With best practices for text messaging, your customer-facing teams will provide better service, while your sales and marketing teams can better interact with leads on a more personalized scale to more efficiently close deals. Why Use Text Messaging Best Practices. SMS Marketing: Text Messaging Marketing Best Practices.

Best practices 62

Best practices Sales Wireless Marketing 62