AWS Machine Learning

SEPTEMBER 20, 2024

Amazon Bedrock agents use LLMs to break down tasks, interact dynamically with users, run actions through API calls, and augment knowledge using Amazon Bedrock Knowledge Bases. In this post, we demonstrate how to use Amazon Bedrock Agents with a web search API to integrate dynamic web content in your generative AI application.

APIs 107

APIs Chatbots Construction Engineering 107

AWS Machine Learning

APRIL 9, 2024

In this post, we discuss two new features of Knowledge Bases for Amazon Bedrock specific to the RetrieveAndGenerate API: configuring the maximum number of results and creating custom prompts with a knowledge base prompt template. For best practices on prompt engineering, refer to Prompt engineering guidelines.

APIs 138

APIs Engineering Healthcare Education 138

AWS Machine Learning

JULY 2, 2024

Amazon Bedrock is a fully managed service that makes a wide range of foundation models (FMs) available though an API without having to manage any infrastructure. An Amazon OpenSearch Serverless vector engine to store enterprise data as vectors to perform semantic search. The request is sent by the web application to the API.

APIs 137

APIs Scripts Enterprise Engineering 137

AWS Machine Learning

NOVEMBER 22, 2023

We also use Vector Engine for Amazon OpenSearch Serverless (currently in preview) as the vector data store to store embeddings. Here’s how RAG operates: Data sources – RAG can draw from varied data sources, including document repositories, databases, or APIs. Lewis et al. An OpenSearch Serverless collection.

Engineering 128

Engineering Chatbots APIs Benchmark 128

AWS Machine Learning

JANUARY 10, 2024

Specialist Data Engineering at Merck, and Prabakaran Mathaiyan, Sr. ML Engineer at Tiger Analytics. The solution uses AWS Lambda , Amazon API Gateway , Amazon EventBridge , and SageMaker to automate the workflow with human approval intervention in the middle. API Gateway invokes a Lambda function to initiate model updates.

APIs 132

APIs Construction Engineering Analytics 132

AWS Machine Learning

MAY 1, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

Chatbots 133

Chatbots APIs Engineering Automotive 133

AWS Machine Learning

MARCH 27, 2024

In software engineering, there is a direct correlation between team performance and building robust, stable applications. The data community aims to adopt the rigorous engineering principles commonly used in software development into their own practices, which includes systematic approaches to design, development, testing, and maintenance.

Enterprise 124

Enterprise APIs Metrics Engineering 124

AWS Machine Learning

MAY 15, 2024

Here, Amazon SageMaker Ground Truth allowed ML engineers to easily build the human-in-the-loop workflow (step v). Regarding the inference, customers using Amazon Ads now have a new API to receive these generated images. The Amazon API Gateway receives the PUT request (step 1). Burak is still a research affiliate in MIT.

Advertising 134

Advertising APIs Engineering Benchmark 134

AWS Machine Learning

DECEMBER 4, 2024

Today, we’re excited to announce a new capability that allows you to deploy over 100 open-weight and proprietary models from Amazon SageMaker JumpStart and register them with Amazon Bedrock , allowing you to seamlessly access them through the powerful Amazon Bedrock APIs.

APIs 105

APIs Engineering Management Customer centricity 105

AWS Machine Learning

NOVEMBER 7, 2024

It also uses a number of other AWS services such as Amazon API Gateway , AWS Lambda , and Amazon SageMaker. API Gateway is serverless and hence automatically scales with traffic. API Gateway also provides a WebSocket API. Incoming requests to the gateway go through this point.

Enterprise 121

Enterprise APIs Government Accountability 121

AWS Machine Learning

MAY 17, 2024

The process of designing and refining prompts to get specific responses from these models is called prompt engineering. Detect if the review content has any harmful information using the Amazon Comprehend DetectToxicContent API. Repeat the toxicity detection through the Comprehend API for the LLM generated response.

APIs 139

APIs Construction Engineering Enterprise 139

AWS Machine Learning

AUGUST 27, 2024

Currently, users might have to engineer their applications to handle scenarios involving traffic spikes that can use service quotas from multiple regions by implementing complex techniques such as client-side load balancing between AWS regions, where Amazon Bedrock service is supported. Become more resilient to any traffic bursts.

APIs 142

APIs Engineering Best practices Management 142

AWS Machine Learning

MARCH 29, 2024

The Amazon Lex fulfillment AWS Lambda function retrieves the Talkdesk touchpoint ID and Talkdesk OAuth secrets from AWS Secrets Manager and initiates a request to Talkdesk Digital Connect using the Start a Conversation API. If the request to the Talkdesk API is successful, a Talkdesk conversation ID is returned to Amazon Lex.

Cloud contact 127

Cloud contact Contact Center Chatbots APIs 127

AWS Machine Learning

OCTOBER 14, 2024

Amazon OpenSearch Service is a powerful, highly flexible search engine that allows users to retrieve data based on a variety of lexical and semantic retrieval approaches. Also, note the physical ID of the API Gateway connection, which should look something like zxpdjtklw2 , as shown in the following screenshot.

Chatbots 131

Chatbots APIs Engineering Healthcare 131

AWS Machine Learning

MARCH 4, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies, such as AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon via a single API, along with a broad set of capabilities you need to build generative AI applications with security, privacy, and responsible AI.

Feedback 131

Feedback APIs Engineering Surveys 131

AWS Machine Learning

MAY 21, 2024

While these tasks can feel like a chore, they are critical to search engine optimization (SEO) and therefore the audience reach of the article. Rewriting these dispatches is also necessary for SEO, as search engines rank duplicate content low. Amazon DynamoDB serves as the primary database for 20 Minutes articles.

Advertising 136

Advertising APIs Engineering industry standards 136

AWS Machine Learning

MAY 15, 2024

This post demonstrates how to use advanced prompt engineering to control an LLM’s behavior and responses. The Amazon Bedrock API returns the output Q&A JSON file to the Lambda function. The container image sends the REST API request to Amazon API Gateway (using the GET method). The Docker engine.

Education 139

Education APIs Engineering Banking 139

AWS Machine Learning

JANUARY 4, 2024

Specifically, we discuss the following: Why do we need Text2SQL Key components for Text to SQL Prompt engineering considerations for natural language or Text to SQL Optimizations and best practices Architecture patterns Why do we need Text2SQL? Effective prompt engineering is key to developing natural language to SQL systems.

Best practices 141

Best practices Enterprise Engineering APIs 141

AWS Machine Learning

APRIL 24, 2024

Conversational artificial intelligence (AI) assistants are engineered to provide precise, real-time responses through intelligent routing of queries to the most suitable AI functions. The tasks are then run through a series of API calls. What is an AI assistant?

APIs 137

APIs Engineering Metrics Management 137

AWS Machine Learning

DECEMBER 22, 2023

In particular, we cover the SMP library’s new simplified user experience that builds on open source PyTorch Fully Sharded Data Parallel (FSDP) APIs, expanded tensor parallel functionality that enables training models with hundreds of billions of parameters, and performance optimizations that reduce model training time and cost by up to 20%.

Scripts 129

Scripts APIs Engineering Finance 129

AWS Machine Learning

NOVEMBER 7, 2024

Amazon Bedrock Prompt Management simplifies the creation, evaluation, versioning, and sharing of prompts to help developers and prompt engineers get better responses from foundation models (FMs) for their use cases. It also allows teams to reuse and share prompts and track different versions.

Management 142

Management APIs Engineering Enterprise 142

AWS Machine Learning

OCTOBER 2, 2024

It’s a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like Anthropic, Cohere, Meta, Mistral AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

Government 129

Government APIs Enterprise Best practices 129

AWS Machine Learning

OCTOBER 30, 2023

It allows developers to build and scale generative AI applications using FMs through an API, without managing infrastructure. Customers are building innovative generative AI applications using Amazon Bedrock APIs using their own proprietary data.

APIs 142

APIs Big data Accountability Enterprise 142

AWS Machine Learning

MAY 30, 2024

The frontend UI interacts with the extract microservice through a RESTful interface provided by Amazon API Gateway. Building a robust solution to extract information from videos poses challenges from both machine learning (ML) and engineering perspectives. Detect text using the Amazon Rekognition text detection API.

Advertising 135

Advertising APIs Education Analytics 135

AWS Machine Learning

JANUARY 5, 2024

Wipro further accelerated their ML model journey by implementing Wipro’s code accelerators and snippets to expedite feature engineering, model training, model deployment, and pipeline creation. Wipro has used the input filter and join functionality of SageMaker batch transformation API.

Management 137

Management APIs Engineering Government 137

AWS Machine Learning

DECEMBER 4, 2024

In a production environment, you continue to use the existing Amazon Bedrock Inference APIs, such as the InvokeModel or Converse API, and turn on invocation logs that store model input data (prompts) and model output data (responses). If you haven’t done this yet, see to the prerequisites section for instructions.

APIs 125

APIs Metrics Healthcare Chatbots 125

AWS Machine Learning

AUGUST 26, 2024

The GenASL web app invokes the backend services by sending the S3 object key in the payload to an API hosted on Amazon API Gateway. API Gateway instantiates an AWS Step Functions The state machine orchestrates the AI/ML services Amazon Transcribe and Amazon Bedrock and the NoSQL data store Amazon DynamoDB using AWS Lambda functions.

APIs 128

APIs Calibration Best practices Healthcare 128

AWS Machine Learning

MAY 13, 2024

This is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading artificial intelligence (AI) companies like AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon through a single API. There are many prompt engineering techniques. A prompt task is defined by prompt engineering.

Healthcare 136

Healthcare Engineering APIs Benchmark 136

AWS Machine Learning

AUGUST 20, 2024

Configuring IP-restricted presigned URLs for SageMaker Ground Truth The new IP restriction feature for presigned URLs in SageMaker Ground Truth can be enabled through the SageMaker API or the AWS Command Line Interface (AWS CLI). You can also perform these operations through the SageMaker API using the AWS SDK.

APIs 120

APIs Engineering Accountability Management 120

AWS Machine Learning

MAY 30, 2024

AWS Prototyping successfully delivered a scalable prototype, which solved CBRE’s business problem with a high accuracy rate (over 95%) and supported reuse of embeddings for similar NLQs, and an API gateway for integration into CBRE’s dashboards. The following diagram illustrates the web interface and API management layer.

Real estate 134

Real estate APIs Metrics Construction 134

AWS Machine Learning

SEPTEMBER 26, 2024

This domain knowledge is traditionally captured in reference manuals, service bulletins, quality ticketing systems, engineering drawings, and more, but the quantity and complexity of documents is growing and takes time to learn. We demonstrate how to do this using both APIs and the Amazon Bedrock console.

APIs 119

APIs Chatbots Engineering Accountability 119

AWS Machine Learning

MARCH 14, 2024

We provide an overview of key generative AI approaches, including prompt engineering, Retrieval Augmented Generation (RAG), and model customization. Building large language models (LLMs) from scratch or customizing pre-trained models requires substantial compute resources, expert data scientists, and months of engineering work.

Best practices 135

Best practices Engineering Chatbots Enterprise 135

AWS Machine Learning

NOVEMBER 15, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

APIs 119

APIs Government Best practices Metrics 119

AWS Machine Learning

SEPTEMBER 15, 2023

Large language model (LLM) agents are programs that extend the capabilities of standalone LLMs with 1) access to external tools (APIs, functions, webhooks, plugins, and so on), and 2) the ability to plan and execute tasks in a self-directed fashion. Note that the next action may or may not involve using a tool or API.

APIs 133

APIs Chatbots Engineering Management 133

AWS Machine Learning

AUGUST 13, 2024

Amazon Bedrock is a fully managed service that makes foundation models (FMs) from leading AI startups and Amazon available through an API, so you can choose from a wide range of FMs to find the model that is best suited for your use case. Lastly, the Lambda function stores the question list in Amazon S3.

Healthcare 134

Healthcare APIs Consulting Consulting 134

AWS Machine Learning

FEBRUARY 19, 2024

The integration of retrieval and generation also requires additional engineering effort and computational resources. For text generation, Amazon Bedrock provides the RetrieveAndGenerate API to create embeddings of user queries, and retrieves relevant chunks from the vector database to generate accurate responses.

Chatbots 125

Chatbots APIs Engineering Enterprise 125

AWS Machine Learning

NOVEMBER 2, 2023

Amazon Bedrock is a fully managed service that makes foundation models from leading AI startups and Amazon available via easy-to-use API interfaces. The solution also uses the grammatical error correction API and the paraphrase API from AI21 to recommend word and sentence corrections.

APIs 134

APIs Education Transportation Accountability 134