AWS Machine Learning

NOVEMBER 7, 2024

It also uses a number of other AWS services such as Amazon API Gateway , AWS Lambda , and Amazon SageMaker. API Gateway is serverless and hence automatically scales with traffic. API Gateway also provides a WebSocket API. Incoming requests to the gateway go through this point.

Enterprise 106

Enterprise APIs Government Accountability 106

AWS Machine Learning

MARCH 19, 2025

Note that these APIs use objects as namespaces, alleviating the need for explicit imports. API Gateway supports multiple mechanisms for controlling and managing access to an API. AWS Lambda handles the REST API integration, processing the requests and invoking the appropriate AWS services.

APIs 100

APIs Automotive Accountability Analytics 100

AWS Machine Learning

APRIL 3, 2025

Each drone follows predefined routes, with flight waypoints, altitude, and speed configured through an AWS API, using coordinates stored in Amazon DynamoDB. API Gateway plays a complementary role by acting as the main entry point for external applications, dashboards, and enterprise integrations.

APIs 97

APIs Telecommunications Enterprise Best practices 97

AWS Machine Learning

NOVEMBER 19, 2024

Clone the repo To get started, clone the repository by running the following command, and then switch to the working directory: git clone [link] Build your guardrail To build the guardrail, you can use the CreateGuardrail API. Based on the API response, you can determine the guardrail’s action.

APIs 107

APIs Government Banking Engineering 107

AWS Machine Learning

NOVEMBER 15, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

APIs 105

APIs Government Best practices Metrics 105

AWS Machine Learning

JANUARY 28, 2025

By documenting the specific model versions, fine-tuning parameters, and prompt engineering techniques employed, teams can better understand the factors contributing to their AI systems performance. It functions as a standalone HTTP server that provides various REST API endpoints for monitoring, recording, and visualizing experiment runs.

Management 95

Management APIs Engineering Metrics 95

AWS Machine Learning

JULY 31, 2024

The new ApplyGuardrail API enables you to assess any text using your preconfigured guardrails in Amazon Bedrock, without invoking the FMs. In this post, we demonstrate how to use the ApplyGuardrail API with long-context inputs and streaming outputs. For example, you can now use the API with models hosted on Amazon SageMaker.

APIs 119

APIs Banking Best practices Engineering 119

AWS Machine Learning

OCTOBER 31, 2024

This connector allows you to query your Gmail data using Amazon Q Business as your query engine. We provide the service account with authorization scopes to allow access to the required Gmail APIs. After you create the project, on the navigation menu, choose APIs and Services and Library to view the API Library.

APIs 111

APIs Accountability Enterprise Engineering 111

AWS Machine Learning

MARCH 19, 2025

They use a highly optimized inference stack built with NVIDIA TensorRT-LLM and NVIDIA Triton Inference Server to serve both their search application and pplx-api, their public API service that gives developers access to their proprietary models. The results speak for themselvestheir inference stack achieves up to 3.1

Healthcare 138

Healthcare Enterprise APIs Transportation 138

AWS Machine Learning

NOVEMBER 13, 2024

The solution also uses Amazon Cognito user pools and identity pools for managing authentication and authorization of users, Amazon API Gateway REST APIs, AWS Lambda functions, and an Amazon Simple Storage Service (Amazon S3) bucket. To launch the solution in a different Region, change the aws_region parameter accordingly.

APIs 123

APIs Scripts Accountability Entertainment 123

AWS Machine Learning

AUGUST 2, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing FMs from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API. 2) The fine-tuning process generally takes longer compared to few-shot prompt engineering based on the same documents. (3)

Engineering 124

Engineering Scripts Metrics APIs 124

AWS Machine Learning

NOVEMBER 14, 2024

Customers can use the SageMaker Studio UI or APIs to specify the SageMaker Model Registry model to be shared and grant access to specific AWS accounts or to everyone in the organization. We will start by using the SageMaker Studio UI and then by using APIs.

Government 89

Government Management APIs Accountability 89

AWS Machine Learning

MARCH 19, 2025

This could be APIs, code functions, or schemas and structures required by your end application. Instead of relying on prompt engineering, tool choice forces the model to adhere to the settings in place. Tool choice with Amazon Nova The toolChoice API parameter allows you to control when a tool is called.

APIs 83

APIs Engineering Chatbots Best practices 83

AWS Machine Learning

MAY 9, 2024

Verisk has embraced this technology and has developed their own Instant Insight Engine, or AI companion, that provides an enhanced self-service capability to their FAST platform. First, they used the Amazon Kendra Retrieve API to get multiple relevant passages and excerpts based on keyword search.

Engineering 129

Engineering Customer Support APIs Government 129

AWS Machine Learning

MARCH 11, 2025

Amazon Bedrock APIs make it straightforward to use Amazon Titan Text Embeddings V2 for embedding data. The implementation used the universal gateway provided by the FloTorch enterprise version to enable consistent API calls using the same function and to track token count and latency metrics uniformly. get("message", {}).get("content")

Benchmark 94

Benchmark APIs Enterprise Scripts 94

AWS Machine Learning

FEBRUARY 14, 2024

Amazon Bedrock offers a choice of high-performing foundation models from leading AI companies, including AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon, via a single API. Prompt engineering makes generative AI applications more efficient and effective.

Engineering 133

Engineering Chatbots Accountability Enterprise 133

AWS Machine Learning

FEBRUARY 21, 2025

Solution overview Our solution implements a verified semantic cache using the Amazon Bedrock Knowledge Bases Retrieve API to reduce hallucinations in LLM responses while simultaneously improving latency and reducing costs. The function checks the semantic cache (Amazon Bedrock Knowledge Bases) using the Retrieve API.

Engineering 111

Engineering APIs Analytics Enterprise 111

AWS Machine Learning

MARCH 27, 2025

This requirement translates into time and effort investment of trained personnel, who could be support engineers or other technical staff, to review tens of thousands of support cases to arrive at an even distribution of 3,000 per category. Sonnet prediction accuracy through prompt engineering. client = boto3.client("bedrock-runtime",

Education 88

Education Engineering APIs Enterprise 88

AWS Machine Learning

SEPTEMBER 20, 2024

Amazon Bedrock agents use LLMs to break down tasks, interact dynamically with users, run actions through API calls, and augment knowledge using Amazon Bedrock Knowledge Bases. In this post, we demonstrate how to use Amazon Bedrock Agents with a web search API to integrate dynamic web content in your generative AI application.

APIs 103

APIs Chatbots Construction Engineering 103

AWS Machine Learning

FEBRUARY 18, 2025

During these live events, F1 IT engineers must triage critical issues across its services, such as network degradation to one of its APIs. This impacts downstream services that consume data from the API, including products such as F1 TV, which offer live and on-demand coverage of every race as well as real-time telemetry.

APIs 70

APIs Engineering Metrics Big data 70

AWS Machine Learning

MARCH 25, 2025

For more information about the SageMaker AI API, refer to the SageMaker AI API Reference. 8B-Instruct to DeepSeek-R1-Distill-Llama-8B, but the new model version has different API expectations. In this use case, you have configured a CloudWatch alarm to monitor for 4xx errors, which would indicate API compatibility issues.

APIs 80

APIs Engineering Accountability Metrics 80

AWS Machine Learning

APRIL 9, 2024

In this post, we discuss two new features of Knowledge Bases for Amazon Bedrock specific to the RetrieveAndGenerate API: configuring the maximum number of results and creating custom prompts with a knowledge base prompt template. For best practices on prompt engineering, refer to Prompt engineering guidelines.

APIs 132

APIs Engineering Healthcare Education 132

AWS Machine Learning

JANUARY 24, 2025

These steps might involve both the use of an LLM and external data sources and APIs. Agent plugin controller This component is responsible for the API integration to external data sources and APIs. The LLM agent is an orchestrator of a set of steps that might be necessary to complete the desired request.

APIs 100

APIs Scripts Best practices Management 100

AWS Machine Learning

NOVEMBER 14, 2024

It enables you to privately customize the FM of your choice with your data using techniques such as fine-tuning, prompt engineering, and retrieval augmented generation (RAG) and build agents that run tasks using your enterprise systems and data sources while adhering to security and privacy requirements.

APIs 104

APIs Engineering Personalization Transportation 104

AWS Machine Learning

FEBRUARY 11, 2025

Enhancing AWS Support Engineering efficiency The AWS Support Engineering team faced the daunting task of manually sifting through numerous tools, internal sources, and AWS public documentation to find solutions for customer inquiries. For example, the Datastore API might require certain input like date periods to query data.

Enterprise 86

Enterprise Engineering APIs Best practices 86

AWS Machine Learning

NOVEMBER 21, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

APIs 106

APIs Call Center Engineering Personalization 106

AWS Machine Learning

FEBRUARY 12, 2025

Amazon Bedrock , a fully managed service offering high-performing foundation models from leading AI companies through a single API, has recently introduced two significant evaluation capabilities: LLM-as-a-judge under Amazon Bedrock Model Evaluation and RAG evaluation for Amazon Bedrock Knowledge Bases.

Metrics 88

Metrics Engineering APIs Benchmark 88

AWS Machine Learning

APRIL 3, 2025

When complete, a notification chain using Amazon Simple Queue Service (Amazon SQS) and our internal notifications service API gateway begins delivering updates using Slack direct messaging and storing searchable records in OpenSearch for future reference. Outside of work, he is an avid tennis player and amateur skier.

Accountability 75

Accountability Sales CRM APIs 75

AWS Machine Learning

OCTOBER 30, 2024

Enabling Global Resiliency for an Amazon Lex bot is straightforward using the AWS Management Console , AWS Command Line Interface (AWS CLI), or APIs. Global Resiliency APIs Global Resiliency provides API support to create and manage replicas. To better understand the solution, refer to the following architecture diagram.

Chatbots 98

Chatbots Interactive Voice Response APIs Telecommunications 98

AWS Machine Learning

NOVEMBER 15, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

Chatbots 114

Chatbots Engineering Enterprise Government 114

AWS Machine Learning

JANUARY 28, 2025

Prompt engineering for latency optimization When optimizing LLM applications for latency, the way you craft your prompts affects both input processing and output generation. Yanyan graduated from Texas A&M University with a PhD in Electrical Engineering. Monitor and optimize token usage to keep performance consistent.

Benchmark 70

Benchmark APIs Engineering Metrics 70

CSM Magazine

MARCH 10, 2025

Based in Galway, Ireland, Joe Joyce , Solutions Architect, earned a Gold Award for Sales Engineer of the Year. “We are incredibly proud to be recognized with two prestigious Stevie Awards,” said David Phillips , SVP, Customer Retention and Sales Engineering at SmartBear.

Sales 52

Sales Customer Service APIs Engineering 52

AWS Machine Learning

DECEMBER 9, 2024

SageMaker is a comprehensive, fully managed ML service designed to provide data scientists and ML engineers with the tools they need to handle the entire ML workflow. Note that MLflow tracking starts from the mlflow.start_run() API. The mlflow.autolog() API can automatically log information such as metrics, parameters, and artifacts.

Metrics 86

Metrics APIs Engineering Accountability 86

AWS Machine Learning

JULY 2, 2024

Amazon Bedrock is a fully managed service that makes a wide range of foundation models (FMs) available though an API without having to manage any infrastructure. An Amazon OpenSearch Serverless vector engine to store enterprise data as vectors to perform semantic search. The request is sent by the web application to the API.

APIs 127

APIs Scripts Enterprise Engineering 127

AWS Machine Learning

NOVEMBER 15, 2024

Use cases we have worked on include: Technical assistance for field engineers – We built a system that aggregates information about a company’s specific products and field expertise. A chatbot enables field engineers to quickly access relevant information, troubleshoot issues more effectively, and share knowledge across the organization.

APIs 113

APIs Engineering Chatbots Construction 113

AWS Machine Learning

FEBRUARY 25, 2025

With the connector ready, move over to the SageMaker Studio notebook and perform data synchronization operations by invoking Amazon Q Business APIs. Make sure that the Amazon Q Business user profile is updated to recognize the email ID using the update-user CLI command or the related API call. secrets_manager_client = boto3.client('secretsmanager')

Enterprise 85

Enterprise Engineering APIs Accountability 85

AWS Machine Learning

DECEMBER 11, 2024

This includes how we configured data sources that comprise our knowledge base, indexing documents and relevancy tuning , security (authentication, authorization, and guardrails ), and Amazon Qs APIs for conversation management and custom plugins. Outside of work, he enjoys golfing, biking, and exploring the outdoors.

Sales 92

Sales Accountability APIs CRM 92