AWS Machine Learning

NOVEMBER 7, 2024

It also uses a number of other AWS services such as Amazon API Gateway , AWS Lambda , and Amazon SageMaker. API Gateway is serverless and hence automatically scales with traffic. API Gateway also provides a WebSocket API. Incoming requests to the gateway go through this point.

Enterprise 114

Enterprise APIs Government Accountability 114

AWS Machine Learning

MARCH 14, 2025

Traditional automation approaches require custom API integrations for each application, creating significant development overhead. Add the Amazon Bedrock Agents supported computer use action groups to your agent using CreateAgentActionGroup API. Prerequisites AWS Command Line Interface (CLI), follow instructions here.

APIs 135

APIs Engineering CRM Enterprise 135

AWS Machine Learning

JANUARY 28, 2025

By documenting the specific model versions, fine-tuning parameters, and prompt engineering techniques employed, teams can better understand the factors contributing to their AI systems performance. It functions as a standalone HTTP server that provides various REST API endpoints for monitoring, recording, and visualizing experiment runs.

Management 117

Management APIs Engineering Metrics 117

AWS Machine Learning

NOVEMBER 19, 2024

Clone the repo To get started, clone the repository by running the following command, and then switch to the working directory: git clone [link] Build your guardrail To build the guardrail, you can use the CreateGuardrail API. Based on the API response, you can determine the guardrail’s action.

APIs 118

APIs Government Banking Engineering 118

AWS Machine Learning

MARCH 19, 2025

Note that these APIs use objects as namespaces, alleviating the need for explicit imports. API Gateway supports multiple mechanisms for controlling and managing access to an API. AWS Lambda handles the REST API integration, processing the requests and invoking the appropriate AWS services.

APIs 114

APIs Automotive Accountability Analytics 114

AWS Machine Learning

NOVEMBER 14, 2024

Customers can use the SageMaker Studio UI or APIs to specify the SageMaker Model Registry model to be shared and grant access to specific AWS accounts or to everyone in the organization. We will start by using the SageMaker Studio UI and then by using APIs.

Government 106

Government Management APIs Accountability 106

AWS Machine Learning

JULY 31, 2024

The new ApplyGuardrail API enables you to assess any text using your preconfigured guardrails in Amazon Bedrock, without invoking the FMs. In this post, we demonstrate how to use the ApplyGuardrail API with long-context inputs and streaming outputs. For example, you can now use the API with models hosted on Amazon SageMaker.

APIs 131

APIs Banking Best practices Engineering 131

AWS Machine Learning

APRIL 3, 2025

When complete, a notification chain using Amazon Simple Queue Service (Amazon SQS) and our internal notifications service API gateway begins delivering updates using Slack direct messaging and storing searchable records in OpenSearch for future reference. Outside of work, he is an avid tennis player and amateur skier.

Accountability 112

Accountability Sales CRM APIs 112

AWS Machine Learning

NOVEMBER 15, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

APIs 112

APIs Government Best practices Metrics 112

AWS Machine Learning

MARCH 27, 2025

This requirement translates into time and effort investment of trained personnel, who could be support engineers or other technical staff, to review tens of thousands of support cases to arrive at an even distribution of 3,000 per category. Sonnet prediction accuracy through prompt engineering. client = boto3.client("bedrock-runtime",

Education 112

Education Engineering APIs Enterprise 112

AWS Machine Learning

OCTOBER 31, 2024

This connector allows you to query your Gmail data using Amazon Q Business as your query engine. We provide the service account with authorization scopes to allow access to the required Gmail APIs. After you create the project, on the navigation menu, choose APIs and Services and Library to view the API Library.

APIs 120

APIs Accountability Enterprise Engineering 120

AWS Machine Learning

NOVEMBER 13, 2024

The solution also uses Amazon Cognito user pools and identity pools for managing authentication and authorization of users, Amazon API Gateway REST APIs, AWS Lambda functions, and an Amazon Simple Storage Service (Amazon S3) bucket. To launch the solution in a different Region, change the aws_region parameter accordingly.

APIs 133

APIs Scripts Accountability Entertainment 133

AWS Machine Learning

MARCH 19, 2025

This could be APIs, code functions, or schemas and structures required by your end application. Instead of relying on prompt engineering, tool choice forces the model to adhere to the settings in place. Tool choice with Amazon Nova The toolChoice API parameter allows you to control when a tool is called.

APIs 105

APIs Engineering Chatbots Best practices 105

AWS Machine Learning

AUGUST 2, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing FMs from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API. 2) The fine-tuning process generally takes longer compared to few-shot prompt engineering based on the same documents. (3)

Engineering 133

Engineering Scripts Metrics Advertising 133

AWS Machine Learning

FEBRUARY 21, 2025

Solution overview Our solution implements a verified semantic cache using the Amazon Bedrock Knowledge Bases Retrieve API to reduce hallucinations in LLM responses while simultaneously improving latency and reducing costs. The function checks the semantic cache (Amazon Bedrock Knowledge Bases) using the Retrieve API.

Engineering 126

Engineering APIs Analytics Enterprise 126

AWS Machine Learning

MARCH 25, 2025

For more information about the SageMaker AI API, refer to the SageMaker AI API Reference. 8B-Instruct to DeepSeek-R1-Distill-Llama-8B, but the new model version has different API expectations. In this use case, you have configured a CloudWatch alarm to monitor for 4xx errors, which would indicate API compatibility issues.

APIs 111

APIs Engineering Accountability Metrics 111

AWS Machine Learning

FEBRUARY 11, 2025

Enhancing AWS Support Engineering efficiency The AWS Support Engineering team faced the daunting task of manually sifting through numerous tools, internal sources, and AWS public documentation to find solutions for customer inquiries. For example, the Datastore API might require certain input like date periods to query data.

Enterprise 106

Enterprise Engineering APIs Best practices 106

AWS Machine Learning

FEBRUARY 14, 2024

Amazon Bedrock offers a choice of high-performing foundation models from leading AI companies, including AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon, via a single API. Prompt engineering makes generative AI applications more efficient and effective.

Engineering 141

Engineering Chatbots Accountability Enterprise 141

AWS Machine Learning

MARCH 11, 2025

Amazon Bedrock APIs make it straightforward to use Amazon Titan Text Embeddings V2 for embedding data. The implementation used the universal gateway provided by the FloTorch enterprise version to enable consistent API calls using the same function and to track token count and latency metrics uniformly. get("message", {}).get("content")

Benchmark 113

Benchmark APIs Enterprise Scripts 113

AWS Machine Learning

MARCH 26, 2025

Update models in the private hub Modify your existing private HubContent by calling the new sagemaker:UpdateHubContent API. Refer to the public API documentation for more details. Refer to the public API documentation for more details. Refer to the public API documentation for more usage details.

APIs 109

APIs Enterprise Government Accountability 109

AWS Machine Learning

JANUARY 24, 2025

These steps might involve both the use of an LLM and external data sources and APIs. Agent plugin controller This component is responsible for the API integration to external data sources and APIs. The LLM agent is an orchestrator of a set of steps that might be necessary to complete the desired request.

APIs 118

APIs Scripts Best practices Management 118

AWS Machine Learning

MAY 9, 2024

Verisk has embraced this technology and has developed their own Instant Insight Engine, or AI companion, that provides an enhanced self-service capability to their FAST platform. First, they used the Amazon Kendra Retrieve API to get multiple relevant passages and excerpts based on keyword search.

Engineering 130

Engineering Customer Support APIs Government 130

AWS Machine Learning

APRIL 8, 2025

Solution overview The following diagram illustrates iFoods legacy architecture, which had separate workflows for data science and engineering teams, creating challenges in efficiently deploying accurate, real-time machine learning models into production systems. The ML platform empowers the building and evolution of ML systems.

Engineering 108

Engineering Virtual Agent Management Technology 108

AWS Machine Learning

DECEMBER 2, 2024

You can retrieve the number of copies of an inference component at any time by making the DescribeInferenceComponent API call and checking the CurrentCopyCount. ApplicationAutoScaling may be in-progress (if configured) or try to increase the capacity by invoking UpdateInferenceComponentRuntimeConfig API. import json scheduler = boto3.client('scheduler')

APIs 109

APIs Best practices Metrics Engineering 109

AWS Machine Learning

FEBRUARY 12, 2025

Amazon Bedrock , a fully managed service offering high-performing foundation models from leading AI companies through a single API, has recently introduced two significant evaluation capabilities: LLM-as-a-judge under Amazon Bedrock Model Evaluation and RAG evaluation for Amazon Bedrock Knowledge Bases.

Metrics 106

Metrics Engineering Benchmark APIs 106

AWS Machine Learning

APRIL 24, 2025

The top-level definitions of these abstractions are included as part of the prompt context for query generation, and the full definitions are provided to the SQL execution engine, along with the generated query. The end-user sends their natural language queries to the NL2SQL solution using a REST API.

Enterprise 88

Enterprise Construction Scripts APIs 88

AWS Machine Learning

MARCH 19, 2025

They use a highly optimized inference stack built with NVIDIA TensorRT-LLM and NVIDIA Triton Inference Server to serve both their search application and pplx-api, their public API service that gives developers access to their proprietary models. The results speak for themselvestheir inference stack achieves up to 3.1

Healthcare 144

Healthcare Enterprise APIs Transportation 144

AWS Machine Learning

SEPTEMBER 20, 2024

Amazon Bedrock agents use LLMs to break down tasks, interact dynamically with users, run actions through API calls, and augment knowledge using Amazon Bedrock Knowledge Bases. In this post, we demonstrate how to use Amazon Bedrock Agents with a web search API to integrate dynamic web content in your generative AI application.

APIs 106

APIs Chatbots Construction Engineering 106

AWS Machine Learning

OCTOBER 23, 2024

Agent Creator is a versatile extension to the SnapLogic platform that is compatible with modern databases, APIs, and even legacy mainframe systems, fostering seamless integration across various data environments. Pre-built templates tailored to various use cases are included, significantly enhancing both employee and customer experiences.

Enterprise 91

Enterprise APIs Engineering Government 91

AWS Machine Learning

OCTOBER 30, 2024

Enabling Global Resiliency for an Amazon Lex bot is straightforward using the AWS Management Console , AWS Command Line Interface (AWS CLI), or APIs. Global Resiliency APIs Global Resiliency provides API support to create and manage replicas. To better understand the solution, refer to the following architecture diagram.

Chatbots 114

Chatbots Interactive Voice Response APIs Telecommunications 114

AWS Machine Learning

FEBRUARY 18, 2025

During these live events, F1 IT engineers must triage critical issues across its services, such as network degradation to one of its APIs. This impacts downstream services that consume data from the API, including products such as F1 TV, which offer live and on-demand coverage of every race as well as real-time telemetry.

APIs 71

APIs Engineering Metrics Big data 71

AWS Machine Learning

NOVEMBER 14, 2024

It enables you to privately customize the FM of your choice with your data using techniques such as fine-tuning, prompt engineering, and retrieval augmented generation (RAG) and build agents that run tasks using your enterprise systems and data sources while adhering to security and privacy requirements.

APIs 112

APIs Engineering Personalization Transportation 112

AWS Machine Learning

NOVEMBER 22, 2024

Reduced time and effort in testing and deploying AI workflows with SDK APIs and serverless infrastructure. We can also quickly integrate flows with our applications using the SDK APIs for serverless flow execution — without wasting time in deployment and infrastructure management.

APIs 124

APIs Chatbots Enterprise Customer centricity 124

AWS Machine Learning

DECEMBER 3, 2024

Agent architecture The following diagram illustrates the serverless agent architecture with standard authorization and real-time interaction, and an LLM agent layer using Amazon Bedrock Agents for multi-knowledge base and backend orchestration using API or Python executors. Domain-scoped agents enable code reuse across multiple agents.

Sales 109

Sales APIs Engineering Analytics 109

AWS Machine Learning

DECEMBER 9, 2024

SageMaker is a comprehensive, fully managed ML service designed to provide data scientists and ML engineers with the tools they need to handle the entire ML workflow. Note that MLflow tracking starts from the mlflow.start_run() API. The mlflow.autolog() API can automatically log information such as metrics, parameters, and artifacts.

Metrics 105

Metrics APIs Engineering Accountability 105

AWS Machine Learning

NOVEMBER 21, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

APIs 112

APIs Call Center Engineering Personalization 112

AWS Machine Learning

JANUARY 28, 2025

Prompt engineering for latency optimization When optimizing LLM applications for latency, the way you craft your prompts affects both input processing and output generation. Yanyan graduated from Texas A&M University with a PhD in Electrical Engineering. Monitor and optimize token usage to keep performance consistent.

Benchmark 78

Benchmark APIs Engineering Metrics 78