AWS Machine Learning

OCTOBER 16, 2024

The goal was to refine customer service scripts, provide coaching opportunities for agents, and improve call handling processes. Frontend and API The CQ application offers a robust search interface specially crafted for call quality agents, equipping them with powerful auditing capabilities for call analysis.

Customer Service 86

Customer Service Scripts Coaching Finance 86

AWS Machine Learning

APRIL 18, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon with a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

Scripts 129

Scripts Best practices Engineering Accountability 129

AWS Machine Learning

SEPTEMBER 20, 2024

Amazon Bedrock agents use LLMs to break down tasks, interact dynamically with users, run actions through API calls, and augment knowledge using Amazon Bedrock Knowledge Bases. In this post, we demonstrate how to use Amazon Bedrock Agents with a web search API to integrate dynamic web content in your generative AI application.

APIs 105

APIs Chatbots Construction Engineering 105

AWS Machine Learning

JULY 2, 2024

Amazon Bedrock is a fully managed service that makes a wide range of foundation models (FMs) available though an API without having to manage any infrastructure. Amazon API Gateway and AWS Lambda to create an API with an authentication layer and integrate with Amazon Bedrock. An API created with Amazon API Gateway.

APIs 138

APIs Scripts Enterprise Engineering 138

AWS Machine Learning

MARCH 27, 2025

We also showcase a real-world example for predicting the root cause category for support cases. For the use case of labeling the support root cause categories, its often harder to source examples for categories such as Software Defect, Feature Request, and Documentation Improvement for labeling than it is for Customer Education.

Education 109

Education Engineering APIs Enterprise 109

AWS Machine Learning

FEBRUARY 1, 2023

Amazon Rekognition has two sets of APIs that help you moderate images or videos to keep digital communities safe and engaged. Some customers have asked if they could use this approach to moderate videos by sampling image frames and sending them to the Amazon Rekognition image moderation API.

APIs 89

APIs Scripts Metrics Surveys 89

AWS Machine Learning

MARCH 15, 2023

The best practice for migration is to refactor these legacy codes using the Amazon SageMaker API or the SageMaker Python SDK. SageMaker runs the legacy script inside a processing container. Step Functions is a serverless workflow service that can control SageMaker APIs directly through the use of the Amazon States Language.

Scripts 143

Scripts APIs Engineering Construction 143

AWS Machine Learning

JULY 29, 2022

The SageMaker Python SDK provides open-source APIs and containers to train and deploy models on SageMaker, using several different ML and deep learning frameworks. In this post, we walk you through an example of how to build and deploy a custom Hugging Face text summarizer on SageMaker. return tokenized_dataset. If we use an ml.g4dn.16xlarge

Scripts 100

Scripts APIs Big data Engineering 100

AWS Machine Learning

APRIL 11, 2023

In the post Secure Amazon SageMaker Studio presigned URLs Part 2: Private API with JWT authentication , we demonstrated how to build a private API to generate Amazon SageMaker Studio presigned URLs that are only accessible by an authenticated end-user within the corporate network from a single account.

APIs 93

APIs Accountability Scripts Enterprise 93

AWS Machine Learning

FEBRUARY 8, 2024

At the forefront of this evolution sits Amazon Bedrock , a fully managed service that makes high-performing foundation models (FMs) from Amazon and other leading AI companies available through an API. The code and resources required for deployment are available in the amazon-bedrock-examples repository.

APIs 140

APIs Scripts Enterprise Management 140

AWS Machine Learning

FEBRUARY 12, 2025

Amazon Bedrock is a fully managed service that makes FMs from leading AI startups and Amazon available through an API, so you can choose from a wide range of FMs to find the model that is best suited for your use case. Solution overview The solution comprises two main steps: Generate synthetic data using the Amazon Bedrock InvokeModel API.

APIs 75

APIs Management Benchmark Scripts 75

AWS Machine Learning

AUGUST 2, 2024

Traditionally, earnings call scripts have followed similar templates, making it a repeatable task to generate them from scratch each time. On the other hand, generative artificial intelligence (AI) models can learn these templates and produce coherent scripts when fed with quarterly financial data.

Engineering 131

Engineering Scripts Metrics APIs 131

AWS Machine Learning

FEBRUARY 5, 2025

Through this practical example, well illustrate how startups can harness the power of LLMs to enhance customer experiences and the simplicity of Nemo Guardrails to guide the LLMs driven conversation toward the desired outcomes. Lets delve into a basic Colang script to see how it works: define user express greeting "hello" "hi" "what's up?"

Chatbots 103

Chatbots Construction Best practices APIs 103

AWS Machine Learning

JULY 11, 2024

This solution uses Retrieval Augmented Generation (RAG) to ensure the generated scripts adhere to organizational needs and industry standards. In this blog post, we explore how Agents for Amazon Bedrock can be used to generate customized, organization standards-compliant IaC scripts directly from uploaded architecture diagrams.

Scripts 137

Scripts APIs Engineering industry standards 137

AWS Machine Learning

OCTOBER 24, 2024

Anatomy of RAG RAG is an efficient way to provide an FM with additional knowledge by using external data sources and is depicted in the following diagram: Retrieval : Based on a user’s question (1), relevant information is retrieved from a knowledge base (2) (for example, an OpenSearch index). Try metadata filtering in your OpenSearch index.

Chatbots 90

Chatbots Metrics Scripts APIs 90

AWS Machine Learning

DECEMBER 22, 2023

In particular, we cover the SMP library’s new simplified user experience that builds on open source PyTorch Fully Sharded Data Parallel (FSDP) APIs, expanded tensor parallel functionality that enables training models with hundreds of billions of parameters, and performance optimizations that reduce model training time and cost by up to 20%.

Scripts 121

Scripts APIs Engineering Finance 121

AWS Machine Learning

SEPTEMBER 8, 2023

Amazon Rekognition makes it easy to add image analysis capability to your applications without any machine learning (ML) expertise and comes with various APIs to fulfil use cases such as object detection, content moderation, face detection and analysis, and text and celebrity recognition, which we use in this example.

APIs 123

APIs Scripts Entertainment Personalization 123

AWS Machine Learning

MAY 16, 2024

The main AWS services used are SageMaker, Amazon EMR , AWS CodeBuild , Amazon Simple Storage Service (Amazon S3), Amazon EventBridge , AWS Lambda , and Amazon API Gateway. Real-time recommendation inference The inference phase consists of the following steps: The client application makes an inference request to the API gateway.

Personalization 123

Personalization APIs Scripts Technical Support 123

AWS Machine Learning

MARCH 19, 2024

However, complex NLQs, such as time series data processing, multi-level aggregation, and pivot or joint table operations, may yield inconsistent Python script accuracy with a zero-shot prompt. After the similarity search, the top similar examples, including NLQ questions, data schema, and Python codes, are inserted in a custom prompt.

Construction 136

Construction Scripts APIs Enterprise 136

AWS Machine Learning

FEBRUARY 25, 2025

For example, What are the top sections of the HR benefits policies? We recommend running similar scripts only on your own data sources after consulting with the team who manages them, or be sure to follow the terms of service for the sources that youre trying to fetch data from. Leave the defaults and choose Next.

Enterprise 96

Enterprise Engineering APIs Accountability 96

AWS Machine Learning

AUGUST 1, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading artificial intelligence (AI) companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API. The scripts for fine-tuning and evaluation are available on the GitHub repository.

APIs 125

APIs Scripts Real estate Accountability 125

AWS Machine Learning

JANUARY 8, 2024

The first allows you to run a Python script from any server or instance including a Jupyter notebook; this is the quickest way to get started. In the following sections, we first describe the script solution, followed by the AWS CDK construct solution. The following diagram illustrates the sequence of events within the script.

Scripts 115

Scripts Construction APIs Healthcare 115

Nexmo

OCTOBER 7, 2020

Vonage API Account. To complete this tutorial, you will need a Vonage API account. Once you have an account, you can find your API Key and API Secret at the top of the Vonage API Dashboard. Web Component polyfill --> <script src="[link]. <!-- This tutorial also uses a virtual phone number.

APIs 118

APIs Scripts Accountability 118

AWS Machine Learning

JANUARY 9, 2023

In this post, we show you how to get started with Amazon Kendra Intelligent Ranking for self-managed OpenSearch, and we provide a few examples that demonstrate the power and value of this feature. Create and start OpenSearch using the Quickstart script. script: wget [link] chmod +x search_processing_kendra_quickstart.sh.

Scripts 104

Scripts APIs Engineering Transportation 104

AWS Machine Learning

JULY 29, 2024

You can also either use the SageMaker Canvas UI, which provides a visual interface for building and deploying models without needing to write any code or have any ML expertise, or use its automated machine learning (AutoML) APIs for programmatic interactions. Python script – Use a Python script to merge the datasets.

APIs 113

APIs Scripts Benchmark Metrics 113

AWS Machine Learning

NOVEMBER 30, 2023

In this example, you take a sentence that describes Werner Vogels wearing white scarfs while travelling around India. The function then searches the OpenSearch Service image index for images matching the celebrity name and the k-nearest neighbors for the vector using cosine similarity using Exact k-NN with scoring script.

Scripts 122

Scripts APIs Entertainment Accountability 122

AWS Machine Learning

FEBRUARY 19, 2024

An asynchronous API and Amazon OpenSearch Service connector make it easy to integrate the model into your neural search applications. Code examples are provided in Python, and JavaScript (Node.js) is also available in this GitHub repository. For Python scripts, you can use the AWS SDK for Python (Boto3). exclusive) to 10.0

Scripts 129

Scripts APIs Entertainment Engineering 129

AWS Machine Learning

JULY 17, 2024

In this post, we’re using the APIs for AWS Support , AWS Trusted Advisor , and AWS Health to programmatically access the support datasets and use the Amazon Q Business native Amazon Simple Storage Service (Amazon S3) connector to index support data and provide a prebuilt chatbot web experience. Synchronize the data source to index the data.

Scripts 123

Scripts APIs Enterprise Accountability 123

AWS Machine Learning

MAY 31, 2024

This genomic data could be either public (for example, GenBank) or could be your own proprietary data. Lastly the model is tested against a set of known genome sequences using some inference API calls. Training on SageMaker We use PyTorch and Amazon SageMaker script mode to train this model.

Biotechnology 112

Biotechnology Scripts Healthcare APIs 112

AWS Machine Learning

MAY 23, 2024

The SMP library uses NVIDIA Megatron to implement expert parallelism and support training MoE models, and runs on top of PyTorch Fully Sharded Data Parallel (FSDP) APIs. For example, to shard your model while using an instance with 8 GPUs, you can set the expert_parallel_degree to 2, 4, or 8.

APIs 130

APIs Engineering Scripts Construction 130

AWS Machine Learning

FEBRUARY 15, 2023

You can fine-tune and deploy JumpStart models using the UI in Amazon SageMaker Studio or using the SageMaker Python SDK extension for JumpStart APIs. This post focuses on how we can implement MLOps with JumpStart models using JumpStart APIs, Amazon SageMaker Pipelines , and Amazon SageMaker Projects. sm_client = boto3.client("sagemaker")

Scripts 114

Scripts APIs Engineering Enterprise 114

AWS Machine Learning

MARCH 23, 2023

To demonstrate this, we show an example of customizing an Amazon SageMaker Scikit-learn, open sourced, deep learning container to enable a deployed endpoint to accept client-side encrypted inference requests. Although this example shows how to perform this for inference operations, you can extend the solution to training and other ML steps.

Scripts 117

Scripts APIs Government Analytics 117

AWS Machine Learning

JULY 24, 2023

If the model changes on the server side, the client has to know and change its API call to the new endpoint accordingly. For example, NEURON_RT_NUM_CORES=2 myapp.py For this example, we’re going with us-east-2 as the region and json as the default output. As an example, we will choose Inf2 as the guide.

Scripts 95

Scripts APIs Best practices Engineering 95

AWS Machine Learning

FEBRUARY 19, 2024

For example, assume you have a model that is only used a few times a day. Inference API – The server exposes an API that allows client applications to send input data and receive predictions from the deployed models. For this example, we showcase the power of DJL with an MME by taking a sample SKLearn model.

APIs 124

APIs Engineering Scripts Metrics 124

AWS Machine Learning

APRIL 12, 2023

The code to invoke the pipeline script is available in the Studio notebooks, and we can change the hyperparameters and input/output when invoking the pipeline. This is quite different from our earlier method where we had all the parameters hard coded within the scripts and all the processes were inextricably linked. cpu-py39-ubuntu20.04-sagemaker",

Scripts 106

Scripts APIs Metrics Best practices 106

AWS Machine Learning

JULY 2, 2024

Image 2: Hugging Face NLP model inference performance improvement with torch.compile on AWS Graviton3-based c7g instance using Hugging Face example scripts. This section shows how to run inference in eager and torch.compile modes using torch Python wheels and benchmarking scripts from Hugging Face and TorchBench repos.

Benchmark 119

Benchmark Scripts Metrics APIs 119

AWS Machine Learning

MAY 31, 2023

Once configured, the Python SDK automatically inherits these values and propagates them to the underlying SageMaker API calls such as CreateProcessingJob() , CreateTrainingJob() , and CreateEndpointConfig() , with no additional actions needed. Additionally, each API call can have its own configurations.

APIs 105

APIs Scripts Accountability Enterprise 105