AWS Machine Learning

NOVEMBER 13, 2024

This innovative feature empowers viewers to catch up with what is being presented, making it simpler to grasp key points and highlights, even if they have missed portions of the live stream or find it challenging to follow complex discussions. To launch the solution in a different Region, change the aws_region parameter accordingly.

APIs 122

APIs Scripts Accountability Entertainment 122

AWS Machine Learning

NOVEMBER 30, 2023

You then perform a search against OpenSearch Service with the names and the embedding from the article to retrieve images that are semantically similar with the presence of the given celebrity, if present. The result from the multimodal model scores the images with a scarf present higher.

Scripts 120

Scripts APIs Entertainment Accountability 120

AWS Machine Learning

AUGUST 1, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading artificial intelligence (AI) companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API. The scripts for fine-tuning and evaluation are available on the GitHub repository.

APIs 124

APIs Scripts Real estate Accountability 124

AWS Machine Learning

JULY 17, 2024

In this post, we’re using the APIs for AWS Support , AWS Trusted Advisor , and AWS Health to programmatically access the support datasets and use the Amazon Q Business native Amazon Simple Storage Service (Amazon S3) connector to index support data and provide a prebuilt chatbot web experience. Synchronize the data source to index the data.

Scripts 119

Scripts APIs Enterprise Accountability 119

AWS Machine Learning

SEPTEMBER 8, 2023

Amazon Rekognition makes it easy to add image analysis capability to your applications without any machine learning (ML) expertise and comes with various APIs to fulfil use cases such as object detection, content moderation, face detection and analysis, and text and celebrity recognition, which we use in this example.

APIs 122

APIs Scripts Entertainment Personalization 122

AWS Machine Learning

OCTOBER 18, 2024

Call the SageMaker control plane API using the SageMaker Python SDK for model training. Create an AWS Identity and Access Management (IAM) user with the AmazonSageMakerFullAccess policy to enable you to run SageMaker APIs. We’ve prepared a script called train_yolov8.py environment. An AWS account.

Scripts 100

Scripts APIs Engineering Marketing 100

AWS Machine Learning

MAY 16, 2024

The main AWS services used are SageMaker, Amazon EMR , AWS CodeBuild , Amazon Simple Storage Service (Amazon S3), Amazon EventBridge , AWS Lambda , and Amazon API Gateway. Real-time recommendation inference The inference phase consists of the following steps: The client application makes an inference request to the API gateway.

Personalization 120

Personalization APIs Scripts Technical Support 120

AWS Machine Learning

JULY 25, 2024

Streamline content creation – Amazon Q can assist in generating drafts, outlines, and even complete content pieces (such as reports, articles, or presentations) by drawing on the knowledge and data stored in SharePoint. Any additional mappings need to be set in the user store using the user store APIs.

Scripts 106

Scripts APIs Engineering Enterprise 106

AWS Machine Learning

JULY 24, 2023

If the model changes on the server side, the client has to know and change its API call to the new endpoint accordingly. Clone the Github repository The GitHub repo provides all the scripts necessary to deploy models using FastAPI on NeuronCores on AWS Inferentia instances. code as the entry point. compiled-model-bs-{batch_size}.pt')

Scripts 85

Scripts APIs Engineering Best practices 85

AWS Machine Learning

NOVEMBER 14, 2024

Customers can use the SageMaker Studio UI or APIs to specify the SageMaker Model Registry model to be shared and grant access to specific AWS accounts or to everyone in the organization. We will start by using the SageMaker Studio UI and then by using APIs.

Government 91

Government Management APIs Accountability 91

AWS Machine Learning

APRIL 10, 2023

In this post, we present a comprehensive guide on deploying and running inference using the Stable Diffusion inpainting model in two methods: through JumpStart’s user interface (UI) in Amazon SageMaker Studio , and programmatically through JumpStart APIs available in the SageMaker Python SDK.

Scripts 91

Scripts APIs Construction Finance 91

AWS Machine Learning

FEBRUARY 19, 2024

Chatbots also offer valuable data-driven insights into customer behavior while scaling effortlessly as the user base grows; therefore, they present a cost-effective solution for engaging customers. Clone the GitHub repo The solution presented in this post is available in the following GitHub repo. model in Amazon Bedrock.

Chatbots 117

Chatbots APIs Engineering Enterprise 117

AWS Machine Learning

NOVEMBER 15, 2024

The rapid advancement of generative AI promises transformative innovation, yet it also presents significant challenges. For early detection, implement custom testing scripts that run toxicity evaluations on new data and model outputs continuously. Amazon Bedrock Knowledge Bases manages the end-to-end RAG workflow for you.

APIs 101

APIs Government Best practices Metrics 101

AWS Machine Learning

JANUARY 5, 2024

Continuous integration and continuous delivery (CI/CD) pipeline – Using the customer’s GitHub repository enabled code versioning and automated scripts to launch pipeline deployment whenever new versions of the code are committed. Wipro has used the input filter and join functionality of SageMaker batch transformation API.

Management 133

Management APIs Engineering Government 133

AWS Machine Learning

NOVEMBER 17, 2022

JumpStart APIs allow you to programmatically deploy and fine-tune a vast selection of JumpStart-supported pre-trained models on your own datasets. In this post, we present a methodology to easily run multiple models and compare their outputs on three dimensions of interest: model accuracy, training time, and inference time.

APIs 92

APIs Scripts Metrics 92

AWS Machine Learning

JULY 11, 2024

Retrieval Augmented Generation (RAG) is a popular paradigm that provides additional knowledge to large language models (LLMs) from an external source of data that wasn’t present in their training corpus. Python script that serves as the entry point. expand(token_embeddings.size()).float() tolist()} After creating the inference.py

Scripts 125

Scripts Accountability APIs Engineering 125

AWS Machine Learning

OCTOBER 22, 2024

Because user-level custom EFS instances are only configurable through programmatic API calls, creating users on the AWS Management Console is not considered in our context. At the last step, a lifecycle config script is run to restore the Amazon EBS snapshots before the SageMaker space launched. Stop and restart the application.

Engineering 111

Engineering Scripts Accountability Consulting 111

AWS Machine Learning

JUNE 23, 2023

For data scientists, moving machine learning (ML) models from proof of concept to production often presents a significant challenge. FastAPI is a modern, high-performance web framework for building APIs with Python. It can be cumbersome to manage the process, but with the right tool, you can significantly reduce the required effort.

APIs 100

APIs Scripts Engineering Accountability 100

AWS Machine Learning

AUGUST 29, 2023

The presented MLOps workflow provides a reusable template for managing the ML lifecycle through automation, monitoring, auditability, and scalability, thereby reducing the complexities and costs of maintaining batch inference workloads in production.

Scripts 85

Scripts APIs Enterprise Accountability 85

AWS Machine Learning

JANUARY 25, 2023

In this post, we provide an overview of how to deploy and run inference with the Stable Diffusion upscaler model in two ways: via JumpStart’s user interface (UI) in Amazon SageMaker Studio , and programmatically through JumpStart APIs available in the SageMaker Python SDK.

APIs 85

APIs Scripts Real estate Entertainment 85

AWS Machine Learning

NOVEMBER 7, 2022

We explore two ways of obtaining the same result: via JumpStart’s graphical interface on Amazon SageMaker Studio , and programmatically through JumpStart APIs. If you want to jump straight into the JumpStart API code we go through in this post, you can refer to the following sample Jupyter notebook: Introduction to JumpStart – Text to Image.

APIs 104

APIs Scripts Enterprise Big data 104

AWS Machine Learning

FEBRUARY 15, 2023

You can fine-tune and deploy JumpStart models using the UI in Amazon SageMaker Studio or using the SageMaker Python SDK extension for JumpStart APIs. This post focuses on how we can implement MLOps with JumpStart models using JumpStart APIs, Amazon SageMaker Pipelines , and Amazon SageMaker Projects. sm_client = boto3.client("sagemaker")

Scripts 110

Scripts APIs Engineering Enterprise 110

AWS Machine Learning

OCTOBER 1, 2024

You only consume the services through their API. To understand better how Amazon Cognito allows external applications to invoke AWS services, refer to refer to Secure API Access with Amazon Cognito Federated Identities, Amazon Cognito User Pools, and Amazon API Gateway. We discuss this later in the post.

Chatbots 86

Chatbots APIs Scripts Management 86

AWS Machine Learning

AUGUST 26, 2022

We explore two ways of obtaining the same result: via JumpStart’s graphical interface on Amazon SageMaker Studio , and programmatically through JumpStart APIs. The following sections provide a step-by-step demo to perform semantic segmentation with JumpStart, both via the Studio UI and via JumpStart APIs. Solution overview.

APIs 90

APIs Scripts Enterprise Big data 90

AWS Machine Learning

JULY 26, 2023

This notebook presents an end-to-end example of how to compile a Stable Diffusion model, save the compiled Neuron models, and load it into the runtime for inference. We compile the UNet for one batch (by using input tensors with one batch), then use the torch_neuronx.DataParallel API to load this single batch model onto each core.

Scripts 92

Scripts APIs Benchmark Engineering 92

AWS Machine Learning

JUNE 15, 2022

Instead of presenting each facet individually as a list, hierarchical facets enable defining a parent-child relationship between facets to shape the scope of the search results. If you just want to read about this feature without running it yourself, you can refer to the Python script facet-search-query.py Solution overview.

APIs 83

APIs Scripts Technology Engineering 83

AWS Machine Learning

MAY 23, 2024

Despite their computational benefits, training and fine-tuning large MoE models efficiently presents some challenges. The SMP library uses NVIDIA Megatron to implement expert parallelism and support training MoE models, and runs on top of PyTorch Fully Sharded Data Parallel (FSDP) APIs. In this example, we use SageMaker training jobs.

APIs 131

APIs Engineering Scripts Construction 131

AWS Machine Learning

SEPTEMBER 28, 2022

The SageMakerMigration class consists of high-level abstractions over SageMaker APIs that significantly reduce the steps needed to deploy your model to SageMaker, as illustrated in the following figure. Prepare your trained model and inference script. pth,pkl, and so on) and an inference script.

Scripts 87

Scripts APIs Engineering Consulting 87

AWS Machine Learning

FEBRUARY 20, 2023

In this post, we provide an overview of how to fine-tune the Stable Diffusion model in two ways: programmatically through JumpStart APIs available in the SageMaker Python SDK , and JumpStart’s user interface (UI) in Amazon SageMaker Studio. Fine-tuning large models like Stable Diffusion usually requires you to provide training scripts.

Scripts 95

Scripts APIs Entertainment Construction 95

AWS Machine Learning

NOVEMBER 21, 2024

The CreateAutoMLJobV2 API offers a low-level interface that allows for more control and customization. Using the SDK offers benefits like faster prototyping, better usability, and pre-built functions, and the API is better for advanced customizations. This pipeline step uses a Lambda step , which runs a serverless Lambda function.

Metrics 82

Metrics APIs Healthcare Scripts 82

AWS Machine Learning

NOVEMBER 7, 2022

We explore two ways of obtaining the same result: via JumpStart’s graphical interface on Amazon SageMaker Studio , and programmatically through JumpStart APIs. The following sections provide a step-by-step demo to perform inference, both via the Studio UI and via JumpStart APIs. JumpStart overview. Solution overview.

APIs 99

APIs Scripts Enterprise Big data 99

AWS Machine Learning

SEPTEMBER 14, 2023

Amazon API Gateway hosts a REST API with various endpoints to handle user requests that are authenticated using Amazon Cognito. The service analyzes the text and identifies any PII entities present within the query. The web application front-end is hosted on AWS Amplify. Confluence, Microsoft SharePoint, Google Drive, Jira, etc.)

APIs 121

APIs Healthcare Scripts Engineering 121

AWS Machine Learning

JANUARY 6, 2023

In this post, we present a solution to handle OOC situations through knowledge graph-based embedding search using the k-nearest neighbor (kNN) search capabilities of OpenSearch Service. Creates an API Gateway that adds an additional layer of security between the web app user interface and Lambda. Solution overview. from your terminal.

Entertainment 98

Entertainment APIs Scripts Analytics 98

AWS Machine Learning

DECEMBER 6, 2023

Another driver behind RAG’s popularity is its ease of implementation and the existence of mature vector search solutions, such as those offered by Amazon Kendra (see Amazon Kendra launches Retrieval API ) and Amazon OpenSearch Service (see k-Nearest Neighbor (k-NN) search in Amazon OpenSearch Service ), among others.

Analytics 127

Analytics APIs Engineering Construction 127

AWS Machine Learning

APRIL 27, 2023

Similar to the process of PyTorch integration with C++ code, Neuron CustomOps requires a C++ implementation of an operator via a NeuronCore-ported subset of the Torch C++ API. Finally, the custom library is built by calling the load API. It only defines the shape of the output tensor but not the actual values.

APIs 86

APIs Engineering Scripts Benchmark 86

AWS Machine Learning

APRIL 29, 2024

Dataset collection We followed the methodology outlined in the PMC-Llama paper [6] to assemble our dataset, which includes PubMed papers sourced from the Semantic Scholar API and various medical texts cited within the paper, culminating in a comprehensive collection of 88 billion tokens. Create and launch ParallelCluster in the VPC.

APIs 126

APIs Healthcare Scripts Enterprise 126

AWS Machine Learning

MAY 5, 2023

Using architecture diagrams as an example, the solution needs to search through reference links and technical documents for architecture diagrams and identify the services present. Therefore, users without ML expertise can enjoy the benefits of a custom labels model through an API call, because a significant amount of overhead is reduced.

Engineering 107

Engineering APIs Scripts Enterprise 107