AWS Machine Learning

OCTOBER 29, 2024

Enterprises in industries like manufacturing, finance, and healthcare are inundated with a constant flow of documents—from financial reports and contracts to patient records and supply chain documents. An AWS Lambda function reads the Amazon Textract response and calls an Amazon Bedrock prompt flow to classify the document.

Finance 100

Finance Enterprise Healthcare Scripts 100

AWS Machine Learning

DECEMBER 22, 2023

In particular, we cover the SMP library’s new simplified user experience that builds on open source PyTorch Fully Sharded Data Parallel (FSDP) APIs, expanded tensor parallel functionality that enables training models with hundreds of billions of parameters, and performance optimizations that reduce model training time and cost by up to 20%.

Scripts 117

Scripts APIs Engineering Finance 117

AWS Machine Learning

FEBRUARY 29, 2024

Knowledge Bases for Amazon Bedrock automates synchronization of your data with your vector store, including diffing the data when it’s updated, document loading, and chunking, as well as semantic embedding. It then employs a language model to generate a response by considering both the retrieved documents and the original query.

APIs 126

APIs Healthcare Scripts Enterprise 126

AWS Machine Learning

JULY 29, 2022

The SageMaker Python SDK provides open-source APIs and containers to train and deploy models on SageMaker, using several different ML and deep learning frameworks. BERT is pre-trained on masking random words in a sentence; in contrast, during Pegasus’s pre-training, sentences are masked from an input document. return tokenized_dataset.

Scripts 89

Scripts APIs Big data Engineering 89

AWS Machine Learning

AUGUST 3, 2023

Data classification, extraction, and analysis can be challenging for organizations that deal with volumes of documents. Traditional document processing solutions are manual, expensive, error prone, and difficult to scale. FMs are transforming the way you can solve traditionally complex document processing workloads.

APIs 77

APIs Banking Enterprise Construction 77

AWS Machine Learning

OCTOBER 14, 2024

For many of these use cases, businesses are building Retrieval Augmented Generation (RAG) style chat-based assistants, where a powerful LLM can reference company-specific documents to answer questions relevant to a particular business or use case. Generate a grounded response to the original question based on the retrieved documents.

Chatbots 118

Chatbots APIs Engineering Healthcare 118

Nexmo

OCTOBER 7, 2020

Vonage API Account. To complete this tutorial, you will need a Vonage API account. Once you have an account, you can find your API Key and API Secret at the top of the Vonage API Dashboard. Web Component polyfill --> <script src="[link]. <!-- This tutorial also uses a virtual phone number.

APIs 118

APIs Scripts Accountability 118

AWS Machine Learning

AUGUST 2, 2024

Traditionally, earnings call scripts have followed similar templates, making it a repeatable task to generate them from scratch each time. On the other hand, generative artificial intelligence (AI) models can learn these templates and produce coherent scripts when fed with quarterly financial data.

Engineering 119

Engineering Scripts Metrics APIs 119

AWS Machine Learning

NOVEMBER 21, 2022

Organizations across industries such as retail, banking, finance, healthcare, manufacturing, and lending often have to deal with vast amounts of unstructured text documents coming from various sources, such as news, blogs, product reviews, customer support channels, and social media. Extract and analyze data from documents.

Scripts 74

Scripts Metrics APIs Healthcare 74

AWS Machine Learning

SEPTEMBER 14, 2023

This post takes you through the most common challenges that customers face when searching internal documents, and gives you concrete guidance on how AWS services can be used to create a generative AI conversational bot that makes internal information more useful. The cost associated with training models on recent data is high.

APIs 112

APIs Healthcare Scripts Engineering 112

AWS Machine Learning

SEPTEMBER 8, 2023

Amazon Rekognition makes it easy to add image analysis capability to your applications without any machine learning (ML) expertise and comes with various APIs to fulfil use cases such as object detection, content moderation, face detection and analysis, and text and celebrity recognition, which we use in this example.

APIs 114

APIs Scripts Entertainment Personalization 114

AWS Machine Learning

JULY 25, 2024

Accelerate research and analysis – Instead of manually searching through SharePoint documents, users can use Amazon Q to quickly find relevant information, summaries, and insights to support their research and decision-making. The site content space also provides access to add lists, pages, document libraries, and more.

Scripts 99

Scripts APIs Engineering Enterprise 99

AWS Machine Learning

APRIL 23, 2024

Here are some features which we will cover: AWS CloudFormation support Private network policies for Amazon OpenSearch Serverless Multiple S3 buckets as data sources Service Quotas support Hybrid search, metadata filters, custom prompts for the RetreiveAndGenerate API, and maximum number of retrievals.

APIs 122

APIs Enterprise Scripts Accountability 122

AWS Machine Learning

MAY 5, 2023

Using architecture diagrams as an example, the solution needs to search through reference links and technical documents for architecture diagrams and identify the services present. Therefore, users without ML expertise can enjoy the benefits of a custom labels model through an API call, because a significant amount of overhead is reduced.

Engineering 109

Engineering APIs Scripts Enterprise 109

AWS Machine Learning

FEBRUARY 19, 2024

Embeddings are created for documents and user questions. The document embeddings are split into chunks and stored as indexes in a vector database. The text generation workflow then takes a question’s embedding vector and uses it to retrieve the most similar document chunks based on vector similarity.

Chatbots 108

Chatbots APIs Engineering Enterprise 108

AWS Machine Learning

DECEMBER 5, 2023

Enterprises may want to add custom metadata like document types (W-2 forms or paystubs), various entity types such as names, organization, and address, in addition to the standard metadata like file type, date created, or size to extend the intelligent search while ingesting the documents.

APIs 117

APIs Enterprise Accountability Healthcare 117

AWS Machine Learning

JULY 17, 2024

In this post, we’re using the APIs for AWS Support , AWS Trusted Advisor , and AWS Health to programmatically access the support datasets and use the Amazon Q Business native Amazon Simple Storage Service (Amazon S3) connector to index support data and provide a prebuilt chatbot web experience. Synchronize the data source to index the data.

Scripts 110

Scripts APIs Enterprise Accountability 110

Spearline

JULY 21, 2022

And testingRTC offers multiple ways to export these metrics, from direct collection from webhooks, to downloading results in CSV format using the REST API. Flip the script With testingRTC, you only need to write scripts once, you can then run them multiple times and scale them up or down as you see fit. Happy days!

Scripts 98

Scripts APIs Metrics Analytics 98

AWS Machine Learning

MAY 31, 2024

Lastly the model is tested against a set of known genome sequences using some inference API calls. Training on SageMaker We use PyTorch and Amazon SageMaker script mode to train this model. Script mode’s compatibility with PyTorch was crucial, allowing us to use our existing scripts with minimal modifications.

Biotechnology 100

Biotechnology Scripts Healthcare APIs 100

AWS Machine Learning

DECEMBER 22, 2023

Amazon Bedrock is a fully managed service that makes leading FMs from AI companies available through an API along with developer tooling to help build and scale generative AI applications. Instead of only fulfilling predefined intents through a static decision tree, agents are autonomous within the context of their suite of available tools.

Scripts 116

Scripts Chatbots Accountability Multi-channel support 116

AWS Machine Learning

JULY 8, 2022

OCR has been widely used in various scenarios, such as document electronization and identity authentication. Because OCR can greatly reduce the manual effort to register key information and serve as an entry step for understanding large volumes of documents, an accurate OCR system plays a crucial role in the era of digital transformation.

Best practices 82

Best practices Scripts Construction Management 82

AWS Machine Learning

JUNE 15, 2022

Amazon Kendra uses deep learning and reading comprehension to deliver precise answers, and returns a list of ranked documents that match the search query for you to choose from. We first ingest a set of documents, along with their metadata, into an Amazon Kendra index. Solution overview.

APIs 73

APIs Scripts Technology Engineering 73

AWS Machine Learning

FEBRUARY 19, 2024

An asynchronous API and Amazon OpenSearch Service connector make it easy to integrate the model into your neural search applications. Before you can write scripts that use the Amazon Bedrock API, you need to install the appropriate version of the AWS SDK in your environment. The vectors power speedy, accurate search experiences.

Scripts 114

Scripts APIs Entertainment Engineering 114

AWS Machine Learning

MAY 30, 2024

AWS Prototyping successfully delivered a scalable prototype, which solved CBRE’s business problem with a high accuracy rate (over 95%) and supported reuse of embeddings for similar NLQs, and an API gateway for integration into CBRE’s dashboards. The following diagram illustrates the web interface and API management layer.

Real estate 121

Real estate APIs Metrics Construction 121

AWS Machine Learning

JUNE 4, 2024

The workflow includes the following steps: The user runs the terraform apply The Terraform local-exec provisioner is used to run a Python script that downloads the public dataset DialogSum from the Hugging Face Hub. More information can be found in the Terraform documentation for aws_caller_identity , aws_partition , and aws_region.

Scripts 126

Scripts Accountability Engineering Best practices 126

AWS Machine Learning

MAY 22, 2023

Note that you need to pass the Predictor class when deploying model through the Model class to be able to run inference through the SageMaker API. It develops insights by recognizing the entities, key phrases, language, sentiments, and other common elements in a document.

APIs 106

APIs Scripts Metrics Accountability 106

AWS Machine Learning

JUNE 19, 2024

Imagine the possibilities: Quick and efficient brainstorming sessions, real-time ideation, and even drafting documents or code snippets—all powered by the latest advancements in AI. The Slack application sends the event to Amazon API Gateway , which is used in the event subscription.

APIs 90

APIs Engineering Accountability Scripts 90

AWS Machine Learning

MAY 19, 2023

In our previous blogpost Enable the Visually Impaired to Hear Documents using Amazon Textract and Amazon Polly , we showed you our Text to Speech application called “Read for Me”. A pre-signed URL with the location of the audio file stored in Amazon S3 is sent back to the user’s browser through Amazon API Gateway.

APIs 96

APIs Scripts Best practices Engineering 96

AWS Machine Learning

NOVEMBER 20, 2023

Retrieval Augmented Generation (RAG) allows you to provide a large language model (LLM) with access to data from external knowledge sources such as repositories, databases, and APIs without the need to fine-tune it. When a user asks a question, it searches the vector database and retrieves documents that are most similar to the user’s query.

APIs 114

APIs Entertainment Accountability Customer Experience 114

AWS Machine Learning

MARCH 23, 2023

Applications and services can call the deployed endpoint directly or through a deployed serverless Amazon API Gateway architecture. To learn more about real-time endpoint architectural best practices, refer to Creating a machine learning-powered REST API with Amazon API Gateway mapping templates and Amazon SageMaker.

Scripts 113

Scripts APIs Government Analytics 113

AWS Machine Learning

MAY 16, 2023

As a JumpStart model hub customer, you get improved performance without having to maintain the model script outside of the SageMaker SDK. The inference script is prepacked with the model artifact. It develops insights by recognizing the entities, key phrases, language, sentiments, and other common elements in a document.

Chatbots 87

Chatbots Scripts APIs Feedback 87

AWS Machine Learning

NOVEMBER 26, 2023

Gartner predicts that “by 2026, more than 80% of enterprises will have used generative AI APIs or models, or deployed generative AI-enabled applications in production environments, up from less than 5% in 2023.” However, scripting appealing subject lines can often be tedious and time-consuming.

Personalization 120

Personalization Customer Experience APIs Entertainment 120

AWS Machine Learning

JUNE 12, 2024

This solution uses an Amazon Cognito user pool as an OAuth-compatible identity provider (IdP), which is required in order to exchange a token with AWS IAM Identity Center and later on interact with the Amazon Q Business APIs. Amazon Q uses the chat_sync API to carry out the conversation. You can also find the script on the GitHub repo.

APIs 121

APIs Enterprise Accountability Feedback 121

AWS Machine Learning

MAY 23, 2023

Original content production, code generation, customer service enhancement, and document summarization are typical use cases of generative AI. The web application interacts with the models via Amazon API Gateway and AWS Lambda functions as shown in the following diagram. Clone and set up the AWS CDK application. Choose Generate image.

APIs 106

APIs Accountability Construction Management 106

AWS Machine Learning

JUNE 23, 2023

FastAPI is a modern, high-performance web framework for building APIs with Python. Its ease and built-in functionalities like the automatic API documentation make it a popular choice amongst ML engineers to deploy high-performance inference APIs. To build this image locally, we need Docker. file later in this post.

APIs 94

APIs Scripts Engineering Accountability 94

AWS Machine Learning

APRIL 17, 2024

companion script (both commands are part of the container): neuron-monitor | neuron-monitor-prometheus.py --port The command uses the following components: neuron-monitor collects metrics and stats from the Neuron applications running on the system and streams the collected data to stdout in JSON format neuron-monitor-prometheus.py

APIs 114

APIs Metrics Accountability Management 114

AWS Machine Learning

NOVEMBER 15, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

APIs 105

APIs Government Best practices Metrics 105