AWS Machine Learning

AUGUST 9, 2024

Question and answering (Q&A) using documents is a commonly used application in various use cases like customer support chatbots, legal research assistants, and healthcare advisors. In this collaboration, the AWS GenAIIC team created a RAG-based solution for Deltek to enable Q&A on single and multiple government solicitation documents.

Government 128

Government Healthcare Construction Engineering 128

AWS Machine Learning

FEBRUARY 12, 2025

Amazon Bedrock is a fully managed service that makes FMs from leading AI startups and Amazon available through an API, so you can choose from a wide range of FMs to find the model that is best suited for your use case. Solution overview The solution comprises two main steps: Generate synthetic data using the Amazon Bedrock InvokeModel API.

APIs 74

APIs Management Benchmark Scripts 74

AWS Machine Learning

DECEMBER 6, 2023

Such data often lacks the specialized knowledge contained in internal documents available in modern businesses, which is typically needed to get accurate answers in domains such as pharmaceutical research, financial investigation, and customer support. For example, imagine that you are planning next year’s strategy of an investment company.

Analytics 125

Analytics APIs Engineering Construction 125

AWS Machine Learning

OCTOBER 24, 2024

Broadly speaking, a retriever is a module that takes a query as input and outputs relevant documents from one or more knowledge sources relevant to that query. Document ingestion In a RAG architecture, documents are often stored in a vector store. You must use the same embedding model at ingestion time and at search time.

Chatbots 88

Chatbots Metrics Scripts APIs 88

AWS Machine Learning

FEBRUARY 25, 2025

This post shows how to configure an Amazon Q Business custom connector and derive insights by creating a generative AI-powered conversation experience on AWS using Amazon Q Business while using access control lists (ACLs) to restrict access to documents based on user permissions. Who are the data stewards for my proprietary database sources?

Enterprise 92

Enterprise Engineering APIs Accountability 92

AWS Machine Learning

FEBRUARY 8, 2024

At the forefront of this evolution sits Amazon Bedrock , a fully managed service that makes high-performing foundation models (FMs) from Amazon and other leading AI companies available through an API. System integration – Agents make API calls to integrated company systems to run specific actions. Gather evidence for claim 5t16u-7v.

APIs 140

APIs Scripts Enterprise Management 140

AWS Machine Learning

AUGUST 3, 2023

Data classification, extraction, and analysis can be challenging for organizations that deal with volumes of documents. Traditional document processing solutions are manual, expensive, error prone, and difficult to scale. FMs are transforming the way you can solve traditionally complex document processing workloads.

APIs 94

APIs Banking Enterprise Construction 94

AWS Machine Learning

DECEMBER 22, 2023

In particular, we cover the SMP library’s new simplified user experience that builds on open source PyTorch Fully Sharded Data Parallel (FSDP) APIs, expanded tensor parallel functionality that enables training models with hundreds of billions of parameters, and performance optimizations that reduce model training time and cost by up to 20%.

Scripts 120

Scripts APIs Engineering Finance 120

AWS Machine Learning

JULY 29, 2022

The SageMaker Python SDK provides open-source APIs and containers to train and deploy models on SageMaker, using several different ML and deep learning frameworks. BERT is pre-trained on masking random words in a sentence; in contrast, during Pegasus’s pre-training, sentences are masked from an input document. return tokenized_dataset.

Scripts 99

Scripts APIs Big data Engineering 99

AWS Machine Learning

NOVEMBER 21, 2022

Organizations across industries such as retail, banking, finance, healthcare, manufacturing, and lending often have to deal with vast amounts of unstructured text documents coming from various sources, such as news, blogs, product reviews, customer support channels, and social media. Extract and analyze data from documents.

Scripts 91

Scripts Metrics APIs Healthcare 91

AWS Machine Learning

FEBRUARY 29, 2024

Knowledge Bases for Amazon Bedrock automates synchronization of your data with your vector store, including diffing the data when it’s updated, document loading, and chunking, as well as semantic embedding. It then employs a language model to generate a response by considering both the retrieved documents and the original query.

APIs 135

APIs Healthcare Scripts Enterprise 135

AWS Machine Learning

AUGUST 2, 2024

Traditionally, earnings call scripts have followed similar templates, making it a repeatable task to generate them from scratch each time. On the other hand, generative artificial intelligence (AI) models can learn these templates and produce coherent scripts when fed with quarterly financial data.

Engineering 129

Engineering Scripts Metrics APIs 129

AWS Machine Learning

JULY 25, 2024

Accelerate research and analysis – Instead of manually searching through SharePoint documents, users can use Amazon Q to quickly find relevant information, summaries, and insights to support their research and decision-making. The site content space also provides access to add lists, pages, document libraries, and more.

Scripts 107

Scripts APIs Engineering Enterprise 107

AWS Machine Learning

SEPTEMBER 14, 2023

This post takes you through the most common challenges that customers face when searching internal documents, and gives you concrete guidance on how AWS services can be used to create a generative AI conversational bot that makes internal information more useful. The cost associated with training models on recent data is high.

APIs 120

APIs Healthcare Scripts Engineering 120

AWS Machine Learning

SEPTEMBER 8, 2023

Amazon Rekognition makes it easy to add image analysis capability to your applications without any machine learning (ML) expertise and comes with various APIs to fulfil use cases such as object detection, content moderation, face detection and analysis, and text and celebrity recognition, which we use in this example.

APIs 122

APIs Scripts Entertainment Personalization 122

Nexmo

OCTOBER 7, 2020

Vonage API Account. To complete this tutorial, you will need a Vonage API account. Once you have an account, you can find your API Key and API Secret at the top of the Vonage API Dashboard. Web Component polyfill --> <script src="[link]. <!-- This tutorial also uses a virtual phone number.

APIs 118

APIs Scripts Accountability 118

AWS Machine Learning

APRIL 23, 2024

Here are some features which we will cover: AWS CloudFormation support Private network policies for Amazon OpenSearch Serverless Multiple S3 buckets as data sources Service Quotas support Hybrid search, metadata filters, custom prompts for the RetreiveAndGenerate API, and maximum number of retrievals.

APIs 126

APIs Enterprise Scripts Accountability 126

AWS Machine Learning

JUNE 15, 2022

Amazon Kendra uses deep learning and reading comprehension to deliver precise answers, and returns a list of ranked documents that match the search query for you to choose from. We first ingest a set of documents, along with their metadata, into an Amazon Kendra index. Solution overview.

APIs 91

APIs Scripts Technology Engineering 91

AWS Machine Learning

JULY 8, 2022

OCR has been widely used in various scenarios, such as document electronization and identity authentication. Because OCR can greatly reduce the manual effort to register key information and serve as an entry step for understanding large volumes of documents, an accurate OCR system plays a crucial role in the era of digital transformation.

Best practices 96

Best practices Scripts Construction Management 96

AWS Machine Learning

JULY 17, 2024

In this post, we’re using the APIs for AWS Support , AWS Trusted Advisor , and AWS Health to programmatically access the support datasets and use the Amazon Q Business native Amazon Simple Storage Service (Amazon S3) connector to index support data and provide a prebuilt chatbot web experience. Synchronize the data source to index the data.

Scripts 121

Scripts APIs Enterprise Accountability 121

AWS Machine Learning

FEBRUARY 19, 2024

Embeddings are created for documents and user questions. The document embeddings are split into chunks and stored as indexes in a vector database. The text generation workflow then takes a question’s embedding vector and uses it to retrieve the most similar document chunks based on vector similarity.

Chatbots 123

Chatbots APIs Engineering Enterprise 123

AWS Machine Learning

DECEMBER 5, 2023

Enterprises may want to add custom metadata like document types (W-2 forms or paystubs), various entity types such as names, organization, and address, in addition to the standard metadata like file type, date created, or size to extend the intelligent search while ingesting the documents.

APIs 122

APIs Enterprise Accountability Healthcare 122

AWS Machine Learning

MAY 31, 2024

Lastly the model is tested against a set of known genome sequences using some inference API calls. Training on SageMaker We use PyTorch and Amazon SageMaker script mode to train this model. Script mode’s compatibility with PyTorch was crucial, allowing us to use our existing scripts with minimal modifications.

Biotechnology 109

Biotechnology Scripts Healthcare APIs 109

AWS Machine Learning

DECEMBER 22, 2023

Amazon Bedrock is a fully managed service that makes leading FMs from AI companies available through an API along with developer tooling to help build and scale generative AI applications. Instead of only fulfilling predefined intents through a static decision tree, agents are autonomous within the context of their suite of available tools.

Scripts 124

Scripts Chatbots Accountability Multi-channel support 124

AWS Machine Learning

MAY 5, 2023

Using architecture diagrams as an example, the solution needs to search through reference links and technical documents for architecture diagrams and identify the services present. Therefore, users without ML expertise can enjoy the benefits of a custom labels model through an API call, because a significant amount of overhead is reduced.

Engineering 104

Engineering APIs Scripts Enterprise 104

Spearline

JULY 21, 2022

And testingRTC offers multiple ways to export these metrics, from direct collection from webhooks, to downloading results in CSV format using the REST API. Flip the script With testingRTC, you only need to write scripts once, you can then run them multiple times and scale them up or down as you see fit. Happy days!

Scripts 98

Scripts APIs Metrics Analytics 98

AWS Machine Learning

JUNE 19, 2024

Imagine the possibilities: Quick and efficient brainstorming sessions, real-time ideation, and even drafting documents or code snippets—all powered by the latest advancements in AI. The Slack application sends the event to Amazon API Gateway , which is used in the event subscription.

APIs 102

APIs Engineering Accountability Big data 102

AWS Machine Learning

MAY 30, 2024

AWS Prototyping successfully delivered a scalable prototype, which solved CBRE’s business problem with a high accuracy rate (over 95%) and supported reuse of embeddings for similar NLQs, and an API gateway for integration into CBRE’s dashboards. The following diagram illustrates the web interface and API management layer.

Real estate 128

Real estate APIs Metrics Construction 128

AWS Machine Learning

MAY 16, 2023

As a JumpStart model hub customer, you get improved performance without having to maintain the model script outside of the SageMaker SDK. The inference script is prepacked with the model artifact. It develops insights by recognizing the entities, key phrases, language, sentiments, and other common elements in a document.

Chatbots 98

Chatbots Scripts APIs Feedback 98

AWS Machine Learning

FEBRUARY 5, 2025

Lets delve into a basic Colang script to see how it works: define user express greeting "hello" "hi" "what's up?" define flow greeting user express greeting bot express greeting bot ask how are you In this script, we see the three fundamental types of blocks in Colang: User Message Blocks (define user ): These define possible user inputs.

Chatbots 99

Chatbots Construction Best practices APIs 99

AWS Machine Learning

JUNE 4, 2024

The workflow includes the following steps: The user runs the terraform apply The Terraform local-exec provisioner is used to run a Python script that downloads the public dataset DialogSum from the Hugging Face Hub. More information can be found in the Terraform documentation for aws_caller_identity , aws_partition , and aws_region.

Scripts 130

Scripts Accountability Engineering Best practices 130

AWS Machine Learning

JUNE 12, 2024

This solution uses an Amazon Cognito user pool as an OAuth-compatible identity provider (IdP), which is required in order to exchange a token with AWS IAM Identity Center and later on interact with the Amazon Q Business APIs. Amazon Q uses the chat_sync API to carry out the conversation. You can also find the script on the GitHub repo.

APIs 134

APIs Enterprise Accountability Feedback 134

AWS Machine Learning

FEBRUARY 19, 2024

An asynchronous API and Amazon OpenSearch Service connector make it easy to integrate the model into your neural search applications. Before you can write scripts that use the Amazon Bedrock API, you need to install the appropriate version of the AWS SDK in your environment. The vectors power speedy, accurate search experiences.

Scripts 126

Scripts APIs Entertainment Engineering 126

AWS Machine Learning

NOVEMBER 20, 2023

Retrieval Augmented Generation (RAG) allows you to provide a large language model (LLM) with access to data from external knowledge sources such as repositories, databases, and APIs without the need to fine-tune it. When a user asks a question, it searches the vector database and retrieves documents that are most similar to the user’s query.

APIs 122

APIs Entertainment Accountability Customer Experience 122

AWS Machine Learning

JULY 24, 2023

If the model changes on the server side, the client has to know and change its API call to the new endpoint accordingly. Clone the Github repository The GitHub repo provides all the scripts necessary to deploy models using FastAPI on NeuronCores on AWS Inferentia instances. code as the entry point. compiled-model-bs-{batch_size}.pt')

Scripts 92

Scripts APIs Best practices Engineering 92

AWS Machine Learning

MAY 22, 2023

Note that you need to pass the Predictor class when deploying model through the Model class to be able to run inference through the SageMaker API. It develops insights by recognizing the entities, key phrases, language, sentiments, and other common elements in a document.

APIs 110

APIs Scripts Metrics Accountability 110

AWS Machine Learning

MAY 19, 2023

In our previous blogpost Enable the Visually Impaired to Hear Documents using Amazon Textract and Amazon Polly , we showed you our Text to Speech application called “Read for Me”. A pre-signed URL with the location of the audio file stored in Amazon S3 is sent back to the user’s browser through Amazon API Gateway.

APIs 101

APIs Scripts Best practices Engineering 101