article thumbnail

Reducing hallucinations in LLM agents with a verified semantic cache using Amazon Bedrock Knowledge Bases

AWS Machine Learning

Solution overview Our solution implements a verified semantic cache using the Amazon Bedrock Knowledge Bases Retrieve API to reduce hallucinations in LLM responses while simultaneously improving latency and reducing costs. Lets assume that the question What date will AWS re:invent 2024 occur? is within the verified semantic cache.

article thumbnail

Benchmarking Amazon Nova and GPT-4o models with FloTorch

AWS Machine Learning

OpenAI launched GPT-4o in May 2024, and Amazon introduced Amazon Nova models at AWS re:Invent in December 2024. Amazon Bedrock APIs make it straightforward to use Amazon Titan Text Embeddings V2 for embedding data. The growing need for cost-effective AI models The landscape of generative AI is rapidly evolving.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

GraphStorm 0.3: Scalable, multi-task learning on graphs with user-friendly APIs

AWS Machine Learning

adds new APIs to customize GraphStorm pipelines: you now only need 12 lines of code to implement a custom node classification training loop. To help you get started with the new API, we have published two Jupyter notebook examples: one for node classification, and one for a link prediction task. Specifically, GraphStorm 0.3

APIs 117
article thumbnail

From RAG to fabric: Lessons learned from building real-world RAGs at GenAIIC – Part 2

AWS Machine Learning

An alternative approach to routing is to use the native tool use capability (also known as function calling) available within the Bedrock Converse API. In this scenario, each category or data source would be defined as a ‘tool’ within the API, enabling the model to select and use these tools as needed.

APIs 118
article thumbnail

Principal Financial Group uses QnABot on AWS and Amazon Q Business to enhance workforce productivity with generative AI

AWS Machine Learning

In business for 145 years, Principal is helping approximately 64 million customers (as of Q2, 2024) plan, protect, invest, and retire, while working to support the communities where it does business and build a diverse, inclusive workforce. 2024, Principal Financial Services, Inc. 3778998-082024

Chatbots 114
article thumbnail

Enhance speech synthesis and video generation models with RLHF using audio and video segmentation in Amazon SageMaker

AWS Machine Learning

Programmatic setup Alternatively, you can create your labeling job programmatically using the CreateLabelingJob API. Whether you choose the SageMaker console or API approach, the result is the same: a fully configured labeling job ready for your annotation team.

APIs 95
article thumbnail

How AWS sales uses Amazon Q Business for customer engagement

AWS Machine Learning

Introducing Field Advisor In April 2024, we launched our AI sales assistant, which we call Field Advisor, making it available to AWS employees in the Sales, Marketing, and Global Services organization, powered by Amazon Q Business. We deliver our chatbot experience through a custom web frontend, as well as through a Slack application.

Sales 102