2024, APIs and Benchmark - Customer Contact Central

GraphStorm 0.3: Scalable, multi-task learning on graphs with user-friendly APIs

AWS Machine Learning

AUGUST 2, 2024

adds new APIs to customize GraphStorm pipelines: you now only need 12 lines of code to implement a custom node classification training loop. To help you get started with the new API, we have published two Jupyter notebook examples: one for node classification, and one for a link prediction task. Specifically, GraphStorm 0.3

APIs

APIs Benchmark Construction Enterprise

Your guide to generative AI and ML at AWS re:Invent 2024

AWS Machine Learning

NOVEMBER 19, 2024

Seamlessly bring your fine-tuned models into a fully managed, serverless environment, and use the Amazon Bedrock standardized API and features like Amazon Bedrock Agents and Amazon Bedrock Knowledge Bases to accelerate generative AI application development.

APIs

APIs Enterprise Best practices Government

Brilliant words, brilliant writing: Using AWS AI chips to quickly deploy Meta LLama 3-powered applications

AWS Machine Learning

OCTOBER 21, 2024

In this blog post, we will introduce how to use an Amazon EC2 Inf2 instance to cost-effectively deploy multiple industry-leading LLMs on AWS Inferentia2 , a purpose-built AWS AI chip, helping customers to quickly test and open up an API interface to facilitate performance benchmarking and downstream application calls at the same time.

APIs

APIs Benchmark Education Marketing

A progress update on our commitment to safe, responsible generative AI

AWS Machine Learning

JULY 10, 2024

red teaming) In April 2024, we announced the general availability of Guardrails for Amazon Bedrock and Model Evaluation in Amazon Bedrock to make it easier to introduce safeguards, prevent harmful content, and evaluate models against key safety and accuracy criteria. In February 2024, Amazon joined the U.S.

Government

Government Education Best practices APIs

Amazon Bedrock Custom Model Import now generally available

AWS Machine Learning

OCTOBER 21, 2024

This feature empowers customers to import and use their customized models alongside existing foundation models (FMs) through a single, unified API. Having a unified developer experience when accessing custom models or base models through Amazon Bedrock’s API. Ease of deployment through a fully managed, serverless, service. 2, 3, 3.1,

APIs

APIs Scripts Finance Real estate

From RAG to fabric: Lessons learned from building real-world RAGs at GenAIIC – Part 2

AWS Machine Learning

NOVEMBER 15, 2024

An alternative approach to routing is to use the native tool use capability (also known as function calling) available within the Bedrock Converse API. In this scenario, each category or data source would be defined as a ‘tool’ within the API, enabling the model to select and use these tools as needed.

APIs

APIs Engineering Chatbots Construction

Get started with Amazon Titan Text Embeddings V2: A new state-of-the-art embeddings model on Amazon Bedrock

AWS Machine Learning

MAY 2, 2024

We published a follow-up post on January 31, 2024, and provided code examples using AWS SDKs and LangChain, showcasing a Streamlit semantic search app. A common way to select an embedding model (or any model) is to look at public benchmarks; an accepted benchmark for measuring embedding quality is the MTEB leaderboard.

Benchmark

Benchmark Metrics Enterprise APIs

Best practices for building robust generative AI applications with Amazon Bedrock Agents – Part 1

AWS Machine Learning

OCTOBER 2, 2024

In addition, they use the developer-provided instruction to create an orchestration plan and then carry out the plan by invoking company APIs and accessing knowledge bases using Retrieval Augmented Generation (RAG) to provide an answer to the user’s request. user id 111 Today: 09/03/2024 Certainly! Your appointment ID is XXXX.

Best practices

Best practices APIs Metrics Accountability

Build a RAG-based QnA application using Llama3 models from SageMaker JumpStart

AWS Machine Learning

SEPTEMBER 12, 2024

On Hugging Face, the Massive Text Embedding Benchmark (MTEB) is provided as a leaderboard for diverse text embedding tasks. It currently provides 129 benchmarking datasets across 8 different tasks on 113 languages. medium instance to demonstrate deploying the model as an API endpoint using an SDK through SageMaker JumpStart.

APIs

APIs Benchmark Enterprise Construction

A review of purpose-built accelerators for financial services

AWS Machine Learning

SEPTEMBER 11, 2024

In terms of resulting speedups, the approximate order is programming hardware, then programming against PBA APIs, then programming in an unmanaged language such as C++, then a managed language such as Python. In March 2024, AWS announced it will offer the new NVIDIA Blackwell platform, featuring the new GB200 Grace Blackwell chip.

Benchmark

Benchmark Banking Analytics Big data

Evaluate conversational AI agents with Amazon Bedrock

AWS Machine Learning

JULY 25, 2024

Although existing large language model (LLM) benchmarks like MT-bench evaluate model capabilities, they lack the ability to validate the application layers. Evaluator considerations By default, evaluators use the InvokeModel API with On-Demand mode, which will incur AWS charges based on input tokens processed and output tokens generated.

APIs

APIs Engineering Best practices Virtual Agent

The executive’s guide to generative AI for sustainability

AWS Machine Learning

APRIL 22, 2024

Figure 1: Examples of generative AI for sustainability use cases across the value chain According to KPMG’s 2024 ESG Organization Survey , investment in ESG capabilities is another top priority for executives as organizations face increasing regulatory pressure to disclose information about ESG impacts, risks, and opportunities.

Best practices

Best practices Benchmark Transportation Engineering

Mixtral 8x22B is now available in Amazon SageMaker JumpStart

AWS Machine Learning

MAY 17, 2024

What is Mixtral 8x22B Mixtral 8x22B is Mistral AI’s latest open-weights model and sets a new standard for performance and efficiency of available foundation models , as measured by Mistral AI across standard industry benchmarks. making the model available for exploring, testing, and deploying. Therefore, she sold the car for $18,248.33.

APIs

APIs Benchmark Personalization Enterprise

AWS empowers sales teams using generative AI solution built on Amazon Bedrock

AWS Machine Learning

AUGUST 26, 2024

From the period of September 2023 to March 2024, sellers leveraging GenAI Account Summaries saw a 4.9% This involves benchmarking new models against our current selections across various metrics, running A/B tests, and gradually incorporating high-performing models into our production pipeline. The impact goes beyond just efficiency.

Sales

Sales Accountability Feedback Metrics

Boost inference performance for Mixtral and Llama 2 models with new Amazon SageMaker containers

AWS Machine Learning

APRIL 8, 2024

In January 2024, Amazon SageMaker launched a new version (0.26.0) In this post, we explore the latest features introduced in this release, examine performance benchmarks, and provide a detailed guide on deploying new LLMs with LMI DLCs at high performance. of Large Model Inference (LMI) Deep Learning Containers (DLCs).

Engineering

Engineering Calibration APIs Enterprise

Improve factual consistency with LLM Debates

AWS Machine Learning

NOVEMBER 22, 2024

This post and the subsequent code implementation were inspired by one of the International Conference on Machine Learning (ICML) 2024 best papers on LLM debates Debating with More Persuasive LLMs Leads to More Truthful Answers. It uses a different dataset, TofuEval. Details on the exact dataset can be found in the GitHub repository.

Consulting

Consulting Consulting APIs Calibration

Enable data sharing through federated learning: A policy approach for chief digital officers

AWS Machine Learning

MARCH 15, 2024

Furthermore, model hosting on Amazon SageMaker JumpStart can help by exposing the endpoint API without sharing model weights. It also takes away potential high-level compute challenges with on-premises hardware with Amazon Elastic Compute Cloud (Amazon EC2) resources.

Healthcare

Healthcare Government Best practices Engineering

Anthropic Claude 3.5 Sonnet ranks number 1 for business and finance in S&P AI Benchmarks by Kensho

AWS Machine Learning

JULY 9, 2024

Sonnet currently ranks at the top of S&P AI Benchmarks by Kensho , which assesses large language models (LLMs) for finance and business. For example, there could be leakage of benchmark datasets’ questions and answers into training data. Anthropic Claude 3.5 Kensho is the AI Innovation Hub for S&P Global. Anthropic Claude 3.5

Finance

Finance Benchmark industry standards Accountability

Philips accelerates development of AI-enabled healthcare solutions with an MLOps platform built on Amazon SageMaker

AWS Machine Learning

NOVEMBER 16, 2023

Enable a data science team to manage a family of classic ML models for benchmarking statistics across multiple medical units. Users from several business units were trained and onboarded to the platform, and that number is expected to grow in 2024. Another important metric is the efficiency for data science users.

Healthcare

Healthcare Government Engineering APIs

Secure AccountantAI Chatbot: Lili’s journey with Amazon Bedrock

AWS Machine Learning

JULY 18, 2024

The ingestion workflow transforms these curated questions into vector embeddings using Amazon Titan Text Embeddings model API. Specific accounting knowledge that is relevant to the question and the model is not familiar with, such as updated data for 2024. The vector embeddings are persisted in the application in-memory vector store.

Chatbots

Chatbots APIs Accountability Finance

Customer Contact Central

GraphStorm 0.3: Scalable, multi-task learning on graphs with user-friendly APIs

Your guide to generative AI and ML at AWS re:Invent 2024

Trending Sources

Brilliant words, brilliant writing: Using AWS AI chips to quickly deploy Meta LLama 3-powered applications

A progress update on our commitment to safe, responsible generative AI

Amazon Bedrock Custom Model Import now generally available

From RAG to fabric: Lessons learned from building real-world RAGs at GenAIIC – Part 2

Get started with Amazon Titan Text Embeddings V2: A new state-of-the-art embeddings model on Amazon Bedrock

Best practices for building robust generative AI applications with Amazon Bedrock Agents – Part 1

Build a RAG-based QnA application using Llama3 models from SageMaker JumpStart

A review of purpose-built accelerators for financial services

Evaluate conversational AI agents with Amazon Bedrock

The executive’s guide to generative AI for sustainability

Mixtral 8x22B is now available in Amazon SageMaker JumpStart

AWS empowers sales teams using generative AI solution built on Amazon Bedrock

Boost inference performance for Mixtral and Llama 2 models with new Amazon SageMaker containers

Improve factual consistency with LLM Debates

Enable data sharing through federated learning: A policy approach for chief digital officers

Anthropic Claude 3.5 Sonnet ranks number 1 for business and finance in S&P AI Benchmarks by Kensho

Philips accelerates development of AI-enabled healthcare solutions with an MLOps platform built on Amazon SageMaker

Secure AccountantAI Chatbot: Lili’s journey with Amazon Bedrock

Stay Connected