Remove APIs Remove Best practices Remove How To
article thumbnail

Amazon Bedrock launches Session Management APIs for generative AI applications (Preview)

AWS Machine Learning

Amazon Bedrock announces the preview launch of Session Management APIs, a new capability that enables developers to simplify state and context management for generative AI applications built with popular open source frameworks such as LangGraph and LlamaIndex. Building generative AI applications requires more than model API calls.

APIs 99
article thumbnail

Security best practices to consider while fine-tuning models in Amazon Bedrock

AWS Machine Learning

In this post, we delve into the essential security best practices that organizations should consider when fine-tuning generative AI models. Implementing these procedures allows you to follow security best practices when you deploy and use your fine-tuned model within Amazon Bedrock for inference tasks. Choose Apply.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Build a multi-tenant generative AI environment for your enterprise on AWS

AWS Machine Learning

It also uses a number of other AWS services such as Amazon API Gateway , AWS Lambda , and Amazon SageMaker. API Gateway is serverless and hence automatically scales with traffic. API Gateway also provides a WebSocket API. Incoming requests to the gateway go through this point.

article thumbnail

Considerations for addressing the core dimensions of responsible AI for Amazon Bedrock applications

AWS Machine Learning

In this post, we introduce the core dimensions of responsible AI and explore considerations and strategies on how to address these dimensions for Amazon Bedrock applications. This tool not only supports responsible AI practices, but also fosters trust and reliability in the use of AI-generated content.

APIs 110
article thumbnail

Secure a generative AI assistant with OWASP Top 10 mitigation

AWS Machine Learning

In this post, we show you an example of a generative AI assistant application and demonstrate how to assess its security posture using the OWASP Top 10 for Large Language Model Applications , as well as how to apply mitigations for common threats. These steps might involve both the use of an LLM and external data sources and APIs.

APIs 110
article thumbnail

Use the ApplyGuardrail API with long-context inputs and streaming outputs in Amazon Bedrock

AWS Machine Learning

The new ApplyGuardrail API enables you to assess any text using your preconfigured guardrails in Amazon Bedrock, without invoking the FMs. In this post, we demonstrate how to use the ApplyGuardrail API with long-context inputs and streaming outputs. For example, you can now use the API with models hosted on Amazon SageMaker.

APIs 127
article thumbnail

Streamline workflow orchestration of a system of enterprise APIs using chaining with Amazon Bedrock Agents

AWS Machine Learning

Intricate workflows that require dynamic and complex API orchestration can often be complex to manage. In this post, we explore how chaining domain-specific agents using Amazon Bedrock Agents can transform a system of complex API interactions into streamlined, adaptive workflows, empowering your business to operate with agility and precision.

APIs 132