Improve LLM performance with human and AI feedback on Amazon SageMaker for Amazon Engineering
AWS Machine Learning
APRIL 24, 2024
The Amazon D&C team implemented the solution in a pilot for Amazon engineers and collected user feedback. In this post, we share how we analyzed the feedback data and identified limitations of accuracy and hallucinations RAG provided, and used the human evaluation score to train the model through reinforcement learning.
Let's personalize your content