According to an official release, New Relic, an all-in-one observability platform for every engineer, announced that New Relic AI Monitoring (AIM), an APM solution for AI-powered applications, is now integrated with Amazon Bedrock, a fully managed service by Amazon Web Services, Inc. (AWS)‘s that makes foundation models (FMs) from AI companies accessible through an API to build and scale generative AI applications.
Sources revealed that AWS customers can now use New Relic to gain greater visibility and insights across the AI stack, making it easier to troubleshoot and optimise their applications for performance, quality, and cost.
“Observability is essential for any company building AI applications. With AWS we plan to bring the power of observability to engineers and developers who are modernising their tech stacks. And by putting our AI monitoring solution front and center with AWS customers, we are multiplying our ability to reach every engineer using leading LLMs like Anthropic,” Manav Khurana, chief product officer, New Relic, explained.
It is believed that AIM integrates with Amazon Bedrock to provide in-depth end-to-end observability. With AIM’s built-in integrations such as Langchain, Amazon Bedrock customers can get metrics and trace throughout the life-cycle of LLM prompt and response, ranging from raw prompts to repaired and business-compliant responses.
