Dynatrace (NYSE: DT), a unified observability and security-based platform, has announced that it has extended its analytics and automation platform to provide observability and security for large language models (LLMs) and generative AI-powered applications.
According to an official release, Dynatrace® AI Observability is a solution which covers the end-to-end AI stack, including infrastructure, such as Nvidia® GPUs, foundational models, such as GPT4, semantic caches and vector databases, such as Weaviate, and orchestration frameworks, such as LangChain. From what it’s understood, it also supports platforms for building, training, and delivering AI models, including Microsoft® Azure OpenAI Service, Amazon® SageMaker, and Google® AI Platform.
Reportedly, Dynatrace AI Observability leverages the platform’s Davis® AI and other technologies to deliver a view of AI-powered applications. As a result, organisations are believed can provide user experiences while identifying performance bottlenecks and root causes automatically. Based on official data, Dynatrace AI Observability with Davis AI also helps platforms comply with privacy and security regulations and governance standards by tracing the origins of the output created by their applications. Additionally, it seemingly helps users forecast and control costs by monitoring their consumption of tokens, which are the basic units that generative AI models use to process queries.
“I believe generative AI is the new frontier of digital transformation. This technology can enable organisations to create solutions that boost productivity, profitability, and competitiveness. While transformational, it can also pose new challenges for security, transparency, reliability, experience, and cost management. Organisations need AI observability that can cover every aspect of their generative AI solutions to overcome these challenges. Dynatrace is extending its observability and AI leadership to meet this need, helping customers to embrace AI with insights into their generative AI-driven applications,” Bernd Greifeneder, CTO, Dynatrace, said.
