OpenTelemetry Semantic Conventions for Generative AI
Drew Robbins
Engineering Leader | Driving Innovation and Observability in Generative AI Applications
Exciting news from our OpenTelemetry working group! We've just merged our first pull-request for OpenTelemetry Semantic Conventions tailored to Generative AI applications. This milestone is the result of a collaborative effort across the industry, establishing a common data model for monitoring Generative AI applications in observability systems.
Our newly defined conventions cover key aspects such as model names, versions, token usage, and even chat history tracking for better evaluation and debugging. This PR is just the beginning—it sets the stage for ongoing community contributions and broader application support.
What’s next?
We’re eager to expand these conventions and need your expertise:
Join Us!
Our meetings are open to everyone and are a great way to contribute to a leading-edge topic. Check out the meeting notes, and join our slack channel (#otel-llm-semconv-wg) to get involved.
Let’s shape the future of Generative AI monitoring together!
Co-Founder of Altrosyn and DIrector at CDTECH | Inventor | Manufacturer
1yIt's truly commendable to see the strides taken in standardizing OpenTelemetry Semantic Conventions for Generative AI, fostering consistency and clarity in monitoring and evaluation. This initiative marks a pivotal moment in advancing observability systems, paving the way for more robust and comprehensive monitoring of Generative AI applications. As this field continues to evolve rapidly, what specific challenges do you anticipate in ensuring broad adoption of these conventions across diverse AI frameworks and platforms? Additionally, considering the dynamic nature of Generative AI, how do you envision incorporating flexibility into these conventions to accommodate emerging techniques and technologies?
AI Experts - Join our Network of AI Speakers, Consultants and AI Solution Providers. Message me for info.
1yExciting progress towards standardizing Generative AI observability - looking forward to contributing too.
I connect your personal brand with your SEO | I rank your company on AI search engines | I give away content marketing frameworks that are an absolute no brainer to implement!
1yThat's awesome news. Collaborating for progress in AI, impressive teamwork. Drew Robbins