observability
27 articles in this category (Page 2 of 2)
AI NewsMicroservicesObservability
Scaling API Independence: Mocking, Contract Testing & Observability in Microservices
Tom Akehurst discusses strategies to overcome microservices challenges like environment dependency and slow development using API mocking, contract testing, and observability. He emphasizes realistic simulations, automated validation, and AI integration for efficient testing.
Read more
AI NewsObservabilityLLM
Why Observability Matters for AI Applications: A Deep Dive into LLM Monitoring
Sally O'Malley explains the unique observability challenges of Large Language Models (LLMs) and demonstrates how to implement an open-source observability stack using vLLM, Llama Stack, Prometheus, Grafana, and OpenTelemetry. She discusses key metrics for monitoring performance, cost, and quality, and the importance of tracing for debugging AI workloads.
Read more