Best Practices

Brown kraft paper peeled back to expose the ‘A’ and ‘I’ keys of a keyboard, symbolizing pulling back the curtain to observe what happens behind the scenes of AI.

Best Practices

Observability for LLMs: Why It Matters and How to Achieve It

Observability is crucial for LLM apps to ensure performance, reliability, and user trust. It involves monitoring metrics, logging prompts, outputs, and user interactions.

Tooling Deep-Dives

Using the OpenTelemetry Collector: A Practical Guide

OpenTelemetry’s Collector is a vendor-neutral service that sits between your applications and observability backends. It can receive telemetry data (traces, metrics, logs), process or transform it, and export it to one or multiple destinations. In a production environment, the Collector becomes essential for building a flexible and resilient observability