Skip to content
All tags

#llmops

2 posts
ai deep-dive

Helicone Deep Dive: LLM Gateway, Request Tracing, and Cost Analytics

Helicone is an open-source LLM gateway and observability platform: requests sent through its compatible endpoint automatically capture model, latency, tokens, cost, and custom properties, while managed credits or BYOK enable routing and fallbacks.

#helicone#llm-observability#ai-gateway#tracing#llmops#open-source
ai deep-dive

LangSmith Deep Dive: From Agent Traces to Offline and Online Evaluation

LangSmith structures LLM applications as projects, traces, runs, and threads, then uses datasets, evaluators, and experiments to turn production failures into offline regression tests. It observes any LLM application and does not require LangChain.

#langsmith#llm-observability#tracing#evaluation#llmops#ai-agent