How to Become an AI Evaluation Engineer: 2026 Roadmap
10 min read
What an AI evaluation engineer does, the Ragas, DeepEval, TruLens and LangSmith stack, an LLM-as-a-judge CI pipeline you can copy, and two portfolio projects.
4 posts
10 min read
What an AI evaluation engineer does, the Ragas, DeepEval, TruLens and LangSmith stack, an LLM-as-a-judge CI pipeline you can copy, and two portfolio projects.
11 min read
RAG, agent memory or just a bigger context window? Cost per query at October 2026 prices, a runnable cost model, and when plain docs beat all three.
13 min read
Why Claude Code returns 400 errors through a custom ANTHROPIC_BASE_URL or LiteLLM, what it actually sends, and three fixes that hold up across releases.
24 min read
Hard LLM API budget caps that stop spend before the call: reserve-then-settle in Redis, per-tenant quotas, a spend circuit breaker and a kill switch.