Enterprise Evals 101
Imagine your worst nightmare: your agent passes every demo, then a customer asks something you never tested, and it fails in public.In April...
Topic
#Harbor
6 篇笔记
Harbor Framework 深度调研
Harbor Framework 深度调研 一句话概括：Harbor 是一个开源框架，用于在容器化沙箱环境中评估和优化 AI Agent 及 LLM——从跑 benchmark、生成 RL rollout 到 prompt 优化，一站式解决。 |---| | GitHub | harbor-framework/harbor | | Stars | 4,500 | | License | Apach…
Evaluating OpenWiki with WikiBench
OpenWiki is our open source agent for generating and maintaining codebase documentation. As we improve OpenWiki, we’ve needed to measure two...
How we Build Agent Environments & Tasks
TLDR: This is a practical guide on how we create synthetic agent environments and tasks. By the end, we have a two-step pipeline. The first...
Evaluating code review agents with ReviewBench
There are more code review agents now, and we’ve been building one internally. Code review is hard to evaluate. There aren’t many benchmarks...
Towards Automating Eval Engineering
Today we’re releasing our Eval Engineering Skill, a skill that helps coding agents build evals using context from a repository and agent tra...