> For the complete documentation index, see [llms.txt](https://docs.kiln.tech/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.kiln.tech/docs/evals-and-specs.md). # Evals #### Two Ways to Build Evals Kiln has two powerful ways to build evals that ensure your AI systems perform as expected, drive optimizations and don't regress in quality: * [**Manual Evals**](/docs/evals-and-specs/evaluations.md): Build industry standard evals with methods like LLM-as-Judge and G-Eval. * [**Eval Builder**](/docs/evals-and-specs/specifications.md)**:** A guided interactive flow that includes synthetic evaluation data generation, edge case detection, judge prompt generation, and more. It's an easy, fast and more comprehensive way to build evals.

	Manual Evals	Eval Builder
LLM-as-Judge including G-Eval	✅	✅
Judge Prompt Creation	Manual	Automatic
Edge Case Discovery	Manual	Automatic
Eval Data Creation	Manual With synthetic tooling	Automatic
Eval Accuracy	Variable	High Human in the loop validation and refinement
Approx. Effort	30 mins+	5-10 mins
Needed Expertise	Data Science Basics Understand Golden sets, data labeling	No experience necessary Fully Guided UI
Kiln Account	Optional	Required
Docs	Evals Guide	Eval Builder Guide

#### Guides * [Eval Builder Guide](/docs/evals-and-specs/specifications.md): build an eval, synthetic data, and align your judge in one interactive flow * [Evals 101](/docs/evals-and-specs/evaluations.md): build your first eval start to finish * [Many Small Evals Beat One Big Eval](https://kiln.tech/blog/you_need_many_small_evals_for_ai_products): Blog post which walks through how to setup eval tooling, and how to create an eval culture on your team. * [Evaluate RAG Accuracy](/docs/evals-and-specs/evaluate-rag-accuracy-q-and-a-evals.md): Kiln can generate custom Q\&A evals which test your RAG with knowledge from your documents * [Evaluate Tool Use](/docs/evals-and-specs/evaluate-appropriate-tool-use.md): ensure your agents are using the right tools, at the right time, with the right parameters with tool use evals * [Use Kiln Evals on External Agents](/docs/tools-and-mcp/connect-to-existing-agents.md): If you've built agents in another platform, you can still evaluate them in Kiln using our MCP connectors. --- # Agent Instructions This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com. ## Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter: ``` GET https://docs.kiln.tech/docs/evals-and-specs.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.