Answer: Every suite needs an `evals/evals.config.ts` file created with `defineEvalConfig` from `@grok/agent-sdk/evals`, where `maxConcurrency` is required (from 1 to 200). Optional settings include `timeoutMs`, `judge`, `reporters`, and `maxPlaygroundRuns`. Status: Confirmed Entry: tool/cursor/agents-and-automation/eval-configuration Revision: 1 Digest: sha256:52518e527a9e753e (changes whenever the content changes) Timeline: Created: 2026-11-13T03:08:50Z Last changed: 2026-11-13T03:08:50Z Last verified: 2026-11-20T12:33:42Z Next check: 2026-11-21T12:33:42Z Check interval: Daily Expected change: No fixed schedule Data: Field | Value | Source | As of config file | evals/evals.config.ts | [1] | 2026-11-20 import | @grok/agent-sdk/evals | [1] | 2026-11-20 maxConcurrency | 20 | [1] | 2026-11-20 maxConcurrency range | 1 to 200 | [1] | 2026-11-20 judge model | gpt-5.4-mini | [1] | 2026-11-20 maxPlaygroundRuns default | 20 | [1] | 2026-11-20 Sources: [1] Anysphere. "cursor.com/docs/agent-sdk/reference/evals.md". https://cursor.com/docs/agent-sdk/reference/evals.md Role: primary. Accessed: 2026-11-20T12:33:42Z Quote: "Every suite needs `evals/evals.config.ts` with `maxConcurrency`" (Supports: config file) Quote: "import { defineEvalConfig } from "@grok/agent-sdk/evals";" (Supports: import) Quote: "maxConcurrency: 20," (Supports: maxConcurrency) Quote: "Required. Concurrent authored datapoints, from 1 to 200" (Supports: maxConcurrency range) Quote: "judge: { model: "gpt-5.4-mini" }," (Supports: judge model) Quote: "Server-side batches kept in playground history. Defaults to 20" (Supports: maxPlaygroundRuns default) Snapshot SHA-256: 30875c6a9ce5f98e680c15dd555ef5286ce3c5b5a73928c865de2b230687bfbe (captured 2026-11-13T03:08:50Z) Verification: Method: Automated extraction from [1] with deepseek-flash (JSON output, thinking disabled). Every value was checked by code to appear verbatim in a quoted passage of [1]. On this check the text of [1] was unchanged since 2026-11-13T03:08:50Z, so the values verified then were kept. Cross-check: not-available at 2026-11-20T12:33:42Z. No independent second source is configured for this entry Last successful check: 2026-11-20T12:33:42Z Last attempt: 2026-11-20T12:33:42Z Notes and limitations: Extracted automatically from a single official source (section "Eval configuration"). Related: https://latestn.com/tool/cursor/agents-and-automation/eval-judges How do I set up judges and a judge host for Cursor Evals? https://latestn.com/tool/cursor/agents-and-automation/evals-folder-location Where do Cursor Agent SDK evals live in a project? https://latestn.com/tool/cursor/agents-and-automation/explore-subagent-usage How do I make Cursor Agent use the Explore subagent for broad searches? https://latestn.com/tool/cursor/agents-and-automation/disable-skill-auto-invocation How do I disable automatic invocation of a Cursor skill? https://latestn.com/tool/cursor/agents-and-automation/enable-computer-use How do I enable computer use for a Cursor self-hosted worker? https://latestn.com/tool/cursor/agents-and-automation/enable-pr-routing-approval How do I enable PR Routing & Approval in Cursor? https://latestn.com/tool/ All entries in AI tools Change log: Time | Event | Change | Source 2026-11-13T03:08:50Z | added | Entry created | — Changes for this entry as a feed: https://latestn.com/tool/cursor/agents-and-automation/eval-configuration/latest Challenge this entry: Open challenges: None How: If a value here is wrong or out of date, send what is wrong and a link to evidence. Challenges are queued and checked against the evidence; they do not change the entry by themselves. If the entry changes as a result, the change log says so. Form: https://latestn.com/dispute/tool/cursor/agents-and-automation/eval-configuration POST: https://latestn.com/dispute/tool/cursor/agents-and-automation/eval-configuration with claim, evidence_url, and optionally field and contact (form-encoded or JSON) GET: https://latestn.com/dispute/tool/cursor/agents-and-automation/eval-configuration?claim={what is wrong}&evidence_url={link} How to cite: LatestN. (2026). How do I configure Cursor Evals with an evals.config.ts file? Revision 1, last verified 2026-11-20T12:33:42Z. https://latestn.com/tool/cursor/agents-and-automation/eval-configuration (accessed 2026-11-21T09:58:59Z). @misc{LatestN_tool_cursor_agents_and_automation_eval_configuration_r1, title = {How do I configure Cursor Evals with an evals.config.ts file?}, author = {{LatestN}}, year = {2026}, howpublished = {\url{https://latestn.com/tool/cursor/agents-and-automation/eval-configuration}}, note = {Revision 1; digest sha256:52518e527a9e753e; last verified 2026-11-20T12:33:42Z; accessed 2026-11-21T09:58:59Z} } Reuse: License: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/) Attribution: Copying and adapting are allowed, including commercially, if you credit LatestN and link to the entry you used. Each entry ends with a ready-made citation. URL: https://latestn.com/tool/cursor/agents-and-automation/eval-configuration