Install and set up ends with Continue to prompts in the benchmark app. Everything on this page happens in that same browser tab: you choose what to test, confirm what the run will use, and watch both context arms answer your prompts.
If you would rather have an AI agent drive the run for you, see start a run from an AI agent.
The Choose what the benchmark tests step offers three options.
| Option | Use it when |
|---|---|
| Recommended test prompts | This is your first run, or you want a broad result. Ten connected-work prompts chosen to show what Teamwork Graph can reach that a siloed agent cannot. |
| Custom prompts | You want to test a real question your team asks. Write one prompt, or run a set you saved earlier. |
| Role-based | Not available yet. It is marked Coming soon. |
Whichever you choose, the same prompts run through both context arms.
Every recommended prompt needs details only you know: a topic, a Jira project, a person, a lookback window. Each row reads as the prompt itself, with those details filled in, so you can tell what a prompt asks without opening it. While Finding suggestions is on screen, the benchmark app is still proposing values from your connected sources.
topic or project key.An empty detail only matters on a prompt you selected. Continue to review stays unavailable until every selected prompt has what it needs, and the footer names the detail that is holding it up.
A prompt whose sources are not connected cannot be selected. It names the source it needs, and you fix that back in Connect data sources, not here.
Success: at least one prompt is selected, no selected prompt is missing a detail, and Continue to review becomes available.
Pick topics with substantial recent activity across your connected sources. A topic with little work, few decisions, and no documentation gives both context arms nothing to find, so the comparison says very little.
The Know what will run step is the last one before the benchmark spends model usage. It shows:
| Section | What to check |
|---|---|
| Setup summary | The agent, sources, and prompts you selected. |
| Models | The model that answers the prompts, and the model that scores them. |
| Estimated usage and time | Expected token usage and duration, plus any warnings. |
| Fair comparison | The guarantees that keep the two arms comparable, such as the same agent, prompts, and model on both sides. |
Select Confirm and start benchmark run. If no estimate could be produced, the same button reads Start benchmark run without an estimate.
Success: the benchmark app replaces the setup steps with the run view in the same tab.
Keep the browser tab open and leave the terminal running until the run finishes. The benchmark app reports one phase at a time.
| Phase | What is happening |
|---|---|
| Preparing the comparison | Final checks and source canaries, before any prompt runs. |
| Running benchmark prompts | Both context arms are answering the same prompt. |
| Running blind automated review | An LLM judge compares the answers without knowing which arm produced them. |
| Review the answers | Your turn. Choose the stronger answer for each prompt. |
| Building the final report | Usage, quality, and your review choices are combined. |
| Benchmark complete | The final report is ready in the same tab. |
If a run stops, the benchmark app shows Benchmark could not continue with the error. Start a new run rather than resuming a partial one, so both arms answer the same prompts with the same fresh state.
Next: when the phase reaches Review the answers, continue to review, report, and share.
The recommended set contains ten realistic tasks that depend on context about people, projects, documents, code, and recent work.
| Prompt | What it asks for |
|---|---|
| Return-to-work catch-up | What changed while you were away, focused on one topic, and what to do first. |
| Topic deep dive | The current state of a topic, its key people, dependencies, and where to start contributing. |
| Project dependency map | Upstream blockers, sibling dependencies, downstream consumers, and the critical path for a Jira project. |
| Code-change dependency risk map | Cross-repository upstream and downstream dependencies, production use, and change risk for a Jira project. |
| Leadership delivery briefing | A 14 day briefing for an org on what shipped and needs leadership attention. |
| Reliability and incident review | Recurring reliability risks for a platform, and where leadership should focus prevention. |
| Find subject-matter experts and owners | Who to consult for each workstream in a topic, and whether an overall owner exists. |
| Personal daily stand-up | One person's stand-up for a project, covering blockers and decisions that matter today. |
| Find current design documents and PRDs | The documents to start from for a topic, plus conflicts and freshness gaps. |
| Launch-readiness decision brief | A go, conditional go, or no-go recommendation for an Atlas project. |
Use it for a first run because ten prompts give a broader result than one. Every result depends on the work data connected to your site, so treat a single run as directional. Run the benchmark more than once before you draw a conclusion.
In commands and file names, the recommended set is the suite named cc.
Instead of driving the benchmark app yourself, you can ask a supported AI agent to run the benchmark. The agent uses the Teamwork Graph AI Context Benchmark skill, which is a set of instructions the Benchmark CLI installs for you. It completes any missing setup, starts both context arms, and opens a browser view so you can follow progress and review the answers.
This path does not use the benchmark app. Instead of the guided app, the agent runs the two arms as command line processes and opens the live view, which shows run progress and the blind review only. The setup checks, prompt suggestions, and usage estimate live in the app, so you give those up here in exchange for letting the agent drive.
Supported agents are Codex and Claude Code. Cursor Desktop can coordinate a run, using Codex or Claude Code to produce the answers.
If the skill is missing, install or repair it:
1 2benchmark skills install
Then ask your agent for one of these:
| Ask for | Example instruction |
|---|---|
| The recommended set | Use the Teamwork Graph AI Context Benchmark skill with suite cc. |
| One prompt from the set | Use the Teamwork Graph AI Context Benchmark skill with scenario swe_ooo_catchup and topic <your topic>. |
| Your own question | Use the Teamwork Graph AI Context Benchmark skill with prompt "<your question>". |
It is the same comparison either way, so prefer the benchmark app unless you specifically want the agent to drive.
Use one agent for a complete run. Answers from different agents are not comparable, because the agent is meant to be held fixed while Teamwork Graph is the only thing that changes.
If neither the benchmark app nor an agent can start a run, see the three-terminal commands in Troubleshooting.
Rate this page: