Install and configure the Benchmark CLI

Quick setup walkthrough

Install

macOS and Linux

1
2
curl -fsSL https://teamwork-graph.atlassian.com/cli/benchmark/install | bash

For a custom install directory:

1
2
curl -fsSL https://teamwork-graph.atlassian.com/cli/benchmark/install | BENCHMARK_INSTALL_PREFIX="$HOME/bin" bash

Open a new terminal window and verify installation:

1
2
benchmark version --verbose

Windows

Run this command in PowerShell:

1
2
curl.exe -fsSL https://teamwork-graph.atlassian.com/cli/benchmark/install.ps1 -o "$env:TEMP\benchmark-install.ps1"; powershell.exe -NoProfile -ExecutionPolicy Bypass -File "$env:TEMP\benchmark-install.ps1"

Open a new PowerShell window, then verify the installation:

1
2
benchmark version --verbose

The installer places benchmark.exe in %LOCALAPPDATA%\Programs\benchmark\bin and adds that directory to your user PATH. Rerun the installer command to update.

Update an existing install

If you already installed the Benchmark CLI:

1
2
benchmark update

Configure pairing

Choose an agent (codex or claude) and use only that agent for all --agent flags in later commands. The examples below use codex.

Confirm pairing readiness

1
2
benchmark pair status --agent codex

If the command reports pair ready: no:

1
2
benchmark pair setup --agent codex

The first time you run setup, you complete three tasks:

1. Sign in to the selected agent.
2. Select and save prompt inputs.
3. Choose and authenticate the connectors you want.

Reconfigure later

To reconfigure prompt inputs:

1
2
benchmark pair setup --agent codex --reconfigure-inputs

To reconfigure connectors:

1
2
benchmark pair setup --agent codex --reconfigure-connectors

Next step

Run a benchmark with the agent skill or the CLI.