cb
cua-bench: run computer-use tasks and benchmark datasets on local and cloud sandboxes.
cua-bench: run computer-use tasks and benchmark datasets on local and cloud sandboxes.
cb <COMMAND> [OPTIONS]Run cb <command> --help for the build you have.
cb run#Run a task or dataset with an agent or the oracle, run one interactively, and follow runs. Reference.
| Command | Description |
|---|---|
cb run | Run a task or dataset, and manage runs. |
cb run task | Run one task variant. |
cb run dataset | Run every task and variant of a dataset in parallel. |
cb run list | List all runs with status. |
cb run info | Show detailed info about a run. |
cb run watch | Watch a run in real-time with live updates. |
cb run stop | Stop a run and release its sandboxes. |
cb run logs | View combined logs from a run or session. |
cb interact | Run a task's setup with its desktop visible, then evaluate. |
cb task#Inspect, list, scaffold and generate tasks. Reference.
| Command | Description |
|---|---|
cb task | Inspect and manage task environments. |
cb task info | Show detailed information about a task. |
cb task list | List tasks in a directory. |
cb task create | Scaffold a new task environment. |
cb task generate | Generate a task from a prompt using Claude. |
cb dataset#List registry datasets and build training data from runs. Reference.
| Command | Description |
|---|---|
cb dataset | Manage datasets and build from outputs. |
cb dataset list | List available datasets from registry. |
cb dataset build | Build a dataset from batch outputs. |
cb trace#View traces and agent trajectories. Reference.
| Command | Description |
|---|---|
cb trace | View and analyze trace datasets. |
cb trace view | View a single trace in browser. |
cb trace traj | View agent trajectories from a run in cua.ai/trajectory-viewer. |
Cloud pools and local sandboxes, sign-in, status and cleanup. Reference.
| Command | Description |
|---|---|
cb env | List or garbage-collect sandboxes and pools. |
cb env ls | List managed cloud pools and claims. |
cb env gc | Delete idle managed pools and stuck claims. |
cb login | Sign in for --on cloud (runs cua auth login). |
cb status | Show system status dashboard. |
cb prune | Clean up cua-bench run data (and 0.2.x image leftovers). |
cb agent#Scaffold custom agents. Reference.
| Command | Description |
|---|---|
cb agent | Scaffold custom agents. |
cb agent init | Create a new agent from template. |
cb agent build | Deprecated: cb run executes agents in-process. |
cb agent push | Deprecated: agent images are no longer used. |
The canonical images and platform configurations. Reference.
| Command | Description |
|---|---|
cb image | Show the canonical images (the local image store is deprecated). |
cb image list | List all images. |
cb image info | Show image details. |
cb image create | Deprecated: create an image from a platform. |
cb image delete | Deprecated: delete a stored image. |
cb image clone | Deprecated: clone a stored image. |
cb image shell | Deprecated: interactive shell into a stored image. |
cb platform | Show available platform configurations. |
cb platform list | List all available platforms. |
cb platform info | Show platform details. |
--help prints help for any command; --version prints the version.
| Code | Meaning |
|---|---|
0 | Success: every variant completed. |
1 | Failure: a variant failed or was cancelled, or the command could not run. |
2 | Usage error: an unknown command, flag or value. |
130 | Interrupted (Ctrl-C); running variants are cancelled. |