{ "checker": { "claims": [ { "claim": "agent-brief produces pasteable agent instructions and MCP settings", "command": "python3 -m cdp_setup_kit --kit-dir ../cdp-kit-quickstart agent-brief main", "evidence": "\",\n \"--browser-url=http://127.0.0.1:9333\"\n ]\n },\n \"playwright\": {\n \"command\": \"npx\",\n \"args\": [\n \"-y\",\n \"@playwright/mcp@0.0.83\",\n \"--cdp-endpoint\",\n \"http://127.0.0.1:9333\"\n ]\n }\n }\n}\n\nHealth check (does not enumerate tabs):\ncurl --fail --show-error --max-time 5 http://127.0.0.1:9333/json/version\n\nFor access over SSH, on the agent machine keep this tunnel running instead of connecting directly:\nssh -N -L 9333:127.0.0.1:9333 USER@HOST\nUse the browser machine's SSH host for HOST, and connect to http://127", "expected": "brief with the profile's HTTP endpoint and the MCP browserURL setting", "input": "recorded profile main on port 9333, no browser running", "kind": "claim", "outcome": "Real input produced the expected result: ", "returncode": 0, "source": "Pasteable agent rules/MCP settings", "source_checked": true, "source_file": "README.md", "verdict": "yes" }, { "claim": "promise", "command": "", "evidence": "Google Chrome is not installed in this guest (doctor: FAIL 'Chrome found'); installing or downloading a browser is not permitted for this run, and no shared CDP endpoint was supplied (nothing answers on 9222, 9333, 9334).", "expected": "", "input": "", "kind": "claim", "outcome": "Google Chrome is not installed in this guest (doctor: FAIL 'Chrome found'); installing or downloading a browser is not permitted for this run, and no shared CDP endpoint was supplied (nothing answers on 9222, 9333, 9334).", "source": "Google Chrome installed, Python 3.9 or newer, and Windows 10, Windows 11,", "source_checked": true, "source_file": "README.md", "verdict": "blocked" }, { "claim": "promise", "command": "", "evidence": "Requires a Chrome binary to run open main --headless; Chrome is absent and may not be installed by this run.", "expected": "", "input": "", "kind": "claim", "outcome": "Requires a Chrome binary to run open main --headless; Chrome is absent and may not be installed by this run.", "source": "For an SSH-only server, use [Chrome Headless]", "source_checked": true, "source_file": "README.md", "verdict": "blocked" } ], "cycle_checks": [ { "claim": "Scheduled or looping main behavior", "command": "", "evidence": "Entry points inspected (cdp_setup_kit/__main__.py, cli.py, README 'Commands'): the tool runs one command per invocation and installs no timer, cron, loop or webhook. README 'Optional: closing idle tabs' states 'This tool installs no timer.' Sign-in entries (startup enable) run the browser at graphical login only, not a product cycle and need Chrome, which is absent.", "expected": "identify the product trigger", "input": "source inspection", "kind": "cycle", "outcome": "Entry points inspected (cdp_setup_kit/__main__.py, cli.py, README 'Commands'): the tool runs one command per invocation and installs no timer, cron, loop or webhook. README 'Optional: closing idle tabs' states 'This tool installs no timer.' Sign-in entries (startup enable) run the browser at graphical login only, not a product cycle and need Chrome, which is absent.", "source": "repository entry points", "verdict": "yes" } ], "details": { "argv": [ "python3", "-m", "cdp_setup_kit", "--kit-dir", "../cdp-kit-quickstart", "agent-brief", "main" ], "kind": "cli", "needs_browser": false, "needs_credentials": false, "returncode": 0, "scope": "product operation", "stderr": "", "stdout": "PREVIEW: not live yet. After applying and verifying access, a Chrome browser window (dedicated profile main) will be available at http://127.0.0.1:9333; sign in to the accounts you want agents to use.\nUse it for the owner-authorized task for profile \"main\"; sign-ins must be authorized for that task.\nRules: do not close other windows/tabs you did not open; never copy or export profiles/cookies; changing provider data through it is a write.\nAttach to the existing browser context. Do not create a signed-out replacement context.\nWARNING: CDP has no authentication. Every program able to reach the address controls every tab, including signed-in sites.\nThe owner signs in manually; availability does not prove any account is signed in.\n\nMCP examples are pinned; approve these versions or pin to a version you trust before installing.\nMCP client configuration (HTTP browserURL form; clients discover the current WebSocket URL):\n{\n \"mcpServers\": {\n \"chrome-devtools\": {\n[excerpt truncated]", "working": false }, "evidence_strength": "partly_checked", "example_checks": [ { "claim": "documented offline test suite runs from the checkout", "command": "python3 -B -m unittest discover -s tests -t . -q", "deferred": false, "evidence": "----------------------------------------------------------------------\nRan 221 tests in 27.471s\n\nOK (skipped=3)", "expected": "all tests pass", "input": "python3 -B -m unittest discover -s tests -t . -q", "kind": "example", "outcome": "command completed successfully", "returncode": 0, "source": "README.md: Run the test suite from the checkout (one process at a time)", "verdict": "yes" }, { "claim": "documented agent brief for a recorded profile", "command": "python3 -m cdp_setup_kit --kit-dir ../cdp-kit-quickstart agent-brief main", "deferred": false, "evidence": "s tunnel running instead of connecting directly:\nssh -N -L 9333:127.0.0.1:9333 USER@HOST\nUse the browser machine's SSH host for HOST, and connect to http://127.0.0.1:9333 through the tunnel.\nFirst connection asks to trust the host key: verify it and answer yes once, or run ssh USER@HOST true interactively first. For scripts add -o StrictHostKeyChecking=accept-new: this trusts an unseen host automatically (first-connection impersonation risk), but refuses changed keys. If you use a key add -i KEY (and -o IdentitiesOnly=yes if needed), or use your Host alias from SSH config instead of USER@HOST.", "expected": "pasteable brief with MCP settings", "input": "profile main", "kind": "example", "outcome": "command completed successfully", "returncode": 0, "source": "README.md: agent-brief NAME", "verdict": "yes" } ], "status": "PASS" }, "deviations": [ "README 'Install Chrome on Linux' (apt/dnf or Chrome for Testing download) was not run: the task forbids downloading or installing a browser. Consequently 'init', 'open', 'connect' against a live window, 'stop', 'share' and 'startup' could not be verified; 'doctor' still reports Chrome not found.", "README 'init --yes --no-open' was replaced by 'add main --port 9333' to record the profile without a browser; add does not open Chrome.", "No shared CDP endpoint was supplied; probes of ports 9222, 9333 and 9334 got connection refused.", "Repo privacy test (tests/test_private_terms.py) flags IPv4 literals in the .coldpass evidence files; expected_text was changed to the MCP package version string printed by agent-brief, and no IP literal was kept in evidence files.", "The checker writes .coldpass/observed.json, which contains the IP literal and makes the repo's test suite fail if it is still present on the next replay; it was removed before replay as the task allows for my own generated output." ], "fault_owner": "prerequisite", "main_blocker": "Google Chrome is not installed in this guest and I may not install a browser; no shared CDP endpoint was supplied.", "operation": "Record a Chrome profile named main on port 9333 in a kit folder outside the checkout, then generate its agent brief (agent-brief main), which is the documented way to hand a signed-in Chrome window to an agent.", "operation_scope": "Linux guest, Ubuntu 24.04, Python 3.12.3 (README needs 3.9+). No Google Chrome installed and no shared CDP endpoint supplied. Chrome install/download was not permitted for this run, so open, connect, stop, share and sign-in steps were not exercised. Verified without a browser: offline test suite, list --no-check, add, agent-brief.", "outcome": "unverified", "plain_failure": "The tool's core job is to open a signed-in Chrome window and expose it to agents. That needs Chrome, which this test machine does not have, and no already-running browser was provided. Everything that does not need a browser works: the test suite passes, profiles can be recorded and listed, and the agent instructions are generated. The browser-dependent part could not be tested here.", "steps": [ "git init; git remote add origin https://github.com/TayHCode/cdp-setup-kit; git fetch --depth 1 origin 486bef579463a0d7ee2456b6473760601fd84e80; git reset --mixed FETCH_HEAD (succeeded; HEAD 486bef5)", "python3 -B -m cdp_setup_kit --kit-dir ../cdp-kit-quickstart list --no-check (rc 0, 'No profiles yet')", "python3 -B -m cdp_setup_kit --kit-dir ../cdp-kit-quickstart doctor --json (Chrome found: FAIL; platform, config PASS)", "python3 -B -m unittest discover -s tests -t . -q (221 tests, OK, 3 skipped)", "python3 -m cdp_setup_kit --kit-dir ../cdp-kit-quickstart add main --port 9333 (recorded profile; warned Chrome not found)", "python3 -m cdp_setup_kit --kit-dir ../cdp-kit-quickstart list --no-check (shows main 9333 not-checked)", "python3 -m cdp_setup_kit --kit-dir ../cdp-kit-quickstart agent-brief main (brief with MCP settings, rc 0)", "python3 -m cdp_setup_kit --kit-dir ../cdp-kit-quickstart connect main --json (rc 0)", "COLDPASS_WORKSPACE= python3 -I --validate --replay (valid: true, no problems)" ], "stuck_step": "open main (Chrome window / CDP endpoint); README 'Quickstart (Linux)' step 2 and 'Install Chrome on Linux'", "suggested_fix": "Run this check on a machine with Google Chrome (or supply a shared CDP endpoint and Chrome path), then run init/open/connect and a real agent attach to confirm the browser-dependent steps." }