Can a cheap model install and use TayHCode/readtrial?

Newest observation per platform and model. Revisions, runtimes and operations can differ; this is not a ranking. Earlier observations remain in the full history.

All questions / TayHCode/readtrial · Full history →

Works on some setups

README claims checked out on 4 recorded setups. Other recorded outcomes appear below; untested combinations remain unknown.

Answers apply to each recorded setup, revision and operation. Earlier observations remain in Run details.

Works with my model and platform?
PlatformHaikuLuna
Linuxpartly checkedyes
Windowspartly checkedyes
macOSyesyes

Linux / Haiku 5.5: partly checked · Oct 21, 2026 · 1662f23f8b0d · claude-code / 2.1.300 (Claude Code)
Recorded operation: python3 -m readtrial demo --out trial-results/probe-demo-checker-24f3944e8ea84b17966a3f2f8001cecb

Linux / Luna: yes · Oct 21, 2026 · d2e59cfaef5f · codex / codex-cli 0.163.0
Recorded operation: python3 -m readtrial demo --out trial-results/coldpass-replay-checker-9dfea472b8994052a024407ed43d9a7e

Windows / Haiku 5.5: partly checked · Oct 21, 2026 · 1662f23f8b0d · claude-code / 2.1.300 (Claude Code)
Recorded operation: 'C:\coldpass\python\python.exe' -m readtrial demo --out 'trial-results\probe-demo-checker-f3fad4ab84b2494694b235dae29d0db5'

Windows / Luna: yes · Oct 21, 2026 · d2e59cfaef5f · codex / codex-cli 0.163.0
Recorded operation: 'C:\coldpass\python\python.exe' -m readtrial demo --out trial-results/coldpass-probe-checker-27b1b6e130f4446caf776a4b6dcf5792

macOS / Haiku 5.5: yes · Oct 21, 2026 · 1662f23f8b0d · claude-code / 2.1.300 (Claude Code)
Recorded operation: python3 -m readtrial demo --out trial-results/probe-demo-checker-be05f64e4bd64997a6c880eb33f6d9d2

macOS / Luna: yes · Oct 21, 2026 · d2e59cfaef5f · codex / codex-cli 0.163.0
Recorded operation: /opt/homebrew/bin/python3 -m readtrial demo --out trial-results/replay-demo-checker-b4f461e2f4b943ce994ca8d0d21bb91a

Does what it says
1 of 1 claims checked out
  • The offline demo writes real sample reports and a diff: Real input produced the expected result: diff.json: 1 resolved finding

    Source: The demo finishes in under 20 seconds and writes real sample reports and a diff;

    Input: python3 -m readtrial demo --out trial-results/claim-demo

    Expected: prints a FAIL then PASS loop and reports diff.json with one resolved finding

    Command: python3 -m readtrial demo --out trial-results/claim-demo-checker-b39b79df7e874018bf168de50da2d8bb

    Observed: diff.json: 1 resolved finding; evidence in before/ and after/.

MCP
No
Local or hosted
local
Local: runs on your machine
Needs keys or browser
None seen
Maintained
Maintained
actively maintained: last commit 4 days ago; 7 commits and 3 merged PRs in 90 days; 0 open issues, 1 open PRs; no releases

Last commit Oct 21, 2026

Setup time
4 min 13 s
4 min 13 s to a working result
Issue
none found in confirmed setups
Examples
3 of 3 ran as expected, 1 couldn’t confirm (blocked)
  • Show the CLI help: command completed successfully

    Source: README.md Five-minute CLI quickstart (macOS)

    Input: --help

    Expected: usage text listing the subcommands

    Command: python3 -m readtrial --help

    Observed: ires --yes leftovers read-only discovery of exact journaled identities; removes nothing recover delete only exact journal-owned LXC instances; requires --yes rerun repeat saved targets/checks against latest HEAD and diff advisory findings demo offline fake agent/target FAIL then PASS loop (under 20 seconds) options: -h, --help show this help message and exit --version show program's version number and exit

  • Run the offline demo loop as documented: command completed successfully

    Source: README.md Five-minute CLI quickstart (macOS)

    Input: --out trial-results/example-demo

    Expected: Before FAIL, After PASS

    Command: python3 -m readtrial demo --out trial-results/example-demo-checker-753d67285b894a7d850a233ba7f96fd5

    Observed: OFFLINE DEMO: fake agent and fake target; no model, SSH, LXC or repository execution. Before: FAIL (README step exit 3; declared check failed) After: PASS (README step exit 0; declared check passed) diff.json: 1 resolved finding; evidence in before/ and after/.

  • Run the repository's offline unit suite as documented: command completed successfully

    Source: README.md Five-minute CLI quickstart (macOS)

    Input: discover -s tests -q

    Expected: OK with skipped tests on macOS

    Command: python3 -m unittest discover -s tests -q

    Observed: (valid for 24 hours). ssh:example: AGENT deviation: ignored added cd; selected the exact README command from the clone root: py -3 hello.py --name Check /private<guest-path> Recorded 0 requirements; Factory decides gate passage. readtrial: previous run is incompatible or did not fetch source successfully readtrial: --out must be a new folder beneath job.evidence_dir readtrial: model and source hash overrides must match the supplied job ---------------------------------------------------------------------- Ran 399 tests in 45.369s OK (skipped=11)

  • Real isolated trial against an LXC or SSH target: Missing prerequisite: no Linux controller with LXD, no LXC target, and no dedicated macOS trial account (doctor exit 1, missing account, group, owned home, sudo attestation and SSH session). README says full macOS-controller trials are unverified; not run.

    Source: README.md Isolated trials / Dedicated macOS test account

    Expected: documented command completes successfully

    Observed: Missing prerequisite: no Linux controller with LXD, no LXC target, and no dedicated macOS trial account (doctor exit 1, missing account, group, owned home, sudo attestation and SSH session). README says full macOS-controller trials are unverified; not run.

Evidence
README behavior checked
Agent interfaces
CLI
CLI

Observed interfaces were exercised by the checker. Documentation alone does not confirm compatibility.

Tested with
Claude Code / Haiku 5.5
  • macOS: Claude Code / Haiku 5.5 · agent 2.1.300 (Claude Code) · Checked operation passed · Oct 21, 2026 on 1662f23f8b0d

Each entry describes its recorded operation and source revision. Other agent clients were not tested.

Safety
Something to look at: writes outside the project folder by tests

Review signals across current setups: outside write.

Repository processes attempted these writes outside documented output/cache paths. 2 distinct locations. 2 findings. 60 attributed processes.

Full event, path and process lists for each observed setup:

Haiku 5.5 (claude-haiku-5-5)

The recorded outcome is unverified; see the linked evidence.

Operation: python3 -m readtrial demo --out trial-results/probe-demo-checker-24f3944e8ea84b17966a3f2f8001cecb

Recorded scope: product operation

Agent-reported scope: Run readtrial's documented offline demo (FAIL then PASS loop) and its unit test suite from the pinned checkout

run
TayHCode--readtrial-claude-haiku-5-5-1792635869163211471
date
Oct 21, 2026
source commit
1662f23f8b0d88c1fe3d028265786f3f3b141171
test version
readme-1924d8f529c6fc4500abb29916f5c9ac942027957e7b82d725d5610040cd3b4a
purpose
Initial run
platform
linux
reasoning / service tier
low / not recorded
recorded resources
4096 MiB RAM, 2 CPUs, 32768 MiB disk
model / version
claude-haiku-5-5 / claude-haiku-5-5
agent runtime / version
claude-code / 2.1.300 (Claude Code)
checker
PASS · cli
Recorded source
https://github.com/TayHCode/readtrial
Backend
hyperv
Tool transport
mcp-assigned-vm
Requested source pin (not an observed revision)
{"commit": "1662f23f8b0d88c1fe3d028265786f3f3b141171", "url": "https://github.com/TayHCode/readtrial"}
time to working
Not established by this run.
total attempt
564.5s
reported cost (usage complete)
$0.013975

run JSON · checker evidence · agent report + check · transcript excerpt · error excerpt unavailable

Checked operation passed.

Operation: python3 -m readtrial demo --out trial-results/probe-demo-checker-be05f64e4bd64997a6c880eb33f6d9d2

Recorded scope: product operation

Agent-reported scope: Run readtrial's documented macOS quickstart: CLI help, the offline demo FAIL-to-PASS loop, and the offline unit suite

run
TayHCode--readtrial-claude-haiku-5-5-1792636554300450414
date
Oct 21, 2026
source commit
1662f23f8b0d88c1fe3d028265786f3f3b141171
test version
readme-6f8cbfa597c6d59f7ece0e29599b48d61f780e82e853b6ab300c3a8265684642
purpose
Initial run
platform
macos
reasoning / service tier
low / not recorded
recorded resources
4096 MiB RAM, None CPUs, 32768 MiB disk
model / version
claude-haiku-5-5 / claude-haiku-5-5
agent runtime / version
claude-code / 2.1.300 (Claude Code)
checker
PASS · cli
Recorded source
https://github.com/TayHCode/readtrial
Backend
tart
Tool transport
mcp-assigned-vm
Requested source pin (not an observed revision)
{"commit": "1662f23f8b0d88c1fe3d028265786f3f3b141171", "url": "https://github.com/TayHCode/readtrial"}
time to checked operation
253.0s
total attempt
280.2s
reported cost (usage complete)
$0.015351

run JSON · checker evidence · agent report + check · transcript excerpt · error excerpt unavailable

The recorded outcome is unverified; see the linked evidence.

Operation: 'C:\coldpass\python\python.exe' -m readtrial demo --out 'trial-results\probe-demo-checker-f3fad4ab84b2494694b235dae29d0db5'

Recorded scope: product operation

Agent-reported scope: Run readtrial's documented offline demo (FAIL then PASS learning loop) and its documented unit-test suite on Windows, using the README's Windows PowerShell commands with the absolute Python path

run
TayHCode--readtrial-claude-haiku-5-5-1792637142222214564
date
Oct 21, 2026
source commit
1662f23f8b0d88c1fe3d028265786f3f3b141171
test version
readme-1924d8f529c6fc4500abb29916f5c9ac942027957e7b82d725d5610040cd3b4a
purpose
Initial run
platform
windows
reasoning / service tier
low / not recorded
recorded resources
4096 MiB RAM, 2 CPUs, 32768 MiB disk
model / version
claude-haiku-5-5 / claude-haiku-5-5
agent runtime / version
claude-code / 2.1.300 (Claude Code)
checker
PASS · cli
Recorded source
https://github.com/TayHCode/readtrial
Backend
hyperv
Tool transport
mcp-assigned-vm
Requested source pin (not an observed revision)
{"commit": "1662f23f8b0d88c1fe3d028265786f3f3b141171", "url": "https://github.com/TayHCode/readtrial"}
time to working
Not established by this run.
total attempt
266.3s
reported cost (usage complete)
$0.027823

run JSON · checker evidence · agent report + check · transcript excerpt · error excerpt unavailable

Luna (gpt-6-luna)

Checked operation passed.

Operation: /opt/homebrew/bin/python3 -m readtrial demo --out trial-results/replay-demo-checker-b4f461e2f4b943ce994ca8d0d21bb91a

Recorded scope: product operation

Agent-reported scope: Run documented offline readtrial demo

run
TayHCode--readtrial-gpt-6-luna-1792608385002180888
date
Oct 21, 2026
source commit
d2e59cfaef5ffc94989c7dc2635a30790109246f
test version
readme-d757857089451acda0b664735f6fb2f1c23adde544a896e78c2005d691c87d2a
purpose
Initial run
platform
macos
reasoning / service tier
low / standard
recorded resources
4096 MiB RAM, None CPUs, 32768 MiB disk
model / version
gpt-6-luna / gpt-6-luna
agent runtime / version
codex / codex-cli 0.163.0
checker
PASS · cli
Recorded source
https://github.com/TayHCode/readtrial
Backend
tart
Tool transport
mcp-assigned-vm
Requested source pin (not an observed revision)
{"commit": "d2e59cfaef5ffc94989c7dc2635a30790109246f", "url": "https://github.com/TayHCode/readtrial"}
time to checked operation
86.4s
total attempt
135.1s
reported cost
Not reported; not assumed to be zero.

run JSON · checker evidence · agent report + check · transcript excerpt · error excerpt unavailable

Checked operation passed.

Operation: 'C:\coldpass\python\python.exe' -m readtrial demo --out trial-results/coldpass-probe-checker-27b1b6e130f4446caf776a4b6dcf5792

Recorded scope: product operation

Agent-reported scope: Offline demo

run
TayHCode--readtrial-gpt-6-luna-1792611030995818388
date
Oct 21, 2026
source commit
d2e59cfaef5ffc94989c7dc2635a30790109246f
test version
readme-b1819f024d5ed935ff3dbeda74c496bb81329fead41d3600bf69c3eedba1e8de
purpose
Initial run
platform
windows
reasoning / service tier
low / standard
recorded resources
4096 MiB RAM, 2 CPUs, 32768 MiB disk
model / version
gpt-6-luna / gpt-6-luna
agent runtime / version
codex / codex-cli 0.163.0
checker
PASS · cli
Recorded source
https://github.com/TayHCode/readtrial
Backend
hyperv
Tool transport
mcp-assigned-vm
Requested source pin (not an observed revision)
{"commit": "d2e59cfaef5ffc94989c7dc2635a30790109246f", "url": "https://github.com/TayHCode/readtrial"}
time to checked operation
49.7s
total attempt
136.7s
reported cost
Not reported; not assumed to be zero.

run JSON · checker evidence · agent report + check · transcript excerpt · error excerpt unavailable

Checked operation passed.

Operation: python3 -m readtrial demo --out trial-results/coldpass-replay-checker-9dfea472b8994052a024407ed43d9a7e

Recorded scope: product operation

Agent-reported scope: Offline FAIL to PASS demo

run
TayHCode--readtrial-gpt-6-luna-1792613248077910869
date
Oct 21, 2026
source commit
d2e59cfaef5ffc94989c7dc2635a30790109246f
test version
readme-b1819f024d5ed935ff3dbeda74c496bb81329fead41d3600bf69c3eedba1e8de
purpose
Initial run
platform
linux
reasoning / service tier
low / standard
recorded resources
4096 MiB RAM, 2 CPUs, 32768 MiB disk
model / version
gpt-6-luna / gpt-6-luna
agent runtime / version
codex / codex-cli 0.163.0
checker
PASS · cli
Recorded source
https://github.com/TayHCode/readtrial
Backend
hyperv
Tool transport
mcp-assigned-vm
Requested source pin (not an observed revision)
{"commit": "d2e59cfaef5ffc94989c7dc2635a30790109246f", "url": "https://github.com/TayHCode/readtrial"}
time to checked operation
122.5s
total attempt
146.1s
reported cost
Not reported; not assumed to be zero.

run JSON · checker evidence · agent report + check · transcript excerpt · error excerpt unavailable

More Coldpass questions