{
  "schemaVersion": "1",
  "revision": "22ce5d34dbcb5a78",
  "id": "factory-reasoning-and-video-questions",
  "slug": "reasoning-and-video-questions",
  "title": "Independent reasoning and video evidence — questions and tradeoffs",
  "summary": "Detailed questions and tradeoffs with concrete prompts, observable outcomes, and the limits of the example.",
  "category": "Verification",
  "tags": [
    "reasoning-and-video",
    "questions"
  ],
  "sources": [
    {
      "label": "Independent reasoning and video evidence — questions and tradeoffs",
      "url": "https://shiny-rosette-m6zy.here.now/dialogue.html"
    }
  ],
  "sourceUnits": [
    "08-oracle-video/dialogue.html#The premise",
    "08-oracle-video/dialogue.html#The economics",
    "08-oracle-video/dialogue.html#The video claim",
    "08-oracle-video/dialogue.html#The setup"
  ],
  "collection": "factory",
  "categoryId": "verification",
  "wordCount": 1159,
  "url": "/topics/factory-reasoning-and-video-questions/",
  "markdownUrl": "/markdown/factory-reasoning-and-video-questions.md?raw=1&v=22ce5d34dbcb5a78",
  "jsonUrl": "/api/v1/documents/factory-reasoning-and-video-questions.json",
  "headings": [
    {
      "id": "the-premise",
      "text": "The premise",
      "level": 2
    },
    {
      "id": "the-economics",
      "text": "The economics",
      "level": 2
    },
    {
      "id": "the-video-claim",
      "text": "The video claim",
      "level": 2
    },
    {
      "id": "the-setup",
      "text": "The setup",
      "level": 2
    }
  ],
  "markdown": "# Independent reasoning and video evidence — questions and tradeoffs\n\nDetailed questions and tradeoffs with concrete prompts, observable outcomes, and the limits of the example.\n\n## The premise\n\nIsn’t maximum intelligence just an API call away? Why all this browser theater?\n\nIt isn’t. ChatGPT’s strongest tier — the model picker’s “Latest” row, currently GPT-5.6 Pro with Extended thinking — is a subscription feature of the chat product, not the API. And Gemini’s video understanding is only reachable through the page’s own upload widget. The strongest text model and the only real video-watching path both sit behind logged-in chat sessions. Whoever holds a valid session cookie holds the key — and after one human login, the whole setup is this:\n\n``` text\nnpm install -g @steipete/oracle    # or: brew install steipete/tap/oracle (Node 22+)\noracle --engine browser -p \"HI\"    # first handshake: copies your cookies, sends \"HI\"\noracle status --hours 72           # the reply is recorded as a replayable session\n```\n\nHold on — cookies? How does an agent log into ChatGPT?\n\nIt doesn’t. You do, once, in your normal Chrome. Oracle copies those session cookies into a temporary automation profile and then drives that profile like a very fast reader — same model picker, same upload widget a human sees:\n\n``` text\nyou (human) ──sign in once──▶ Chrome profile (chatgpt.com cookies)\n                                     │  cookies copied per run\nagent ──▶ oracle CLI ──▶ automation Chrome profile ──▶ chatgpt.com ──▶ GPT-5.6 Pro\n                │\n                └─ packx bundle (up to ~900k tokens of code) pasted/attached\n```\n\nAn API integration authenticates as a program and gets program-shaped limits. A cookie-borrowing browser authenticates as *you* and gets everything your subscription gives you.\n\n## The economics\n\nA consult takes 20–60 minutes. Isn’t that unusable?\n\nUnusable if you spend it like a chat message. “What’s the next change?” is a banned prompt shape — it spends an hour of frontier thinking on minutes of work. The contract is: every consult demands the **maximum actionable batch** — ordered work packages with exact file/function/test targets and a falsifiable verification each. This is the prompt behind ~1,978 real sessions, verbatim:\n\n``` text\n[<three-to-five-word-slug>]\n\n## Project briefing\n<stack, framework, runtime, and repo rules — two or three sentences>\n\n## Goal\n<the full outcome you want, stated as the whole contract Oracle must plan\nagainst — never pre-shrunk to a first step>\n\n## Prior-State Ledger\n- prior_oracle_session: none\n- implemented_since_prior_oracle: none\n- verified_since_prior_oracle: none\n- failed_proof_or_blocker: none\n- remaining_goal_coverage: the full goal above\n\n## Current evidence\n<attempts, failing logs, screenshots, and known constraints — or \"none yet\">\n\n## Bundle map\nThe attached files contain <what you included and why>. Possibly missing:\n<what you could not include>.\n\n## Deliverable\nReturn the maximum actionable batch: an ordered set of work packages covering\neverything worth doing toward the goal. Every work package must carry exact\nfile/function/test targets, critical code snippets, and a falsifiable\nverification. Sequence the packages, name risks and invariants, and put\nanything you cannot target exactly in a separate short \"needs investigation\"\nlist.\n\nReturn your answer as text in this response only. Do not create, attach, export,\nor offer any downloadable file. Do not create local project artifacts yourself.\nThe local agent will write any needed files, plans, notes, goals, commits, or\nverification logs using local tools.\n\nPlan the maximum actionable batch: cover everything worth doing toward the\ngoal in ordered work packages with exact file/function/test targets and a\nfalsifiable verification each. Do not return a single next step or hold work\nback for a later round. An ambitious, specific answer is correct; only\nuntargeted vagueness is a defect.\n```\n\n``` text\noracle --engine browser -p \"$(cat consult-prompt.md)\" \\\n  --file \"src/**/*.ts,docs/**/*.md\" --slug \"<three-to-five-word-slug>\"\n```\n\nBe honest — do you actually use this, or is it a demo trick?\n\nThe local archive held about 1,978 session folders in the observed snapshot, and it grows daily. A sample of what they ask:\n\nThe recurring consult shapes are repeated hardening audits, independent multi-angle review followed by a judge, forensic debugging, redesign planning, and planning a media-analysis pipeline before executing it.\n\nThe recurring shapes: iteration audits where a fresh frontier reviewer re-reads the codebase every loop, multi-angle panels where a judge consult picks the winner, and pipeline-planning-the-pipeline. Every session leaves `output.log` and token receipts, replayable with `oracle session <id> --render`.\n\n## The video claim\n\nVideo? Text models can’t watch video.\n\nRight — and neither can an API text pipeline. Gemini watches footage, but only through the page’s upload widget, which is exactly what Oracle’s browser hands can operate. Before any expensive run, you prove the upload path with a cheap sentinel probe:\n\n``` text\n[video-upload-smoke-probe]\n\nThis is an attached-video readiness probe for a longer video analysis run.\n\nConfirm that you can inspect the attached video. Return exactly three short bullets:\n- whether video frames are visible;\n- whether audio is detectable;\n- one strictly observed visual detail, without guessing.\n\nEnd with this exact sentinel on its own line:\nEND_OF_VIDEO_ANALYSIS video-upload-smoke-probe probe\n```\n\n``` text\noracle --engine browser --model gemini-3-pro --browser-attachments always \\\n  -p \"$(cat probe-prompt.md)\" --file \"/absolute/path/to/probe-clip.mp4\" \\\n  --slug \"video-upload-smoke-probe\"\n```\n\nPass rule: the sentinel comes back byte-exact and the observed detail matches your footage. In the real Loop Craft run, Gemini heard “we are going to talk about Loopcraft…” and identified the presenter’s picture-in-picture at the 00:30 mark — that is watching, not transcript-summarizing. The result is public: a 93-minute workshop became the [Loop Craft wiki](https://silken-ferry-63mw.here.now/).\n\nBrowser automation is the most fragile thing in computing. Why build on it?\n\nIt is fragile — UI drift, model pickers, upload races. The discipline is what turns it into infrastructure: probes before spends, exact sentinels, receipts for every session. In the Loop Craft run, two probe failures cost seconds each; shard 004 failed twice while its siblings passed, which pointed at the input, and an exact re-encode fixed it in one try — 73 seconds to a completed analysis ending in the exact sentinel. Classify the failure, change one variable, re-run the cheap proof, keep the fix. The whole run is replayed beat by beat in the [session replay](https://shiny-rosette-m6zy.here.now/replay.html).\n\n## The setup\n\nDo I need your Mac mini and a four-slot browser pool?\n\nNo. The laptop version is the whole setup: sign into ChatGPT in Chrome, run the handshake, done. The Mac mini is the same trick made multi-tenant — an always-on machine runs `oracle serve` with the signed-in Chrome, every other machine points at it over a private network, and a four-slot dual-account pool runs four hour-long consults at once while nobody’s laptop stays open. Start local; scale only when consults start queuing. To get the local version working right now, hand this to your own agent:\n\n``` text\nFetch https://shiny-rosette-m6zy.here.now/agent.md?raw and follow it to set this up in my current project. Run the success check at the end and show me the result.\n```\n\nAnd if you want the actual skills that orchestrate all of this, the full skill family is [attached on the index](https://shiny-rosette-m6zy.here.now/index.html#attachments-the-oracle-skill-family) — download, install, adapt."
}
