{
  "schemaVersion": "1",
  "revision": "22ce5d34dbcb5a78",
  "id": "codex-verified-variations",
  "slug": "verified-variations",
  "title": "Generate controlled, verified variations",
  "summary": "When code and design candidates are cheap, the mistake is not generating too many. The mistake is generating them randomly. Start by defining the candidates, keep the comparison controlled, run each option through the same constraints, and review the…",
  "category": "Planning",
  "tags": [
    "variations",
    "comparison",
    "proof"
  ],
  "sources": [
    {
      "label": "Codex workflows companion",
      "url": "https://lapis-fossil-vsbc.here.now/#verified-variations"
    },
    {
      "label": "Published workshop recording",
      "url": "https://www.dropbox.com/scl/fi/3m5p2dwkx0imuyu0dq5os/GMT20260626-155513_Recording_gallery_1920x1080.mp4?rlkey=60j5649let6pt4fdxpggozv1q&st=qhbuo513&dl=0"
    }
  ],
  "sourceUnits": [
    "src/content/final/chunk-04-generate-verified-variations.md",
    "src/content/final/chunk-04-generate-verified-variations.md#Generate Variations Before You Trust One Answer",
    "src/content/final/chunk-04-generate-verified-variations.md#Generate Variations Before You Trust One Answer/Start With A Candidate List",
    "src/content/final/chunk-04-generate-verified-variations.md#Generate Variations Before You Trust One Answer/Vary One Thing At A Time",
    "src/content/final/chunk-04-generate-verified-variations.md#Generate Variations Before You Trust One Answer/Use The Same Base Prompt",
    "src/content/final/chunk-04-generate-verified-variations.md#Generate Variations Before You Trust One Answer/Fan Out After The Matrix Is Clear",
    "src/content/final/chunk-04-generate-verified-variations.md#Generate Variations Before You Trust One Answer/Preserve The Review Surface",
    "src/content/final/chunk-04-generate-verified-variations.md#Generate Variations Before You Trust One Answer/Pick, Combine, Refine, Expand, Or Reject",
    "src/content/final/chunk-04-generate-verified-variations.md#Generate Variations Before You Trust One Answer/Turn The Winner Into A Real Build",
    "src/content/final/chunk-04-generate-verified-variations.md#Generate Variations Before You Trust One Answer/Copyable Prompt: Candidate Matrix",
    "src/content/final/chunk-04-generate-verified-variations.md#Generate Variations Before You Trust One Answer/Copyable Prompt: Refine The Winner",
    "src/lib/content/sections.ts",
    "src/lib/content/sections.ts#verified-variations",
    "src/lib/content/sections.ts#recordingSpans"
  ],
  "collection": "codex",
  "categoryId": "planning",
  "wordCount": 544,
  "url": "/topics/codex-verified-variations/",
  "markdownUrl": "/markdown/codex-verified-variations.md?raw=1&v=22ce5d34dbcb5a78",
  "jsonUrl": "/api/v1/documents/codex-verified-variations.json",
  "headings": [
    {
      "id": "start-with-a-candidate-list",
      "text": "Start With A Candidate List",
      "level": 2
    },
    {
      "id": "vary-one-thing-at-a-time",
      "text": "Vary One Thing At A Time",
      "level": 2
    },
    {
      "id": "use-the-same-base-prompt",
      "text": "Use The Same Base Prompt",
      "level": 2
    },
    {
      "id": "fan-out-after-the-matrix-is-clear",
      "text": "Fan Out After The Matrix Is Clear",
      "level": 2
    },
    {
      "id": "preserve-the-review-surface",
      "text": "Preserve The Review Surface",
      "level": 2
    },
    {
      "id": "pick-combine-refine-expand-or-reject",
      "text": "Pick, Combine, Refine, Expand, Or Reject",
      "level": 2
    },
    {
      "id": "turn-the-winner-into-a-real-build",
      "text": "Turn The Winner Into A Real Build",
      "level": 2
    },
    {
      "id": "copyable-prompt-candidate-matrix",
      "text": "Copyable Prompt: Candidate Matrix",
      "level": 2
    },
    {
      "id": "copyable-prompt-refine-the-winner",
      "text": "Copyable Prompt: Refine The Winner",
      "level": 2
    },
    {
      "id": "related-resources",
      "text": "Related resources",
      "level": 2
    }
  ],
  "markdown": "# Generate controlled, verified variations\n\nWhen code and design candidates are cheap, the mistake is not generating too many. **The mistake is generating them randomly.** Start by defining the candidates, keep the comparison controlled, run each option through the same constraints, and review the outputs on a surface that makes the decision obvious enough to defend later.\n\n## Start With A Candidate List\n\nAsk the agent to **generate the dataset first**: styles, strategies, prompts, layouts, implementation approaches, or test boundaries. Remove duplicates, rename vague entries, and make sure each candidate is **different for a reason**.\n\n> To do variations, like, you come up with the variations first.\n>\n> — John Lindquist\n\n## Vary One Thing At A Time\n\nIf every candidate changes layout, data model, tests, and copy, you are **no longer comparing candidates**. You are just admiring chaos with a folder structure.\n\n## Use The Same Base Prompt\n\nCandidate prompts should **differ only by the named variable**. Keep the base prompt, constraints, review criteria, and verification command identical.\n\n## Fan Out After The Matrix Is Clear\n\nParallelization is useful after you know what each lane is supposed to test. **Treat the candidate list like data**: each lane gets a candidate id, one variable setting, and the same proof requirement.\n\n> I definitely wouldn't rely on setting a long loop… Because then you get into, like, after a while, compaction and other things where you lose that context and things start to look alike.\n>\n> — John Lindquist\n\n## Preserve The Review Surface\n\nFor UI work, use screenshots or a [gallery](https://inspiration-board.pages.dev/variations/01-masonry-grid). For code, use diffs, test logs, and a short comparison table. **Save the artifacts before choosing** so the decision does not disappear into memory.\n\n## Pick, Combine, Refine, Expand, Or Reject\n\nThose are the valid outcomes. **Choose one explicitly.** If two candidates each have one strong idea, combine the named pieces. If the whole batch is wrong, reject the batch and update the matrix.\n\n## Turn The Winner Into A Real Build\n\nA generated mockup is **direction, not shipped UI**. Use the selected candidate as the reference for a verified implementation pass. The next prompt should say what won, why it won, what to preserve, what to fix, and what proof counts as done.\n\n## Copyable Prompt: Candidate Matrix\n\n```text\nCreate a variation matrix for a software UI concept.\n\nGoal:\nDesign a mobile app screen for browsing saved listings.\n\nVariable under test:\nVisual layout direction.\n\nGenerate 8 candidate directions.\n\nFor each candidate, include:\n- id\n- layout direction\n- design constraints\n- what should stay identical\n- what would make this candidate fail review\n\nDo not generate the UI yet.\nReturn the candidate matrix first.\n```\n\n## Copyable Prompt: Refine The Winner\n\n```text\nContinue from this saved variation decision.\n\nOutcome:\nRefine.\n\nPrimary candidate:\nv2.\n\nWhy:\nIt best preserves the constraints and passes the review criteria.\n\nPreserve:\n- the selected layout structure\n- the interaction model\n- the accepted visual hierarchy\n\nFix:\n- tighten spacing on mobile\n- improve empty-state copy\n- keep the same data model\n\nVerification:\nRun the same verification command from the matrix and save the result.\n\nDo not reopen the candidate search.\n```\n\n## Related resources\n\n- [Companion reference](https://lapis-fossil-vsbc.here.now/#verified-variations)\n- [Resource directory and portable download](/topics/codex-resources/)\n- [Published recording](https://www.dropbox.com/scl/fi/3m5p2dwkx0imuyu0dq5os/GMT20260626-155513_Recording_gallery_1920x1080.mp4?rlkey=60j5649let6pt4fdxpggozv1q&st=qhbuo513&dl=0)"
}
