Status: implementation-ready process spec
Owner: local coding agent
Reference run: workshop-followup/
Primary output: verified follow-up materials from one or more source videos
This process turns a raw workshop recording, tutorial, app walkthrough, bug reproduction, or short screen recording into a reviewable artifact project. It is built from the completed workshop-followup/ run and the Oracle review session video-pipeline-repeatable-process.
The pipeline has two main paths:
- Long workshop path: segment long recordings, remove verified breaks, carry forward break chat, analyze chunks, verify omissions, extract keyframes, reconcile, and assemble a teammate packet.
- Short recording path: skip segmentation unless needed, analyze the clip directly, optionally extract keyframes, verify outputs, and produce a compact follow-up note, bug packet, design brief, or requirements document.
The core rule is evidence preservation. Keep the original media immutable, preserve original timestamps when a source timeline exists, save model prompts/results/logs, and keep verification receipts next to every generated claim.
For this browser-based workflow, Gemini video analysis uses
Oracle browser mode and must clean up after itself. After a chunk's analysis is saved
and verified, close the Gemini tab opened for that chunk. Leave the browser/profile
alive for reuse, but do not leave accumulated gemini.google.com/app tabs on the
remote Mac mini.
Project Structure
Use one run folder per video or video set:
runs/
YYYY-MM-DD-slug/
README.md
run-config.json
inputs/
source-video.mp4
source-video.sha256
transcript.vtt
transcript.md
chat.txt
chat.md
screenshots/
clips/
receipts/
ffprobe.source.json
media-info.md
source-file-list.txt
tool-versions.txt
git-status.before.txt
git-status.after.txt
analysis/
timeline-initial.json
silencedetect.log
boundary-candidates.md
segmentation-notes.md
source-timeline.md
segments/
segment-manifest.v1.json
segment-manifest.v1.md
segment-manifest.v2.json
segment-manifest.v2.md
break-chat/
morning-break.chat.md
lunch-break.chat.md
other-break.chat.md
chunks/
video-manifest.json
01/
chunk.mp4
chunk.ffprobe.json
transcript.md
chat.md
carry-forward-chat.md
next-chunk-preview.md
gemini-prompt.md
expected-sentinel.txt
gemini-run.log
gemini-result.json
gemini-analysis.md
gemini-analysis.extracted.json
gemini-omissions-prompt.md
gemini-omissions-run.log
gemini-omissions-result.json
gemini-omissions.md
final-reconciled.md
final-reconciled.json
keyframes/
candidates.json
extracted/
strips/
contact-sheet.jpg
review.md
verification/
expected-items.json
extracted-items.json
coverage-report.md
hallucination-report.md
timestamp-report.md
qa-report.md
visual-claim-report.md
oracle/
planning.md
review.md
sessions/
final/
README.md
teammate-followup-guide.md
chapter-index.md
resources-and-links.md
qa-index.md
exercises.md
keyframes-manifest.md
keyframes-manifest.json
instructor-review-checklist.md
publication/
public-draft/
private-redactions.md
publish-checklist.md
The current reference artifacts live in workshop-followup/. New runs should use runs/<date>-<slug>/ so the reference run remains untouched.
Run Config
Create run-config.json before processing:
{
"run_id": "example-workshop",
"title": "Example Workshop",
"mode": "long_workshop",
"source": {
"video": "inputs/source-video.mp4",
"transcript": "inputs/transcript.vtt",
"chat": "inputs/chat.txt",
"screenshots": "inputs/screenshots",
"clips": "inputs/clips"
},
"policy": {
"preserve_original_timestamps": true,
"chunk_target_minutes": "semantic-under-30",
"chunk_max_minutes": 30,
"dead_space_removal": "only verified long silence plus transcript/chat break evidence",
"default_video_overlap_seconds": 0,
"semantic_boundary_overlap_seconds": 5,
"qa_boundary_overlap_seconds": 15,
"chat_carry_forward": true,
"dedupe_final_materials": true,
"large_binary_git_policy": "local-only-unless-explicitly-approved"
},
"outputs": {
"student_packet": true,
"keyframes": true,
"contact_sheets": true,
"verification_reports": true
}
}
Mode Matrix
| Mode | Typical input | Segmentation | Transcript/chat | Keyframes | Gemini video pass | Output |
|---|---|---|---|---|---|---|
| Long workshop | 2-8 hour Zoom/workshop recording | Required | Required if available | Required | Required | Full teammate packet |
| Medium tutorial | 20-60 minute lesson | Optional semantic chunks | Transcript required, chat optional | Recommended | Required when deriving facts from video | Guide, chapter index, resources |
| Short bug reproduction | 30 sec-8 min screen recording | Skip | Optional | Required | Required for observed behavior | Bug report, repro steps, implementation brief |
| Quick design feedback | 1-12 min screen and voice | Skip | Recommended if voiceover matters | Required | Required for visual/audio claims | Design-change brief, QA checklist |
| Raw app walkthrough | 5-30 min app demo | Skip under 12 min; segment over 20 min | Recommended | Required | Required for requirements/QA extraction | Requirements doc, acceptance criteria |
"Optional" applies only to extra Oracle planning/review over text artifacts. It does not mean the video-watching step can be skipped when the deliverable depends on what is visible or audible in the recording.
Decision Tree
Segment when any of these are true:
- Video duration is over 30 minutes.
- There are real breaks, lunch, pre-roll, or dead air.
- Q&A spans topic transitions.
- Chat must be aligned to the video.
- The target output is a course packet, teammate packet, chapter index, or publication bundle.
Skip segmentation when all of these are true:
- Video duration is 12 minutes or less.
- There is no long dead air or break.
- Chat is absent, irrelevant, or small enough to include directly.
- One model pass can analyze the whole video reliably.
- The target output is a short note, bug report, design feedback memo, or compact implementation plan.
Use a medium path when the video is 12-45 minutes, has no real breaks, and has 2-4 obvious sections. In that case, keep one physical video and create timestamped sections unless model upload/runtime gets awkward.
Remove a video span only when long silence or inactive-screen evidence, transcript evidence, and chat evidence agree that the span is a break or dead space. Never discard chat from a removed span. Save it in break-chat/ and carry it forward to the next spoken chunk when it contains a question, answer, link, or context used later.
Extract keyframes when screen share, terminal commands, browser pages, demos, design feedback, or visual claims appear. Skip keyframes only for pure audio/talking-head content where visual evidence cannot change the output.
Run an omissions pass when coverage is incomplete, missing URLs exist, missing chat questions exist, keyframe candidates are thin, machine JSON is missing/unparseable, timestamps are out of range, or hallucination checks find invented tools/links/commands.
Project Setup
cd /path/to/workshop-video-followup-pipeline
RUN_ID="$(date +%Y-%m-%d)-example-workshop"
RUN_DIR="runs/$RUN_ID"
mkdir -p "$RUN_DIR"/{inputs,receipts,analysis,segments,break-chat,chunks,oracle/sessions,final,publication}
git status --short > "$RUN_DIR/receipts/git-status.before.txt"
Record tool versions:
{
echo "# Tool Versions"
echo
echo "date: $(date -u +%Y-%m-%dT%H:%M:%SZ)"
echo
echo "## ffmpeg"
ffmpeg -version | head -n 3 || true
echo
echo "## ffprobe"
ffprobe -version | head -n 3 || true
echo
echo "## git"
git --version || true
echo
echo "## jq"
jq --version || true
echo
echo "## python"
python3 --version || true
} > "$RUN_DIR/receipts/tool-versions.txt"
Copy inputs. Do not mutate originals:
cp "/absolute/path/to/source-video.mp4" "$RUN_DIR/inputs/source-video.mp4"
# Optional
cp "/absolute/path/to/transcript.vtt" "$RUN_DIR/inputs/transcript.vtt"
cp "/absolute/path/to/chat.txt" "$RUN_DIR/inputs/chat.txt"
Hash source assets and save file list:
shasum -a 256 "$RUN_DIR/inputs/source-video.mp4" > "$RUN_DIR/inputs/source-video.sha256"
find "$RUN_DIR/inputs" -maxdepth 2 -type f -print0 \
| xargs -0 shasum -a 256 \
> "$RUN_DIR/receipts/source-file-list.txt"
Probe the source video:
ffprobe -hide_banner -show_format -show_streams -of json \
"$RUN_DIR/inputs/source-video.mp4" \
> "$RUN_DIR/receipts/ffprobe.source.json"
Create a human-readable media receipt:
{
echo "# Media Info"
echo
echo "source: $RUN_DIR/inputs/source-video.mp4"
echo "sha256: $(cut -d ' ' -f1 "$RUN_DIR/inputs/source-video.sha256")"
echo
jq -r '.format | "- duration: \(.duration)\n- size: \(.size)\n- bit_rate: \(.bit_rate)"' \
"$RUN_DIR/receipts/ffprobe.source.json"
echo
echo "## Streams"
jq -r '.streams[] | "- index=\(.index) type=\(.codec_type) codec=\(.codec_name) duration=\(.duration // "unknown") width=\(.width // "-") height=\(.height // "-")"' \
"$RUN_DIR/receipts/ffprobe.source.json"
} > "$RUN_DIR/receipts/media-info.md"
Commit the initial evidence:
git add "$RUN_DIR/run-config.json" "$RUN_DIR/inputs" "$RUN_DIR/receipts"
git commit -m "Capture source evidence for $RUN_ID"
Long Recording Workflow
- Detect silence:
ffmpeg -hide_banner -i "$RUN_DIR/inputs/source-video.mp4" \
-af silencedetect=noise=-35dB:d=5 \
-f null - 2> "$RUN_DIR/analysis/silencedetect-35db-5s.log"
-
Draft
analysis/boundary-candidates.mdfrom silence, transcript, and chat evidence. -
Create
segments/segment-manifest.v1.jsonand.md. Preserve original timestamps. Use semantic chunks under 30 minutes. Remove break spans only when evidence supports removal. -
Run
$oracle-packxbefore finalizing segmentation when the run is long, public, or ambiguous. Bundle only text artifacts:
mkdir -p ~/.oracle/bundles
find "$RUN_DIR" -type f \( -name '*.md' -o -name '*.json' -o -name '*.log' -o -name '*.sh' \) \
| xargs packx --preview --no-interactive
find "$RUN_DIR" -type f \( -name '*.md' -o -name '*.json' -o -name '*.log' -o -name '*.sh' \) \
| xargs packx --limit 900k -f markdown --no-interactive --stdout --strip-comments --minify \
> ~/.oracle/bundles/video-followup-segmentation-review.txt
test -s ~/.oracle/bundles/video-followup-segmentation-review.txt
Ask Oracle in browser mode only. If using the skill, invoke $oracle-packx; if using the CLI fallback, keep browser mode explicit:
oracle --engine browser \
--model gpt-5.5-pro \
--browser-thinking-time extended \
--slug video-followup-segmentation-review \
--file ~/.oracle/bundles/video-followup-segmentation-review.txt \
-p "$(cat "$RUN_DIR/oracle/planning.md")"
Save the Oracle conversation URL, local bundle path, prompt, and ~/.oracle/sessions/<slug>/output.log reference in oracle/sessions/<slug>.md.
-
Revise into
segments/segment-manifest.v2.jsonand.md. -
Cut chunks from the original source:
mkdir -p "$RUN_DIR/chunks/01"
ffmpeg -hide_banner -ss 00:05:44 -to 00:30:30 \
-i "$RUN_DIR/inputs/source-video.mp4" \
-map 0 -c copy \
"$RUN_DIR/chunks/01/chunk.mp4"
ffprobe -hide_banner -show_format -show_streams -of json \
"$RUN_DIR/chunks/01/chunk.mp4" \
> "$RUN_DIR/chunks/01/chunk.ffprobe.json"
Use -c copy for fast archival cuts when keyframe accuracy is acceptable. Use re-encode for frame-exact cuts:
ffmpeg -hide_banner -ss 00:05:44 -to 00:30:30 \
-i "$RUN_DIR/inputs/source-video.mp4" \
-map 0 -c:v libx264 -crf 18 -preset veryfast -c:a aac \
"$RUN_DIR/chunks/01/chunk.frame-exact.mp4"
-
Slice transcript and chat into
chunks/<nn>/transcript.md,chat.md, andcarry-forward-chat.md. -
Create
chunks/video-manifest.jsonwith chunk id, original range, file path, transcript path, chat path, carry-forward path, ffprobe path, and verification status.
Short Recording Workflow
Use this path for quick screen captures, short bug reproductions, design notes, and small app walkthroughs.
RUN_ID="$(date +%Y-%m-%d)-quick-clip"
RUN_DIR="runs/$RUN_ID"
mkdir -p "$RUN_DIR"/{inputs,receipts,chunks/01,final}
cp "/absolute/path/to/clip.mov" "$RUN_DIR/inputs/source-video.mov"
shasum -a 256 "$RUN_DIR/inputs/source-video.mov" > "$RUN_DIR/inputs/source-video.sha256"
ffprobe -hide_banner -show_format -show_streams -of json \
"$RUN_DIR/inputs/source-video.mov" \
> "$RUN_DIR/receipts/ffprobe.source.json"
For short clips, do not cut video by default. Symlink or copy it as the single chunk:
ln -s ../../inputs/source-video.mov "$RUN_DIR/chunks/01/chunk.mov"
Create chunks/01/gemini-prompt.md using the short clip prompt in this doc, attach the clip directly to Gemini/video model, and save:
chunks/01/expected-sentinel.txt
chunks/01/gemini-run.log
chunks/01/gemini-result.json
chunks/01/gemini-analysis.md
chunks/01/final-reconciled.md
final/README.md
Final output by short mode:
- Bug reproduction:
final/bug-report.md,final/repro-steps.md,final/acceptance-checks.md - Design feedback:
final/design-brief.md,final/visual-acceptance-criteria.md - App walkthrough:
final/requirements.md,final/qa-checklist.md - Tiny tutorial:
final/summary.md,final/resources-and-links.md
Run the same malformed URL and hallucination checks even for short clips.
For YouTube research batches, add these source-selection rules before downloading:
- Search broadly, but select by actual YouTube metadata (
upload_date), not title text. - Enforce user cutoffs exactly. Example: after a chosen cutoff means
upload_date >= CUTOFF_YYYYMMDD. - Exclude topic collisions, coupon/affiliate uploads, auto-generated music/topic uploads, and unrelated videos.
- Save selected videos in
queue.jsonwithid,title,uploader,upload_date,duration, andurl. - Use Chrome cookies with
yt-dlpwhen YouTube challenges require it. - Space Gemini upload starts by about five minutes for batch runs only after the first attached-video probe passes and no unresolved run is pending, unless the user asks for a different cadence.
For each batch item, use a topic-specific prompt. Do not copy old prompt text from a different topic without replacing the product/domain language.
Gemini Readiness And Failure Recovery
Before a large batch, run one tiny attached-video Gemini probe. Do not rely on a text-only Gemini probe as the sole readiness check because text-only runs may use a different HTTP/cookie path than attached-video DOM upload.
Required preflight receipts:
- configured browser mode and Gemini provider routing;
- visible signed-in Gemini UI, or a completed attached-video probe;
- prompt path and exact expected sentinel;
- run/session metadata;
- attachment upload completion;
- final response or recovered visible response with sentinel;
- completed tab cleanup.
On any send not accepted, prompt-empty, consent modal, sign-in, quota, rate-limit,
or upload warning, stop new batch starts. Inspect the active Gemini tab, classify the
state, and retry only the affected chunk if no valid sentinel response exists.
Write the exact expected sentinel into chunks/<nn>/expected-sentinel.txt before each
Gemini run. Verification and recovery should compare against that file, not infer the
sentinel shape from memory.
Gemini Browser Cleanup
When using Oracle CLI fallback with --browser-keep-browser, cleanup is mandatory:
- Wait for the run to finish.
- Save every needed extraction artifact from the Gemini response:
gemini-result.json,gemini-analysis.md,gemini-analysis.extracted.jsonwhen expected, machine JSON, and any recovery note if the response was recovered by tab inspection. - Verify the analysis is non-empty and contains the expected
END_OF_VIDEO_ANALYSIS ...sentinel. - Close only the completed and fully extracted Gemini tab for that run.
- Do not close tabs for active uploads, still-generating sessions, unresolved wrapper errors, or completed-looking tabs whose visible response has not been extracted.
- Do not kill Chrome; Oracle needs the signed-in profile for future runs.
For scripted runs, implement cleanup as a post-extraction step, not as a generic
finally block. A safe script order is: save wrapper result, inspect/recover tab output
if needed, write extracted JSON, verify the exact expected sentinel, then close the
specific Gemini tab target. If any extraction or sentinel check fails, leave the tab
open and record the Chrome port/target for recovery.
If exact target close tooling is available, use Chrome DevTools Protocol to close the
specific gemini.google.com/app target created for the run. If not, list tabs first,
identify completed or empty Gemini tabs, and close only those. Avoid broad "close all
Gemini" actions while a batch is running.
When classifying stale tabs:
- Empty generic Gemini tabs from failed diagnostics may be closed after inspection.
- Active upload/generation tabs must stay open.
- Tabs with conversation state or auto-generated titles must be checked for saved output and the expected sentinel before closing.
- Never use broad "close all Gemini tabs" while a batch is active.
Prompt Templates
Gemini Chunk Analysis
You are analyzing one source-preserving video chunk for a follow-up packet.
Run metadata:
- run_key: {{run_key}}
- chunk_id: {{chunk_id}}
- original_recording_range: {{start_time}} -> {{end_time}}
- chunk_video: {{chunk_video_path}}
- transcript: included below
- chat: included below
- carry_forward_chat: included below
- next_chunk_preview: included below
Hard rules:
1. Preserve original recording timestamps.
2. Separate transcript evidence, chat evidence, visual evidence, and inference.
3. Do not invent tools, commands, URLs, files, speakers, or UI labels.
4. Include unanswered and deferred questions.
5. Flag every policy-sensitive area, especially browser automation, cookies, quota/rate limits, private accounts, and publishing.
6. Return both Markdown and fenced JSON.
7. End with: END_OF_VIDEO_ANALYSIS {{run_key}} {{chunk_id}}
Return:
# Chunk Analysis: {{chunk_id}}
## 1. Overview
## 2. Dense Timeline
## 3. Concept Inventory
## 4. Demo / Screen Activity
## 5. Questions And Answers
## 6. Links / Tools / Commands / References
## 7. Keyframes To Capture
## 8. teammate Exercises
## 9. Uncertainties / Needs Review
## 10. Machine JSON
Omissions Pass
You are auditing a prior video analysis for omissions.
Inputs:
- chunk_id: {{chunk_id}}
- original_recording_range: {{start_time}} -> {{end_time}}
- coverage_report: {{coverage_report}}
- expected_items: {{expected_items_json}}
- prior_analysis: {{prior_analysis}}
Find only omissions and corrections. Do not repeat complete items.
Required focus:
1. Missing URLs exactly as they appeared.
2. Missing chat questions, including unanswered/deferred questions.
3. Missing demo steps.
4. Missing keyframe candidates.
5. Unsupported visual claims.
6. Hallucinated tools, commands, links, or files.
7. Parseable fenced JSON.
Return:
# Omissions And Corrections: {{chunk_id}}
## Additions
## Corrections
## Remove Or Downgrade
## Remaining Human Review
## Machine JSON
Local Reconciliation
Reconcile one analyzed chunk into an evidence-grounded final chunk record.
Inputs:
- segment manifest entry
- transcript slice
- chat slice
- carry-forward chat
- main analysis
- omissions analysis
- verification reports
- keyframe review
Rules:
1. Preserve original timestamps.
2. Remove malformed URLs.
3. Do not include any URL/tool/command unless supported by transcript, chat, carry-forward chat, local path, or keyframe review.
4. Do not claim a visual is visible unless keyframe review confirms it.
5. Preserve unanswered/deferred questions.
6. Preserve editorial warnings.
7. Deduplicate overlap by normalized timestamp + item type + text hash.
Return Markdown and JSON with:
- status: PASS | PASS_WITH_WARNINGS | FAIL
- counts
- timeline summary
- concepts
- Q&A
- links/tools/commands
- demos
- keyframes
- warnings
- teammate-material candidates
Short Clip Analysis
You are analyzing a short screen recording or app walkthrough.
Source:
- run_key: {{run_key}}
- recording_type: short_clip | bug_reproduction | design_feedback | app_walkthrough
- original_recording_range: 00:00:00 -> {{duration}}
- source_video_sha256: {{source_video_sha256}}
Hard rules:
1. Use timestamps relative to the clip unless an original recording timeline is provided.
2. Do not invent commands, files, UI labels, URLs, or implementation details.
3. Separate observed behavior from inferred intent.
4. Include timestamped screenshot/keyframe candidates for visual claims.
5. For a bug reproduction, produce repro steps and expected vs actual behavior.
6. For design feedback, produce requested changes and visual acceptance criteria.
7. For an app walkthrough, produce requirements and QA checks.
8. Include uncertainties and manual review points.
Return:
# Short Video Analysis: {{run_key}}
## 1. Summary
## 2. Observed Timeline
## 3. User Intent / Requirements
## 4. Reproduction Steps Or Walkthrough Steps
## 5. Expected Vs Actual Behavior
## 6. Implementation Notes
## 7. QA / Acceptance Criteria
## 8. Keyframes To Extract
## 9. Risks / Unknowns
## 10. Machine JSON
Final Packet Generation
Assemble a teammate follow-up packet from verified chunk records.
Inputs:
- segments/segment-manifest.v2.md
- chunks/*/final-reconciled.md
- chunks/*/final-reconciled.json
- chunks/*/verification/*.md
- final/keyframes-manifest.json if present
- resources extracted from chat/transcript
Rules:
1. Use original recording timestamps.
2. Do not include unverified visual claims.
3. Do not include malformed URLs.
4. Do not present experimental tools as official recommendations unless approved.
5. Keep policy-sensitive automation/cookie/quota/rate-limit sections as editorial notes.
6. Distinguish publication-ready files from reference drafts.
7. Deduplicate overlap and carry-forward repeated material.
Create:
- final/README.md
- final/teammate-followup-guide.md
- final/chapter-index.md
- final/resources-and-links.md
- final/qa-index.md
- final/exercises.md
- final/keyframes-manifest.md
- final/keyframes-manifest.json
- final/instructor-review-checklist.md
Oracle Review
[{{slug}}]
Project briefing:
{{project_briefing}}
Goal:
{{goal}}
Prior-State Ledger:
- prior_oracle_session: {{prior_oracle_session_or_none}}
- last_oracle_recommendation: {{summary_or_none}}
- implemented_since_prior_oracle: {{files_or_none}}
- verified_since_prior_oracle: {{commands_or_none}}
- failed_proof_or_blocker: {{receipt_or_none}}
- narrowing_decision: {{one_slice}}
- files_functions_now_in_scope: {{paths}}
- files_functions_out_of_scope: {{paths}}
- next_falsifiable_verification: {{command_or_receipt}}
- forward_progress_index: {{score_and_arithmetic}}
Deliverable:
Evaluate segmentation, chat carry-forward, analysis prompts, verification gates, final packet readiness, privacy/security risks, and the one highest-leverage next local action.
Return your answer as text in this response only. Do not create, attach, export, or offer any downloadable file. Do not create local project artifacts yourself. The local agent will write any needed files, plans, notes, goals, commits, or verification logs using local tools.
Verification Gates
Run malformed URL checks on every final packet:
rg -n 'https://www\.\.\.|https://www\s|/"|\| .*: \||Context:' "$RUN_DIR/final" || true
Extract exact URLs from chat/transcript and compare against final resources:
rg -o 'https?://[^[:space:])>"'"'"']+' "$RUN_DIR/chunks" "$RUN_DIR/break-chat" \
| sed 's/[,:;.!"]$//' \
| sort -u \
> "$RUN_DIR/verification.expected-urls.txt"
rg -o 'https?://[^[:space:])>"'"'"']+' "$RUN_DIR/final/resources-and-links.md" \
| sed 's/[,:;.!"]$//' \
| sort -u \
> "$RUN_DIR/verification.final-urls.txt"
comm -23 "$RUN_DIR/verification.expected-urls.txt" "$RUN_DIR/verification.final-urls.txt" \
> "$RUN_DIR/verification.missing-urls.txt"
Validate timestamps stay within range, except carry-forward chat:
python3 scripts/validate-timestamps.py "$RUN_DIR" \
> "$RUN_DIR/receipts/timestamp-validation.log"
If the script does not exist yet, perform a manual timestamp pass and save it as chunks/<nn>/verification/timestamp-report.md.
Check machine JSON:
find "$RUN_DIR/chunks" -name '*.json' -print0 | xargs -0 -n1 jq empty
Required chunk gate files:
chunks/<nn>/verification/coverage-report.md
chunks/<nn>/verification/hallucination-report.md
chunks/<nn>/verification/timestamp-report.md
chunks/<nn>/verification/qa-report.md
chunks/<nn>/final-reconciled.md
chunks/<nn>/final-reconciled.json
Chunk status meanings:
PASS: complete and publication-safe after ordinary instructor review.PASS_WITH_WARNINGS: usable evidence, but warnings must be reviewed before publication.FAIL: rerun analysis, omissions, or reconciliation before using the chunk.
Keyframes
Candidate extraction prompt output should include timestamp, reason, expected visual, priority, and confidence.
Extract deterministic frames:
mkdir -p "$RUN_DIR/chunks/01/keyframes/extracted"
ffmpeg -hide_banner -ss 00:23:48 \
-i "$RUN_DIR/inputs/source-video.mp4" \
-frames:v 1 \
"$RUN_DIR/chunks/01/keyframes/extracted/00-23-48-automation-verification.jpg"
Create contact sheet:
find "$RUN_DIR/chunks/01/keyframes/extracted" -name '*.jpg' | sort \
> "$RUN_DIR/chunks/01/keyframes/contact-sheet-inputs.txt"
ffmpeg -hide_banner -f concat -safe 0 \
-i <(sed "s#^#file '#; s#$#'#" "$RUN_DIR/chunks/01/keyframes/contact-sheet-inputs.txt") \
-vf "scale=320:-1,tile=3x4" \
"$RUN_DIR/chunks/01/keyframes/contact-sheet.jpg"
If process substitution is unavailable, generate the concat list as a real file and pass it to ffmpeg.
Git Workflow
Initialize a new artifact project:
mkdir -p /path/to/new-video-followup-project
cd /path/to/new-video-followup-project
git init
cat > README.md <<'EOF'
# Video Follow-Up Pipeline
Local artifact project for repeatable video follow-up runs.
EOF
git add README.md
git commit -m "Initialize video follow-up project"
Use proof-oriented commit boundaries:
git commit -m "Capture source evidence for <run_id>"
git commit -m "Draft initial segmentation for <run_id>"
git commit -m "Record Oracle segmentation review for <run_id>"
git commit -m "Revise semantic chunk manifest"
git commit -m "Cut video chunks and ffprobe receipts"
git commit -m "Slice transcript and chat by chunk"
git commit -m "Run Gemini analysis for chunks 01-03"
git commit -m "Add verification reports for chunks 01-03"
git commit -m "Run omissions pass for chunk 01"
git commit -m "Reconcile verified chunk analyses"
git commit -m "Extract and review keyframe candidates"
git commit -m "Assemble teammate follow-up packet"
git commit -m "Document repeatable video follow-up process"
Default binary policy for future runs:
- Commit text artifacts, manifests, prompts, logs, JSON, Markdown, reports, and checksums.
- Do not commit large raw videos unless explicitly approved.
- Commit chunk videos only for local archival projects or when Git LFS is configured.
- Commit keyframes/contact sheets only when they are small enough and useful for review.
Suggested .gitignore for future automation projects:
runs/**/inputs/*.mp4
runs/**/inputs/*.mov
runs/**/inputs/*.mkv
runs/**/chunks/**/*.mp4
runs/**/chunks/**/*.mov
!runs/**/inputs/*.sha256
!runs/**/receipts/**
!runs/**/segments/**
!runs/**/chunks/**/*.json
!runs/**/chunks/**/*.md
!runs/**/chunks/**/*.log
!runs/**/final/**
!runs/**/oracle/**
runs/**/chunks/**/keyframes/extracted/*.jpg
runs/**/chunks/**/keyframes/extracted/*.png
runs/**/chunks/**/keyframes/strips/*.jpg
runs/**/chunks/**/keyframes/contact-sheet*.jpg
If committing binaries intentionally:
git add -f "$RUN_DIR/chunks/01/chunk.mp4"
git add -f "$RUN_DIR/chunks/01/keyframes/contact-sheet.jpg"
Oracle Session Receipts
For every $oracle-packx call, save:
- slug
- date
- run id
- browser mode: true
- ChatGPT conversation URL
- bundle path
- bundle sha256
- prompt path
- output log path
- local decisions accepted/rejected
- commit before
- commit after
Template:
# Oracle Session: {{session_slug}}
- date:
- local_run:
- browser_mode: true
- session_url:
- bundle_path:
- bundle_sha256:
- prompt_file:
- output_file:
- commit_before:
- commit_after:
## Question
## Oracle Response Summary
## Local Decisions
Accepted:
Rejected:
Follow-up:
Final Packet Review
Treat these as first publication candidates:
final/README.mdfinal/teammate-followup-guide.mdfinal/chapter-index.mdfinal/resources-and-links.mdfinal/instructor-review-checklist.md
Treat these as reference drafts until edited:
final/qa-index.mdfinal/exercises.mdfinal/keyframes-manifest.md
Manual approval is mandatory for:
- platform automation
- browser automation
- cookies
- session replay
- quota/rate-limit behavior
- account credentials
- private emails
- private chat exports
- meeting transcript bot URLs
- teammate names
- screenshots of private repos
- local network addresses
- QR codes
- API keys
- package security claims
- third-party service recommendations
- public publishing
End-To-End Checklist
Project setup:
- [ ] Create run folder.
- [ ] Copy source video into
inputs/. - [ ] Copy transcript/chat/screenshots/clips if available.
- [ ] Save source SHA256.
- [ ] Save ffprobe source receipt.
- [ ] Save tool versions.
- [ ] Commit source evidence receipts.
Long recording preprocessing:
- [ ] Run
silencedetect. - [ ] Review transcript and chat around silence spans.
- [ ] Draft boundary candidates.
- [ ] Create
segment-manifest.v1.jsonand.md. - [ ] Bundle planning context with
$oracle-packx. - [ ] Run Oracle review in browser mode.
- [ ] Save Oracle session link/output locally.
- [ ] Create
segment-manifest.v2.jsonand.md. - [ ] Commit segmentation.
Chunk creation:
- [ ] Cut chunks from original video.
- [ ]
ffprobeevery chunk. - [ ] Create
chunks/video-manifest.json. - [ ] Slice transcript per chunk.
- [ ] Slice chat per chunk.
- [ ] Preserve break chat separately.
- [ ] Add carry-forward chat to next spoken chunk.
- [ ] Add next-chunk preview.
- [ ] Commit chunk receipts and slices.
Chunk analysis:
- [ ] Create Gemini prompt per chunk.
- [ ] Attach MP4, prompt, transcript, chat, carry-forward chat, and preview.
- [ ] Save Gemini raw result/log.
- [ ] Verify
END_OF_VIDEO_ANALYSISsentinel. - [ ] Extract all required information from the response into local artifacts.
- [ ] Close the completed Gemini tab only after extraction and sentinel verification; leave active Gemini tabs and the browser profile alive.
- [ ] Extract machine JSON.
- [ ] Build
expected-items.json. - [ ] Run coverage verification.
- [ ] Run hallucination/timestamp/Q&A checks.
- [ ] Run omissions pass if any gate fails.
- [ ] Commit analysis and verification reports.
Visual evidence:
- [ ] Generate keyframe candidates.
- [ ] Extract deterministic frames.
- [ ] Extract Gemini-proposed frames.
- [ ] Extract strips for visual demos.
- [ ] Create contact sheet.
- [ ] Review frames.
- [ ] Downgrade unsupported visual claims.
- [ ] Commit visual manifests/reviews.
Reconciliation:
- [ ] Merge main analysis, omissions, verification, and keyframe review.
- [ ] Write
final-reconciled.md/jsonper chunk. - [ ] Preserve warnings.
- [ ] Remove malformed URLs.
- [ ] Deduplicate carried-forward overlap.
- [ ] Commit reconciled chunks.
Final packet:
- [ ] Generate final README.
- [ ] Generate teammate guide.
- [ ] Generate chapter index.
- [ ] Generate resources and links.
- [ ] Generate Q&A index.
- [ ] Generate exercises.
- [ ] Generate keyframes manifest.
- [ ] Generate instructor checklist.
- [ ] Run malformed URL scan.
- [ ] Run URL resolution check if public.
- [ ] Run final packet review.
- [ ] Commit final packet.
Process documentation:
- [ ] Save this process as
docs/repeatable-video-followup-process.md. - [ ] Inspect for exact commands, mode branches, prompts, and gates.
- [ ] Commit process doc.
Automation Responsibilities
Review the process before automating it. These are proposed implementation boundaries, not supplied executables:
scripts/video-followup/init-run.ts
scripts/video-followup/probe-source.ts
scripts/video-followup/detect-silence.ts
scripts/video-followup/build-segment-manifest.ts
scripts/video-followup/cut-chunks.ts
scripts/video-followup/slice-transcript.ts
scripts/video-followup/slice-chat.ts
scripts/video-followup/build-gemini-prompts.ts
scripts/video-followup/extract-machine-json.ts
scripts/video-followup/verify-coverage.ts
scripts/video-followup/scan-malformed-urls.ts
scripts/video-followup/extract-keyframes.ts
scripts/video-followup/build-contact-sheet.ts
scripts/video-followup/reconcile-chunk.ts
scripts/video-followup/build-final-packet.ts
templates/gemini/chunk-analysis.md
templates/gemini/omissions.md
templates/oracle/planning-review.md
templates/oracle/final-review.md
templates/final/README.md
templates/final/teammate-followup-guide.md
templates/final/chapter-index.md
templates/final/resources-and-links.md
templates/final/instructor-review-checklist.md
docs/automation-roadmap.md
Automation priority:
- Malformed URL scanner.
- Timestamp validator.
- Expected-items builder from chat/transcript.
- Chunk prompt generator.
- ffmpeg chunk cutter.
- Keyframe extractor/contact sheet builder.
- Final packet assembler.
Operational boundaries
- Apply the media/privacy ignore policy before the example staging command. Do not stage raw recordings, chats, transcripts, or account-bearing screenshots merely because they live under
inputs/. - Automation file lists are proposed boundaries, not supplied programs. Template fields must be filled from real evidence, and a sentinel is a completion signal rather than proof of accuracy.
- The video-capable provider, browser routing, model aliases, upload limits, and cleanup commands are integration-specific. Verify the attached-video readiness probe and retain uncertainty when evidence is missing.