rl0ve/ui-walkthrough-video
v1.7.4MIT
Record real UI walkthroughs with editable native-project handoffs or optional HyperFrames composition, plus standalone narration and measured speech cues.
Changelog
1.7.4 — 2026-10-20
- A Capability Storyboard can supply the talk track and scene order; its mockups are replaced by real capture or labeled.
1.7.3 — 2026-10-20
- Voice narration: add the VoiceStudio desktop app as an unrated local trial candidate, with its AGPL-3.0 app license separated from model terms and the permission rule for cloning.
1.7.2 — 2026-10-18
- Route conceptual motion explainers to a motion-design lead; retain real capture, narration and delivery ownership for mixed films and ordinary walkthroughs.
- Name official HyperFrames creative and animation skills for composition and choreography under the existing optional route. Require a representative moving proof for substantial authored inserts, preserving reference direction and teaching pace rather than importing promo defaults.
- Link the public-source decision review; no renderer, paid service or installation is added by this guidance update.
1.7.1 — 2026-10-18
- HyperFrames route: when a requested mix includes SFX or music, earshot (MIT, CPU-only) can screen sound-to-cut offsets against the storyboard's cues and render code-built effects with measured sync points. Listening still accepts the mix; narration review, loudness measurement and the full listening reviewer are unchanged. Its optional cloud critique uploads audio and stays off without consent.
- Record the decision in the October 18 earshot review.
1.7.0 — 2026-10-11
- Gemini adapter supports the GA Gemini 3.8 Flash TTS / Flash-Lite TTS schema: verbatim transcript in
text,instructionsinspeech_metadata.style,speechConfig.voiceConfig.voice(prebuilt, library orvoice_...IDs), and a validated RIFF WAV response saved without re-wrapping.gemini-3.1-flash-tts-previewkeeps the legacy path. - ElevenLabs: document
eleven_v4as the current flagship and reject voice settings v4 does not accept (onlystabilityandsimilarity_boost). - Provider guidance: dated Oct 10 blind-preference snapshot as audition candidates, plus re-audition required when an accepted voice name moves to a new model.
- HyperFrames: install the official skills by name (
hyperframes,hyperframes-core,hyperframes-keyframes,hyperframes-cli) under this route; note upstream v0.8.149 while keeping the proven 0.8.137 pin. - Sources: October landscape check (video-shotcraft, onetake, agentic-product-demo, product-demo-director, official HyperFrames/Remotion/ElevenLabs skills).
1.6.0 — 2026-10-06
- Offer HyperFrames as an explicit choice for each new video, carrying that choice through revisions; keep ordinary capture/composition and paid-media authorization separate.
- Add a pinned HTML/GSAP project builder with measured footage, an audio-first storyboard, camera paths, speech-linked highlights, phrase captions, optional music/SFX and music ducking. Author portrait layouts separately and preserve portable source assets.
- Add optional ElevenLabs character timestamps and validated word sidecars; existing basic and polished assemblers consume measured captions while retaining their labeled fallback and explicit-cue precedence.
- Add full-decode, media-spec, black/freeze and loudness checks plus transition review frames. Record synthetic landscape/portrait render evidence separately from listening and viewer acceptance.
1.5.6 — 2026-09-20
- Add a conditional application-narration route covering whole-operation budgets, uncertain charges, reusable clip identity, transcript review and manifest delivery.
- Distinguish cached playback from local inference, and technical/transcript checks from heard voice quality. Preserve the ordinary single-voiceover route.
- State that this is destination-pipeline guidance; the bundled helper does not gain budget enforcement, caching, transcription or a runtime player in this release.
1.5.5 — 2026-09-20
- Add a lightweight route for quick screenshots or recordings, with capture access checked before promising video and a truthful fallback when either format is accepted.
- Verify fresh local-page loading and detected screenshot formats; preserve unsaved state, output dimensions and existing host authorization boundaries.
- Record empty-window-list evidence without inferring its cause; add manual policy cases and align the previously stale Claude marketplace version.
1.5.4 — 2026-09-14
- Add a route for capturing an installed desktop application on the user's own machine, with the executed mechanics: accessibility clicks report success without actuating embedded web content or moving the OS cursor, real HID events do both, and a compilable pointer program ships as an asset.
- Record the recorder contract:
screencapture -vwrites only when it ends on its own, so pass-V seconds; two takes were destroyed by signalling it. A capture script must be the tracked process, not a detached child. - Require every pointer move to sit on a phrase that names what it points at: schedule the path from silence-detected narration timings against a monotonic clock, and treat stillness as a choice. A move with no verbal cue reads as nervous and pulls attention to the pointer.
- Do not pan or zoom a captured still.
zoompanresolves its crop to whole pixels, so a gentle ramp pumps: measured 0.2362 mean frame-to-frame luma change against 0.0007 for the same shot held static. - Record that
activateis not a window selector: with two windows of one browser on different profiles, the app fronted the signed-out one and its page carried a notice the accepted footage did not. Verify the expected state in a still before recording. - Add programmatic take review: diff a downscaled crop of every frame against a confirmed reference frame to locate foreign windows, and scan the assembled cut for unintended jumps. A two-and-a-half-second intrusion that eye review missed was found this way.
- Record the operator as the main hazard to a take, with the mitigations: activate the target immediately before the recorder starts, state the hands-off window, and clear permission prompts beforehand.
- Document fitting the picture to accepted narration with a
setptsratio, the roughly 1.3x slowdown ceiling for cursor-only motion, and the resulting capture headroom. - Record Algenib as an accepted single-narrator direct-Gemini profile, with the pace and the constant delivery instruction that let re-synthesised lines splice against earlier takes.
- State plainly that every prebuilt voice on the model is selectable: the voice names in this package are dated listening results, not a supported subset, and none of them is a default.
1.5.3 — 2026-09-13
- Record Algieba + Sulafat as an accepted direct-Gemini, male-presenting two-host profile and Kore as an accepted female-presenting Southern-style product-demo voice through OpenRouter.
- Separate Gemini voice availability from provider-route capabilities: shared voice names do not prove matching prompt, multi-speaker, format, quota or catalog behavior.
- Add the observed long-form limitation: split two-speaker production at natural one-to-three-minute exchanges and verify speaker continuity.
1.5.2 — 2026-09-06
- Offer native project + source assets + MP4 before capture; reuse an established editable-project preference.
- Rank Cap Studio first for documented editing breadth and Recordly second, with an editing matrix directly in the README.
- Require native zoom/audio/layer preservation, packaged-project reopening and edit checks; distinguish this target from the limited existing trials.
1.5.1 — 2026-09-06
- Put the preference, quality evidence and pros/cons matrices directly in the README, including Mac narration status.
- Correct the Cap trial record: later frames showed an occluding Edge window, missed by earlier review.
- Document the fresh foreground-controlled take, matched narration in both native examples, and stronger content/audio verification.
- Make the Cap recommendation conditional on foreground control and keep framework showcases separate from the product-demo page.
1.5.0 — 2026-09-06
- Add a separate voice-narration skill for provider selection, auditions, audio-only output and revoicing, sharing the existing audio helper.
- Add MiniMax synchronous speech support with explicit model/voice, validated hex MP3 responses, prior paid-call authorization and no automatic retries.
- Distinguish MiniMax Desktop Design, coding, generated assets and speech API routes; retain real capture evidence and untested quality labels.
- Move provider guidance under the narration skill, preserve existing links, and document complementary OpenAI speech and natural-writing skills.
1.4.2 — 2026-09-06
- Add the preferred Mac workflow, qualitative fit/quality assessment, pros/cons and explicit trial boundaries.
- Separate established Kore narration from unintegrated, unauditioned Chatterbox/Kokoro candidates; exclude the NVIDIA route from the Mac default.
- Document shorter cursor/camera timing and the remaining viewer-acceptance and combined-pipeline checks.
1.4.1 — 2026-09-06
- Require a visible standard pointer for mouse-driven demos unless cursorless output is requested.
- Record the tested browser-pointer overlay repair for Cap/Recordly and distinguish baked footage from editable native cursor layers.
1.4.0 — 2026-09-06
- Record actual HyperFrames and Remotion composition trials, including working configurations, timed-out attempts, camera bounds and reuse limits.
- Document executed Cap CLI capture/config/export and Recordly bundled-engine recording, keeping supported interfaces distinct from experimental internals.
- Add automatic-work routing across browser navigation, native capture, composition, and refinement of existing videos; preserve editable sources and a normal cursor option.
- Require recorded-pixel checks for window occlusion, persistent native menus and real pointer telemetry; successful page assertions or a valid capture project alone are insufficient.
1.3.0 — 2026-09-05
- Separate cursor rendering from 25fps browser capture and animate cursor/camera at 60fps; fade idle pointers and retain real click timestamps.
- Reduce repeated zoom resets and competing motion in the existing-site example; add a conservative target-bounds camera fallback and loudness normalization.
- Assess screen-editor/presenter effects, automatic versus conditional defaults, local tools, local TTS, and HeyGen HyperFrames as distinct from hosted avatars.
- Preserve the source-cadence limitation and actual hover-at-arrival behavior; do not claim native 60fps app animation or product parity.
1.2.0 — 2026-09-05
- Add real 2× capture with eased cursor movement, actual click pulses and timestamped targets, plus a Pillow/FFmpeg compositor for explicit camera zooms, framing and captions.
- Add a reproducible demonstration using the existing Design Router Field Guide and user-auditioned Gemini Kore narration.
- Add OpenRouter speech support, including the live-confirmed Gemini PCM requirement, secure shared-credential discovery, partial-take voice metadata and response-format validation.
- Require playable examples for quality claims and keep manual camera planning/scene-level captions distinct from automatic editing and word alignment.
1.1.0 — 2026-09-05
- Add Google Gemini TTS/Kore support, natural-voice audition gates, silent technical tests and explicit-only local test speech.
- Add dated benchmark evidence and polished production routing for Clueso, Recordly and Remotion; distinguish basic capture from demonstrated visual quality.
1.0.0 — 2026-09-05
- Real UI capture by beat, screenshots, configurable voice quality/provider/model, secure environment credentials, captions and silent revoice output.
- Measured media timing, non-destructive takes, explicit supplied captions, and synthetic fixture for reproducible smoke testing.