Skip to content

gatewai-dev/framefields

v3.0.2Apache-2.0

Author, render and verify video compositions with the framefields WebGPU SDK.

framefields

Start a new framefields video project, or add framefields to an existing Node.js project. Use when the user wants to make a video with framefields and the project has no framefields setup yet, or asks how to install framefields, scaffold a composition and render script, get from an empty folder to a first MP4, store footage (asset buckets, Git LFS), generate images, video, music or voice for a film with AI models (ai from framefields, the framefields AI gateway), or add ready-made components (pointers, captions, title cards, device frames …) and library media (SFX, HDRIs) with npx framefields add / npx framefields library. Hands off to framefields-compose, framefields-effects, framefields-vision, framefields-render and framefields-cloud for the details.

framefields-cloud

Render framefields projects on framefields cloud GPUs (api.framefields.dev) or a self-hosted render worker. Use when running framefields render --cloud, calling renderCloud from framefields/cloud, planning cost and workers, splitting a long film across several GPUs, starting renders from the framefields dashboard, getting a project render-ready (push, lockfile, pinned assets, private repos), or fixing a cloud render error code such as ASSET_NOT_FOUND or LOCKFILE_MISSING.

framefields-compose

Design, structure, and animate code-first video compositions using the framefields WebGPU SDK. Use when writing or changing a framefields film — scenes and transitions, layout trees, keyframes and easing, kinetic typography, shapes and morphs, charts, blend modes and mattes, 3D scenes (cameras, lights, materials, outlines, models), physics, GPU particles, procedural VFX layers, time remapping, or audio-synchronized motion.

framefields-effects

Apply, configure, and modulate WebGPU post-processing shaders, stylized looks (pixel art, ASCII, VHS, comic, watercolor, risograph, holographic — and which look fits which request), cinematic color grading, tone mapping, and procedural VFX in framefields. Use when adding blur, grain, LUTs, relighting, curves, greenscreen color keying, or effects driven by vision signals in framefields compositions; detection, cutouts, pose and SAM tracking themselves are in framefields-vision.

framefields-render

Render, inspect, test, preview and export WebGPU video and frame grids with the framefields headless engine. Use when verifying compositions, diagnosing blank frames, running frame grids or pixel tests, showing the user a live preview, exporting MP4/WebM, exporting a scene's 3D models as glTF (.glb) for Blender, Unreal, Unity or the web, reading render progress, running video QA, naming renders in framefields.json, rendering without a GPU, or splitting a render into chunks in framefields. Cloud GPU rendering is in framefields-cloud.

framefields-styles

Choose and combine the creative direction of a framefields video — its look (Motion, Collage, Blueprint, Keynote …), format (widescreen, vertical 9:16, square, 15/30 s ad), genre (explainer, product launch, brand film, lyric video) and media (code-drawn, 3D, footage, AI-generated through the framefields gateway) — or start from a preset. Use when someone asks for a video "in the style of" something, names a platform or length, asks what kind of video to make, wants AI-generated clips to match drawn graphics, or before choosing palette, type, pacing or music for a new film.

framefields-vision

On-device computer vision in framefields — object detection and tracking, instance segmentation, pose, person mattes and cutouts (RTMDet-Ins, RTMO, Selfie Segmenter), soft alpha matting of hair and motion blur (ViTMatte), and prompted video tracking of a specific object or several people with SAM 2.1 Tiny or Small (point/box prompts) and SAM 3 (text prompts such as "man in white shirt", multiple objects at once). Covers which API to use (withVision, comp.vision, analyzeVisionSequence), every pinned ONNX model with sizes and licenses, GPU/CUDA/CPU backends, model downloads and caching, performance, and troubleshooting. Use when a framefields composition needs to know where people or objects are, cut a subject out, follow someone through a clip, or select one person in a crowd.