Skip to content

gatewai-dev/framefields

v3.0.2Apache-2.0

Author, render and verify video compositions with the framefields WebGPU SDK.

Framefields agent skills

Agent skills for framefields, a code-first video SDK that renders compositions natively on WebGPU in Node.js. The skills teach Claude, Codex, and other coding agents how to write, render, and check framefields compositions in your own project.

SkillUse it for
framefieldsStarting a project: install from npm, scaffold a composition and render script, first verified render; generating images, video and audio with AI models (ai)
framefields-composeCompositions, layer trees, layout, animation and easing, beat grids, film structure
framefields-stylesCreative direction: looks, formats (16:9, 9:16, square, ads), genres (explainer, product launch, lyric video) and media (code-drawn, 3D, footage, AI-generated), combined, or from a preset
framefields-effectsPost-processing effects, color grading, VFX
framefields-visionOn-device vision: detection, segmentation, pose, cutouts, and prompted tracking with SAM 2.1 / SAM 3
framefields-renderHeadless rendering, frame-grid inspection, pixel probes, live preview, MP4 delivery checks
framefields-cloudRendering on framefields cloud GPUs (framefields render --cloud, renderCloud), cost plans, split renders, cloud error codes

Skills load automatically when a task matches, for example "add a film-grain pass to this scene" or "render a frame grid of intro.ts".

Installation

Install into Claude Code via the marketplace:

/plugin install framefields --marketplace gatewai-dev/framefields

How it works

This plugin contains skills and a read-only connection to the hosted Framefields MCP server for model information and price estimates. Generate media through the Framefields SDK using a separately configured gateway API key. It bundles no executables, hooks, or package launchers. The engine itself is the framefields npm package, which the skills tell your agent to add to your project (npm install framefields, Node.js 22 or later).

The connected MCP server exposes read-only tools to assist in selecting models and inputs:

  • list_models: List supported AI models, identifiers, and tasks
  • get_model_schema: Get the input and output JSON schema for any catalog model
  • estimate_generation_cost: Check published rates and estimated costs before running a script

Data and privacy

When you run code using ai, prompts, inputs and uploaded files are sent to the Framefields gateway and the provider running the selected model. The gateway stores generated outputs and usage records. The MCP connection provides model information and price estimates; it does not generate media. On-device vision downloads model weights on first use and verifies them by SHA-256. See the privacy policy for details.

License

Apache-2.0. See LICENSE.