Skip to content

About

Video creation through code written or directed by AI agents

Topics

Resources

Contributing

Stars

2 stars

Watchers

0 watching

Forks

Latest commit

 

History

6 Commits

Folders and files

Repository files navigation

Awesome Video as Code Awesome

Trailer excerpt: shader code beside its live render of a starfield, the Milky Way, and nebulae; the render fills the frame, then the stars gather into the title Awesome Video as Code
▶ Watch the full trailer in 2560×1440 at 60 fps · It is itself video as code: an AI agent wrote it as HTML and a GLSL deep-space shader, and a zero-dependency script rendered it with headless Chrome and FFmpeg.

Curated tools, agent skills, production workflows, source-available showcases, and research for creating videos with code written or directed by AI agents.

English · 简体中文

Video as code treats executable source as the visual medium: an agent writes HTML, Canvas, SVG, React, TypeScript, or Python, and a browser or rendering engine turns it into video. This list focuses on that inspectable, programmable workflow. Tools that orchestrate pixel-generating video models are included only when their agent or pipeline design is directly useful to video-as-code practitioners.

Contents

Start Here

If you want to…Start with…
Build videos with ordinary HTML, CSS, and JavaScriptFrameworks and Renderers
Compose videos as React componentsFrameworks and Renderers
Create technical or mathematical animationFrameworks and Renderers
Give an agent a specialized video-making workflowAgent Skills and Tooling
Add audio, captions, assets, or automated renderingProduction Pipeline
Learn from complete projects with public source codeShowcases

The core path is brief → agent → executable visual code → deterministic renderer → video file. Generated-video APIs, stock-footage assembly, and screen recording are adjacent paths, not the primary scope of this list.

LabelMeaning
Code-renderedCode defines the frames or scene graph; a browser or graphics engine produces the pixels.
HybridCode assembles ordinary media and may optionally include model-generated assets.
PipelineSupporting infrastructure for capture, timelines, transcription, encoding, or delivery.

Frameworks and Renderers

  • Remotion - Code-rendered React framework, Studio, player, and rendering stack for programmatic video; source-available under the Remotion License.
  • HyperFrames - Code-rendered HTML video framework with seekable animation adapters and deterministic Chrome-and-FFmpeg rendering.
  • Motion Canvas - Code-rendered TypeScript framework and real-time editor for explanatory vector animations synchronized with voice-over.
  • Manim Community - Code-rendered Python engine for precise mathematical and technical animations.
  • Revideo - Code-rendered TypeScript framework with parameterized templates, a player, and headless rendering for video applications.
  • MoviePy - Hybrid Python library for scripted cutting, compositing, effects, titles, and encoding.
  • p5.js - Code-rendered creative-coding library for Canvas and WebGL visuals that can be captured frame by frame.
  • Three.js - Code-rendered JavaScript 3D engine for WebGL scenes that can be captured by browser-based video renderers.

Agent Skills and Tooling

  • Remotion Agent Skills - Code-rendered first-party agent instructions for composition, animation, audio, captions, transitions, and rendering with Remotion.
  • HyperFrames Skills - Code-rendered first-party skills for planning, creating, checking, previewing, editing, and rendering HyperFrames projects.
  • Claude Code Video Toolkit - Hybrid agent workspace combining Remotion, FFmpeg, browser recording, transcription, voice, music, and generated assets.
  • Motion Skills - Code-rendered installable skills for kinetic type, explainers, data visualization, short-form video, WebGL, and Manim.
  • Claude Motion Design - Code-rendered skill and examples for creating motion graphics in HTML and rendering them with Playwright and FFmpeg.
  • Videowright - Code-rendered coding-agent workflow for assembling animated explainer videos from structured plans and source-controlled assets.

MCP Servers and Integrations

  • Pireel - Hybrid timeline editor whose agent plugin lets MCP-capable agents edit cuts, captions, graphics, audio, and exports while a person retains GUI control.
  • OpenVidStudio - Hybrid MCP workflow that captures a real application with Playwright and composes product footage with Remotion.
  • mimic-mcp - Hybrid MCP server that analyzes a reference reel, scaffolds a Remotion project from supplied footage, renders it, and performs a visual review.
  • Blender MCP - Code-rendered community integration that lets language models control Blender scenes and render conventional 3D animation.

Production Pipeline

  • FFmpeg - Pipeline toolkit for encoding, muxing, filtering, audio mixing, probing, and format conversion.
  • OpenTimelineIO - Pipeline interchange format and API for editorial timelines, clips, tracks, transitions, and adapters.
  • Whisper - Pipeline speech-recognition model and reference implementation for producing transcripts for subtitle workflows.
  • WhisperX - Pipeline transcription tool with word-level alignment and optional diarization for caption timing.
  • ffmpeg.wasm - Pipeline WebAssembly port of FFmpeg for browser-side media conversion and assembly.

Showcases

Projects in this section publish source code, prompts, or production notes that reveal how the video was made.

  • PDoomVideo - Code-rendered music video project with p5.js and p5.brush source, a storyboard, an animation guide, and a browser renderer.
  • ClaudeAnimationBase - Code-rendered starter project with p5.js rendering, a hand-painted character, reusable emotional performances, and coding-agent instructions.
  • Lemo Opuscar - Code-rendered collection of short films paired with reusable visual-style prompts and directing guidance.
  • Zero to Product Video Hero - Code-rendered Remotion project publishing the composition source, output, production plan, and agent conversation for a product video.

Research

Learning

  • Remotion Documentation - Official introduction to creating React compositions, previewing them in Remotion Studio, and rendering video.
  • Remotion Agent Skills Guide - Official guide to Remotion's creation, editing, rendering, captioning, multimedia, and application-building skills.
  • HyperFrames Quickstart - Official walkthrough for creating and rendering a deterministic HTML composition with an agent or by hand.
  • HyperFrames Prompt Guide - First-party guidance for writing briefs, supplying context, iterating with motion vocabulary, and avoiding common failures.
  • Motion Canvas Quickstart - Official introduction to scenes, generator functions, real-time preview, and rendering.
  • Manim Example Gallery - Official gallery pairing rendered mathematical animations with the Python source that produced them.

Related Lists

  • Awesome Opus 5.5 Videos - Model-specific gallery of prompts, source posts, and live remakes for Claude Opus 5.5 video experiments.
  • Awesome Claude 5.5 Videos - Source-linked catalog that records prompts, tools, production evidence, and model variants.
  • Awesome Creative Coding - Creative-coding tools, frameworks, books, tutorials, and communities across visual media.
  • Awesome Web Animation - Browser animation libraries and learning resources for SVG, CSS, Canvas, JavaScript, and React.

Contributing

Contributions are welcome. Please read the contribution guidelines before submitting a resource. If this list saved you some searching, a star helps other people find it.

About

Video creation through code written or directed by AI agents

Topics

Resources

Contributing

Stars

2 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages