New Framefields

Framefields is a video engine specifically designed for programming intelligent agents: it consists of an npm package that allows agents to use TypeScript to create dynamic graphics, text animations, charts, 3D effects, and audio content. These elements can be directly rendered into MP4 format on the GPU, eliminating the need for headless browsers or any desktop software.

The functionality is quite robust: the text remains clear regardless of the size, and there are word-by-word animation effects similar to those found in After Effects. 3D support includes physical materials and shadows, and it’s possible to import models in formats such as glTF and FBX. The software comes with over 50 built-in special effects. Additionally, it allows for keying out characters, detecting their poses, and automatically converting horizontal videos to vertical format. In the official demonstration, a 1080p video with 255 frames was rendered on an M1 Pro in just 2.6 seconds.

It is possible to use a single command to install it in Claude Code, Codex, Cursor, and Gemini CLI. It is open-source and free of charge, making it ideal for developers who wish to use agents to generate product demos and data videos in bulk.

If you want to use it to create AI-generated short dramas, you can start by writing the script and creating the storyboards first.TVLabLook: There are analyses of the plot of popular overseas short dramas, rhythm charts for these dramas’ structures, as well as inspiration cards with pre-divided storyboards. Just copy them and use them as prompts.