Generating Videos with VQGAN+CLIP

Generating Videos with VQGAN+CLIP

on by Cade Brown


A super cool model that you can use to generate images and videos, with a little bit of code.

If you’re in the AI space, specifically generative models, you owe a great deal of respect to VQGAN and CLIP. When combined, they can be used to iteratively refine images to more closely match a prompt.

These are some results from recent work on generating art using machine learning and artificial intelligence. Most of the following are using VQGAN+CLIP, or just CLIP alone.

I gave a presentation at UTK’s Innovative Computing Laboratory (ICL) that describes some of these processes.

Short Square Morph Videos

mush2dna

CEB 0

AZH 0

Music Videos

(demo) ghoti - Towards Holier Places