Computer Vision Recipes

Small computer-vision projects. Each page shows the architecture, the training data and the training recipe in short steps.

Some pages have a live demo. The demo runs in your browser. Your files do not go to a server.

Meme search

Describe a situation and get a blank meme template with your words in it. A fine-tuned CLIP finds templates without reading their text.

CLIPMemeCapbrowser demo

PDF layout parser

A 3.7M-parameter detector finds titles, text, tables and figures on a PDF page, then the page becomes markdown.

D-FINEDocLayNetbrowser demo

World model: a playable dream

A 9.8M-parameter transformer learns a small 2D room from recordings. Then you drive a flashlight inside its dream, frame by frame.

VQ-VAEGenie-style transformerbrowser demo

Tennis tracker

One 3.45M-parameter network tracks the ball, both players and the court lines in broadcast video at about 200 frames per second.

HeatmapsDistillationvideo