← All works

Gesso

Can I just draw what I mean?

An iPad app for changing a website by drawing on it. Circle the thing, scribble what you want, and an AI agent edits the code and commits it.

Year
2026
Type
iPad app
Built with
SwiftUI, Vision, WebKit
Status
TestFlight beta
  1. Open the live site

    Connect a GitHub repository and Gesso loads its deployed site in a browser on the iPad.

  2. Mark it up

    Draw on the page with Apple Pencil and write a note by hand. The iPad reads the handwriting.

  3. The agent edits the code

    Claude or Gemini gets a screenshot of each marked-up page and your notes, reads the repository and makes the change.

  4. Commit and redeploy

    The change is committed with a clear message. When the site redeploys, reload and mark up the next thing.

How a change travels: from a pencil mark to a commit.

Point at it instead of describing it

Describing a design change in words is slow and easy to get wrong: “the second button, no, the one under the header, and a bit bigger.” Pointing at it is faster. Gesso lets you point with an Apple Pencil.

Open your site in Gesso, draw on the page and jot down what you want. Submit, and an AI agent with access to the repository works out which files to change, edits them and commits the result. The site redeploys and you carry on from the updated page.

Feedback that turns into commits

  • Say it the way you’d sketch it

    Circles and arrows say where; handwriting says what. Markup is kept per page and follows the page as it scrolls.

  • Handwriting, understood

    Notes are read on the iPad and grouped into whole phrases, then handed to the model alongside the screenshots.

  • Real changes, not suggestions

    The agent reads the code before it touches anything, commits its edits, and asks you to choose when there are a few reasonable options.

  • Your keys, your repository

    Sign in to GitHub with a device code, bring your own Claude or Gemini key, and optionally connect Vercel to pick the deployment to load.

How it’s built

App
SwiftUI for iPad, with a custom Apple Pencil canvas: pen, calligraphy pen, partial eraser and palm rejection
Browser
WebKit, with markup tied to the page rather than the screen
Handwriting
Apple’s Vision text recognition, on device
Agents
Claude through the Anthropic Messages API, with tools to list, read and commit files; Gemini as an alternative
Delivery
GitHub Actions builds every push to TestFlight