Gesso
Can I just draw what I mean?
An iPad app for changing a website by drawing on it. Circle the thing, scribble what you want, and an AI agent edits the code and commits it.
- Year
- 2026
- Type
- iPad app
- Built with
- SwiftUI, Vision, WebKit
- Status
- TestFlight beta
-
Open the live site
Connect a GitHub repository and Gesso loads its deployed site in a browser on the iPad.
-
Mark it up
Draw on the page with Apple Pencil and write a note by hand. The iPad reads the handwriting.
-
The agent edits the code
Claude or Gemini gets a screenshot of each marked-up page and your notes, reads the repository and makes the change.
-
Commit and redeploy
The change is committed with a clear message. When the site redeploys, reload and mark up the next thing.
How a change travels: from a pencil mark to a commit.
Point at it instead of describing it
Describing a design change in words is slow and easy to get wrong: “the second button, no, the one under the header, and a bit bigger.” Pointing at it is faster. Gesso lets you point with an Apple Pencil.
Open your site in Gesso, draw on the page and jot down what you want. Submit, and an AI agent with access to the repository works out which files to change, edits them and commits the result. The site redeploys and you carry on from the updated page.
Feedback that turns into commits
-
Say it the way you’d sketch it
Circles and arrows say where; handwriting says what. Markup is kept per page and follows the page as it scrolls.
-
Handwriting, understood
Notes are read on the iPad and grouped into whole phrases, then handed to the model alongside the screenshots.
-
Real changes, not suggestions
The agent reads the code before it touches anything, commits its edits, and asks you to choose when there are a few reasonable options.
-
Your keys, your repository
Sign in to GitHub with a device code, bring your own Claude or Gemini key, and optionally connect Vercel to pick the deployment to load.
How it’s built
- App
- SwiftUI for iPad, with a custom Apple Pencil canvas: pen, calligraphy pen, partial eraser and palm rejection
- Browser
- WebKit, with markup tied to the page rather than the screen
- Handwriting
- Apple’s Vision text recognition, on device
- Agents
- Claude through the Anthropic Messages API, with tools to list, read and commit files; Gemini as an alternative
- Delivery
- GitHub Actions builds every push to TestFlight