I'm working on a track of research to explore how collaboration with agents can be improved by leveraging visual and interactive forms.
Problem: design and building with an agent can generate tremendous piles of text, with buried threads of divergence and inaccuracy. It can require tedious review and extensive writing, sometimes adding more friction and effort than the task itself. This research aims to reduce that hurdle with visual and interactive thinking and communication.
- Idea → flow
- Project octopus
Idea → flow
This tool takes an idea and produces a flow diagram that can be directly edited to refine the expression of the idea, and tighten alignment around the concept. The diagram can then be copied as an image or mermaid diagram as an input for planning with a better anchor and less risk of drift. I've developed it to help refine app and feature concepts, but it could be easily extended to other domains.
Project Octopus Editor
This early stage concept explores ways to elevate how we design and refine interfaces. It aims to enable fluid shifts between modes: chat when useful, edit properties for precise refinement, drag and transform elements when that's quickest, collage ideas to express bigger transformations. The goal is to help makers think and speak visually, with the simplicity of Lego bricks or paper collage or a napkin sketch, leveraging the elasticity and magnetism of web elements and molecules.