What Solo Builders Should Build With Spatial AI Now — No Code Required

A startup just raised $2.3 billion to train AI agents on Fortnite gameplay footage. General Intuition builds world models from 2 billion video game clips per year, teaching AI to understand space, time, and movement by watching how humans move through dynamic environments. For solo builders, that shifts AI agents from text processors into visual operators: software that can see screens, work through interfaces, and make spatial decisions.

Here’s the number worth remembering: 2 billion clips per year. That’s the training volume General Intuition is feeding into world models, and it’s why their agents learn cause and effect and anticipatory decision-making rather than just pattern-matching text. I covered what General Intuition does and why video game data is different in my last post; this one is about what to actually build with the technology.

What does spatial AI mean for solo builders?

Spatial AI means agents that reason about what’s on screen instead of only processing text. Today’s agents, the ones behind automated workflows and tool-calling systems, read data, follow instructions, and output API calls. Powerful, but blind; they can’t see a screen or understand physical context. General Intuition’s models learn spatial reasoning by watching first-person footage of players making decisions in real time. For builders, the next generation of agents will automate visual tasks: moving through apps, interpreting dashboards, and deciding based on what they see.

What should I build with spatial AI right now?

Three categories have clear near-term potential, and every component piece already exists.

Visual workflow agents. Current automation tools like Zapier and Make work through APIs, which are structured connections between apps. Most business processes, though, still involve clicking through interfaces, reading dashboards, and making visual judgments. A visual workflow agent could log into your Shopify dashboard, spot products with declining sales, check competitor pricing on Amazon, and draft a pricing adjustment recommendation, all by looking at the screen rather than calling an API.

AI-powered QA. Every software product needs testing, and right now testing is either manual (humans clicking through interfaces) or scripted (test suites that break every time the UI changes). An agent that understands screen layout and interaction patterns could test your app the way a human would, clicking buttons and filling forms, but with automation’s consistency. Move a button three pixels to the left and a scripted suite breaks; a vision-based agent wouldn’t notice or care.

Context-aware customer support. Current AI customer support works through text: reading tickets, matching patterns, generating responses. Spatial AI could watch a customer’s screen (with permission), understand what they’re trying to do, and guide them visually. Picture a screen-sharing assistant that sees what you see and points at the right button. For SaaS products with complex interfaces, that would cut support tickets substantially.

Can I actually build this today?

Partially. General Intuition’s world models aren’t publicly available yet, but the component pieces are mature:

• Computer vision: GPT-4V, Gemini, and Claude can all interpret screenshots and identify UI elements.
• Browser automation: Playwright, Puppeteer, and Selenium can control any web interface.
• LLM reasoning: current models can plan multi-step actions based on visual input.

What’s missing is unified spatial reasoning, the ability to understand that “this button is in the top-right corner of a modal that appeared after I clicked the settings gear.” That’s what world models will add. You can build roughly 80% of the solution today with existing tools, then upgrade the reasoning layer when spatial models ship.

Where should a solo builder start?

Pick one niche. Build a visual browser agent for a specific industry, e-commerce, real estate, or healthcare admin, that can handle their specific interfaces. The reason is that spatial AI only works when it understands context: a general-purpose visual agent would need to understand every interface, while a niche agent needs to understand one type deeply. That’s achievable now.

The stack is browser automation plus computer vision plus an LLM for decision-making, wrapped in a simple UI. Charge per task or per month. When spatial reasoning models become available, swap in the better model and your product improves overnight. I covered how AI agents are becoming employees; spatial AI is what makes them competent employees instead of fast text processors.

General Intuition’s $2.3B raise tells you where agents are headed: from APIs to interfaces, from reading to seeing. You don’t need to train world models on 2 billion video clips. Combine existing vision, automation, and reasoning tools into products that solve real problems for specific users. The spatial layer will come. Build the product now.

More on AI tools and building strategies at /start-here/.

FAQ

What is spatial AI and why does it matter for solo builders? Spatial AI refers to AI systems that understand space, time, and movement, in addition to text. Companies like General Intuition train these models on video game footage (2 billion clips per year) to teach AI how to move through physical and digital environments. For solo builders, this means agents that can see screens, click buttons, and make visual decisions.

Can I build spatial AI tools without training my own models? Yes. Computer vision (GPT-4V, Gemini, Claude), browser automation (Playwright, Puppeteer, Selenium), and LLM reasoning are all mature and available now. Combine them to build visual workflow agents today, then upgrade to spatial reasoning models when they become publicly available.

What’s the best niche for a spatial AI agent? Pick one industry with repetitive visual workflows; e-commerce, real estate, and healthcare admin all work. A niche agent only needs to understand one type of interface deeply, which current technology can handle. General-purpose visual agents need far more spatial context to be useful.

How is spatial AI different from current AI automation? Current AI automation works through APIs, which are structured data connections between apps. Spatial AI works through vision: it looks at screens, interprets layouts, and moves through interfaces the way a human does. That lets it handle tasks with no API access or tasks that require visual judgment.