Startups I Am Watching

No. 02 · Foundation Models

Standard
Intelligence.

Training a foundation model on pixels and software interaction rather than text, a bet on a category that does not exist yet.

San Francisco/ $80M raised/ 6 people/ si.inc
$0M Total RaisedSequoia, Spark Capital, Lachy Groom
6 Team Sizeat time of FDM-1 release
$0B AI Software Market by 2030Grand View Research
0% Enterprise apps embedding AI agents by 2026Gartner projection

Most foundation models learn from text. Standard Intelligence is making a different bet: train a model that learns by watching software being used, pixels, clicks, scroll events, and interface interactions, and build generalization from there rather than from language.

The founding team is small enough and focused enough to stay close to the problem. Six people, $80M from Sequoia and Spark Capital, and Andrej Karpathy as an advisor. That is a very specific kind of conviction about a very specific problem. The FDM-1 release suggests they are moving faster than most people realize.

A pre-category bet in a market measured in trillions.

The honest answer about the market for computer-use foundation models is that it does not exist as a measured category yet. The AI software market broadly will reach $391B by 2030. The specific slice Standard Intelligence is after, models that understand software as interaction rather than description, has no clean analogue in any analyst report. That is the point. The interesting bets are always pre-category.

What makes the broader context relevant is the scale of what AI agents are being asked to do. Gartner projects that 40% of enterprise applications will embed AI agents by end of 2026, up from under 5% in 2025. Most of those agents are being built on top of text-trained models that were subsequently given eyes. Standard Intelligence is asking whether training from the ground up on what software actually looks like produces something different.

Where the main approaches differ.

The competitive frame here is not company versus company but approach versus approach. Most labs extend existing text models with vision capabilities. Standard Intelligence trains from the ground up on computer-use data. The difference in approach is the bet.

Approach
Trains from
scratch on pixels
Extends text
model
Code-agent
focused
Legacy
RPA
Standard IntelligenceThe subject
●
○
○
○
OpenAIComputer use via API
○
●
◐
○
AnthropicClaude computer use
○
●
◐
○
CognitionDevin code agent
○
◐
●
○
UiPath / legacyWorkflow automation
○
○
○
●

● Primary focus◐ Partial / secondary○ Not the bet

The state-space problem.

Text has finite vocabulary and well-understood structure. A computer screen at any given moment is essentially unbounded in what it can contain. The challenge of generalizing across arbitrary software environments, UI patterns, and interaction styles, without overfitting to any one of them, is unsolved at scale. That is what makes training from pixels genuinely different from fine-tuning a language model.

TEXT-TRAINED APPROACH TEXT CORPUS finite vocabulary LANGUAGE MODEL add vision later COMPUTER USE fine-tuned on pixels STANDARD INTELLIGENCE APPROACH PIXEL CORPUS unbounded state space FOUNDATION MODEL TRAINED FROM SCRATCH computer use as the primary signal, not a fine-tune
The key difference is where in the training pipeline computer-use data enters. Most labs add it late as a fine-tune. Standard Intelligence builds from it from the start, which changes what the model learns to pay attention to.

Having worked on quantizing and running models like Mistral-7B on GPU for production inference at Movius, I have a reasonable sense of the gap between a compelling research idea and something that actually ships. Six people doing this at the foundation model layer is not the obvious move. That is what makes it interesting to watch.

Most foundation models learn from text. Standard Intelligence is betting the computer screen is a better teacher.

What the bet actually is.

The question at the center of Standard Intelligence is whether training from the ground up on computer-use data produces models that generalize across software environments better than fine-tuning an existing language model on the same data. The hypothesis is yes, and FDM-1 is the first test of it. The honest answer is that nobody knows yet at scale.

What makes this bet legible is the team. Sequoia and Spark Capital do not write $80M checks to six-person teams without conviction about the approach, and Karpathy does not advise teams without a technical opinion. The question I keep sitting with is not whether the approach is interesting (it clearly is) but whether a small team can maintain the research velocity to stay ahead as every major lab piles into computer use from the other direction.

The question I keep sitting with Does training from pixels produce a meaningfully different model than extending a language model, or does the fine-tuning approach converge on the same capability with enough data? The answer will become clear in the next 18 months. If Standard Intelligence is right, they will have a substantial head start. If they are wrong, the big labs will have it covered and the team will need to find a different edge.