Essay · Jev, one week in
The model that never writes.
Jev answers closed questions in 100 milliseconds for $42 a billion tokens and cannot produce a sentence. I spent a week reading everything anyone has measured about it, and I think it is the first real inflection since the chat models. Here is what it is, and twenty businesses I would build on it.
On 15 September a company called TypeSafe came out of stealth with a model that does one thing every language model was built to avoid: it refuses to write. You hand it a JSON blob of state and a list of closed questions, and somewhere between 70 and 500 milliseconds later you get one typed answer per question with a probability attached.1 The founder, Diogo Almeida, co-wrote the InstructGPT paper that gave ChatGPT its training recipe, and his position on the thing he helped build is not subtle: "I'm one of the few people at OpenAI who actually hates on ChatGPT."2
The launch tweet did 38 million views in a week. Within six days there were 3,574 repositories on GitHub mentioning it, five open-source imitations, first-party packages from Vercel and LangChain, and a Hacker News thread at 1,927 points arguing about whether it was a revolution or a rebranded classifier.3 Both sides are right, which is the interesting part.
I run a lot of things at once: a live show, a few crypto products, an agent harness I build most of my software with, a scraper that reads 360 accounts every morning, a community bot, a personal site. Every one of them has a step where a program needs a judgement a person would make in a second. Until last week that judgement cost a chat model call: a few seconds, a few cents, and a JSON parse that fails one time in fifty. This piece is what changes when it costs a tenth of a second and a hundredth of a cent, and what I would build now that it does.
What it actually is
Three question types, one call, probabilities back. That is the whole product.
The API has two endpoints and the request has three fields: the state, the model, and a map of questions.4 A question is one of three kinds. A Noul is a yes/no proposition and comes back as a probability. A Choice is a set of named options, up to 255, and comes back as a full distribution plus the winner. A Score is an ordered set of described levels, up to ten, and comes back as a probability-weighted position on that scale. Nothing else exists. There is no free text out, no way to get one, and the founder says that is deliberate: strings are "not allowed at all", because that is what lets every answer be computed in parallel.2
Two properties of that call matter more than they look. Every question in a request is evaluated in parallel against the same state, so asking thirteen questions costs about the latency of one; TypeSafe measured the batch as twelve times cheaper and ten times faster than thirteen separate calls.4 And the question key is never shown to the model. urgent is for your code; the model reads only the instructions and the criteria.
How it works is undisclosed. No paper, no base model, no parameter count. What can be reconstructed from outside is convincing enough: a large pretrained transformer reads the state and the schema once, and for each question the final hidden state goes through the language-model head, only the logits for the allowed answers are kept, and a softmax turns them into probabilities. One forward pass per question over a shared cache. That explains all four headline properties at once. No generation, so it is fast. The answer is a softmax over permitted tokens, so the JSON is always valid. A softmax is a distribution, so you get probabilities free. Output tokens never exist, so they cost nothing.5 Archer Hume put about ten thousand calls through the API to confirm the shape: fifteen hundred questions on one short state still came back in a few hundred milliseconds, options are scored jointly rather than independently, and reversing the option order can move a probability from 0.84 to 0.95 on identical evidence.5
The training method has a name, Reinforcement Learning for Calibrated Decisions, and one sentence of description: the probabilities are optimised against outcomes so that higher confidence means higher accuracy. The data is entirely synthetic, which Almeida calls a better bet than RLHF itself.6 Sebastian Raschka's read is the one I trust: encoder classifiers have existed for years, but each was trained for its labels. What is new is a general one that reads arbitrary labels at request time, at roughly Flash-class comprehension, in a tenth of a second, and the moat is almost certainly the data rather than the algorithm.7
The honest numbers
The homepage says 193x faster and 444x cheaper. The measured version is smaller and still changes everything.
TypeSafe's own evaluation is unusually candid. Four real workflows, 711 cases, with GPT-6 Astra and Claude Fable 5.1 averaged as the reference answer. Jev scores 67.8% mean accuracy. GPT-5.6 Sol scores 74.1% and Claude Opus 5 scores 73.1%. So it is six points below the best models on judgement, level with Terra and Sonnet, at $0.0004 and 0.4 seconds per case where Opus costs $0.18 and 38 seconds.8 The 193x and 444x on the homepage are Jev against Sonnet on time and against Opus on cost, the worst point on each axis. Their own blog says these are "on the higher end of real world gains".
The independent measurements, all from the last six days, tell a consistent story, and the fair comparator is a Flash-class model rather than a frontier one.
| Who | Task | Jev | Comparator | Cost and speed |
|---|---|---|---|---|
| Bryo AI9 | 1,565 business emails, 10 categories | 96.4% | Gemini Flash-Lite 97.5% | $0.08 vs $0.80 per 1,000 |
| Emil Lindfors10 | Norwegian consultation responses, 11 questions each | level | DeepSeek V4.1 Flash | 6x cheaper, 0.32 s vs 2.7 s |
| Omar Mujahid11 | 49 tasks, ~8,200 items | won 42 of 49 | GPT-5.6 Luna | 105 ms vs 750 ms, a quarter of the cost |
| Good Start Labs12 | 6,003 rubric checks on financial research | 91.5% agreement with Fable | LLMs agree with each other 88 to 95% | $160 vs $33,000 per million checks |
| LangChain13 | Agent evals, 500 binary decisions | 500 of 500 matched the human oracle | LLM judges, 92 to 913x more variance | $0.34 for the run vs $28.17 |
| Pipecat14 | Voice command routing | 92.6% | GPT-5.6 Luna 81.3% | Luna's median was 1,008 ms |
| geckguy15 | Scam job ads, 1,000 with 53 scams | F1 0.31 | Fitted TF-IDF regression 0.70 | "Confidence is honest, ranking is weak" |
| Cua16 | Form-filling decisions | 83.6% | 706k-param trained specialist 99.7% | 260 ms hosted vs 8 ms local |
Read the last two rows as carefully as the first six. When you already own labelled data for a fixed task, a trained specialist still beats it. Jev wins when the labels change at runtime, or when there is no training set and never will be. That is most of the judgement in a small company.
The claim that worried me most was calibration, because the whole product is the threshold: act above it, ask a human below it. It holds, in every independent test that checked the top bucket. Bryo's 737 predictions at 99% confidence or above were all correct; below 70% nearly half were wrong. Lindfors found the 0.9 to 1.0 bin right 98% of the time and the 0.3 to 0.7 bin right 34%. Hume measured an expected calibration error of 0.031 on twelve hundred MMLU items.9105 Two studies on their own distributions found worse overall error, 0.11 and 0.14, so you measure it on your data before you trust it. But the shape is real: when it says 0.95 it is right about 95 times in a hundred, and that is the property nobody has been able to buy from a chat model at any price.
And the failures, which TypeSafe lists on a page called "model jaggedness" with a fix beside each one.17 It reads literally. It cannot add, count, or compare dates. It gets worse as you pad the state with things the question does not need. It does not treat the state as hostile, so a message saying "ignore your instructions" can move the answer. A proposition and its negation do not sum to one; their own numbers give 1.19. It is not deterministic, only consistent, and it cannot reason: in a solver-verified poker test it shoved with the nuts sixteen times out of sixteen in a spot where the answer is to check, and a form-filling agent built on it alone completed zero of thirteen steps.18 "Zero hallucination" means the JSON is always valid and nothing else. As Armin Ronacher put it, "it delegates the hallucination problem a little bit to the user."6
LLMs create. Code executes. Jev decides. The whole design space is the arrows between those three.
Why this is an inflection and not a feature
The test I use before I let myself get excited about a technology.
Mike Maples has a four-question test for whether something is a real turning point or just an improvement curve, and the fourth question is the one everybody skips.19 Here it is, applied.
What is the specific new thing? A general-purpose judge that reads labels defined at request time, returns a calibrated probability, and costs four hundredths of a cent and a tenth of a second per decision. Classifiers existed. Cheap classifiers existed. A general one with honest confidence, at a price where you never ask "should we run the model on this", did not exist on 14 September.
Who does it newly empower, and how? The person or the two-person team who has judgement-shaped work at volume and no team to do it: moderation, triage, review, scoring, ranking, verification. Until last week that work was priced in human hours or in chat-model seconds, and both prices meant you did it on a sample. Now you do it on everything, continuously, and the marginal decision is free. The Good Start Labs number is the cleanest version: grading a million research answers went from $33,000 to $160.12 That is a queue that was staffed becoming a queue that is computed.
Under what conditions is it realised? The question has to be closed. The input has to be text. Somebody has to write fifty labelled examples to set the threshold, and that somebody has to understand the domain well enough to write criteria a literal reader cannot misread. The struggle has to exist already, visibly, in public: people complaining about the queue, paying for the queue, quitting because of the queue.
Under what conditions might it not be? Four that I can name. OpenAI or Anthropic ship a decisions endpoint on their small models, which the Hacker News consensus expects within months, and every Jev integration becomes a config change; that commoditises the model and leaves the products standing. The $42 price turns out to be subsidised; TypeSafe says it can serve profitably and admits it cannot prove it.1 Calibration fails on your distribution, which you find out for two dollars. And the servers are US-only with no EU option, which kills anything touching regulated European data until that changes.
It passes. The commoditisation risk is the real one, and it cuts the right way: if the model becomes a commodity, the value is in knowing which decisions to ask and how to write them, and that is exactly the part that takes domain knowledge. Which brings me to the part of this I am actually qualified to write.
Where I am standing
Ideas are only good for the person who has them. This is the ground I generated from.
Saras Sarasvathy studied thirty expert founders working the same product idea and watched them build companies in eighteen different industries. The idea did not determine the business. The founder's means did: who they were, what they knew, whom they knew.20 So before the list, the means, from the record rather than from my opinion of myself.
Nine years of commits across 109 projects. Scraping and data pipelines since the first year and never stopped: twenty projects. AI on twenty-five projects, all since 2023, and most of what I do now is agent harnesses, the machinery that makes coding agents produce work I would sign. Blockchain on fifteen, trading on thirteen, reverse engineering on six. Two live shows' worth of broadcast tooling built this year. Communities I can reach: a handful of crypto Telegram groups, some of them large, a Solana builder chapter I do work for, and the audience of a weekly show about what is real in crypto that I am building the studio for. And a temperament I have written down enough times to trust: I am better at optimising inside boundaries that already exist than at inventing new ones, and I want to be new by a small margin.
That narrows the search to three lanes, and I generated inside them rather than in the abstract. Every idea below names the input that produced it: an observed complaint, a distortive process people endure, a purchase that is already happening. If an idea could have occurred to anyone who read the launch post, I cut it. Paul Graham's rule: "if all you know about a startup idea is that it sounds plausible, you have to assume it's bad."21
Twenty things I would build
Each carries the input it came from, who wants it badly, the next test that is cheaper than building, and what kills it.
Communities and chats
Where I already have the data and the people
The input for this lane is the most-repeated complaint in every crypto group I am in: the mods are volunteers, the scammers are not, and a group above a few thousand members is a full-time job nobody is paid for. Someone on X fed 10,208 WhatsApp messages to Jev and had the scam messages flagged in 32 seconds for six and a half cents.22 A Twitch chat filter runs at nine cents an hour on the busiest stream.23 That is the price of moderation now.
-
01
The community operating system
A Telegram and Discord bot that scores every message on five propositions (spam, scam link, harassment, off-topic, wallet solicitation) and one severity scale, and applies a policy the admin writes in plain language. Every pardon of a false positive becomes a precedent fed back into the criteria, so it learns the group's culture without anyone training anything. On top of that, member scoring: who is engaged, who is drifting, who is a helper, who is a newcomer who needs a nudge. The weekly health report writes itself from the scores.
- Input
- Volunteer mods burning out; a working Discord reference already on GitHub with the pardon loop built in
- Desperate
- Anyone running a 5,000-plus member token or builder community. They will use a rough v1 from a stranger because the alternative is doing it at 3am
- Next test
- Export one real group's last month, run the scam and spam questions, show the admin the false-positive rate on a page. Sell it before the bot exists
- Kills it
- Adversarial text. Scammers write prompt injections; the model does not treat state as hostile. Mitigation is state hygiene plus a second opinion above a threshold, and it has to be measured on hostile data
-
02
Morning triage for people who run too many groups
Overnight, every message across every group gets four questions: needs me, about a deal, about a person I track, urgency. One calm screen in the morning with the five things that need you. The LLM writes five one-line summaries at the end; everything before it is Jev and a sort.
- Input
- My own 200 groups; the distortive process is scrolling all of them before coffee
- Desperate
- Founders and BD people in crypto with a hundred-plus active chats
- Next test
- Fifty of my own messages hand-labelled. If the 0.9 bin is right, ship it to five founders
- Kills it
- Telegram's own terms on reading user history, and whether people will connect an account
-
03
Onboarding that routes instead of welcoming
A newcomer's first three messages classified for intent (builder, investor, job seeker, tourist, bot) and routed to the right sub-channel, person or resource, with a confidence gate so the bot only acts when it is sure.
- Input
- A builder chapter where the welcome message is the same for everyone and nobody reads it
- Desperate
- Chapter leads who lose good builders in week one
- Next test
- Classify last month's newcomers by hand and by Jev; compare
- Kills it
- Three messages may be too few to know anything
-
04
Grep for your own history
Search your Telegram, WhatsApp and email by proposition rather than keyword, with real boolean operators. "Someone offered me work" AND NOT "I declined". One person built this as a command-line tool for logs in a single Node file.24 An embedding puts "I want a refund" and "your refund was processed" next to each other; a proposition scores them 0.98 and 0.10.
- Input
- My own searches for a deal I half remember; the tool that exists
- Desperate
- Anyone who has ever lost a lead in a chat scrollback. Honestly, not sure they are desperate enough. Marked as a tool first
- Next test
- Wrap the existing tool around my Telegram export; use it for a week
- Kills it
- Cost scales with history size; a full re-scan on every query is wrong, so it needs a cache and a design
Attention and markets
Where I have been scraping for nine years
The input here is a distortive process I know from the inside: people spend eighteen hours a day on X to catch a narrative before a token attaches to it, and pay for alpha groups that do the same thing with a worse hit rate. I already read 360 accounts every morning for five cents. Scoring every one of those tweets on three questions costs about four cents more. One warning first: every "Jev trading bot" on X feeds it an order book and asks buy or sell, and that is the numeric, multi-step shape it is measurably worst at. Nobody has published a backtest. The defensible use is classifying text into typed features and leaving the decision to the maths.
-
05
Narrative radar
An hourly pipeline that scores the entire X firehose from a curated roster on propositions like "a nameable narrative is forming here", "a token has not attached yet", "this account is early rather than late", and kills 99.8% of what comes back before a person or a bigger model looks at it. The output is a daily brief with the ten things worth a second look and the probabilities beside them. Sold as a subscription, published in public for the first month so the hit rate is on record.
- Input
- My own scraper and my own eighteen-hour days; alpha groups people already pay for
- Desperate
- Traders who pay $100 a month for a Telegram group with a worse signal. They are hostile to it, which is the right sign
- Next test
- Run it for two weeks, publish every call with its timestamp, count subscribers at the end
- Kills it
- The brief is only as good as the roster, and rosters rot. And if the hit rate is public and bad, that is the end
-
06
Semantic features for quants
Score a million tweets, headlines or on-chain event descriptions on twenty described dimensions once, and sell the columns. A quant fund gets twenty semantic features per asset per hour without an NLP team. TypeSafe's own cookbook trains a CatBoost model on Jev outputs; this is that as a data product.
- Input
- The scraper I already run; the feature-discovery cookbook
- Desperate
- Small quant shops without an NLP hire. Not sure yet; needs a conversation with two of them
- Next test
- Offer one fund one month of one feature for free and ask what they would pay
- Kills it
- Funds want the raw data and the method, not the columns
-
07
The reply desk
For someone building a presence on X: every hour, which tweets in your niche are worth replying to (scored against your written persona), and whether an LLM-drafted reply sounds like you (scored against your voice rules). Writing the criteria is writing the persona, which is the part most people never do.
- Input
- My own stalled attempt at exactly this; the 3,282-post self-analysis someone ran for $0.1325
- Desperate
- Founders told to "build in public" who hate it
- Next test
- Run it on my own account for two weeks and watch replies per hour spent
- Kills it
- X's rate limits and rules on automation; the line between assisted and automated is thin
-
08
Feed filters as a product
A browser extension that labels every post in your feed on the propositions you write (substance, humour, promo, AI-written, bait) and hides what you say to hide. Three people built rough ones in the first week.26 The one that wins is the one with the best default rule sets per niche.
- Input
- The three extensions that exist; my own drains list has "Twitter FOMO" on it
- Desperate
- Mild. This is the plausible-sounding one on the list and I am flagging it as such
- Next test
- Install one, use it a week, see if I keep it
- Kills it
- Platforms break extensions; nobody pays for a feed filter
Live shows and content
Where the latency is the product
The input is what I see every week running a live show: the host says "we need to find that tweet", and someone alt-tabs for ninety seconds while the show waits. Every graphic on screen is a screenshot because finding and retypesetting the source takes too long. Chat scrolls past unread. All of that is a decision that has to happen inside a sentence, and until now nothing could make it.
-
09
The standby researcher
An agent that listens to the live transcript. Every sentence gets one question, "is this a request to find something", and a Choice on what kind: tweet, article, token, chart, person. Above a threshold, it goes and finds it, ranks the twenty candidates against the transcript excerpt, and puts the top three on the operator's desk as proposed cards. One click sends it to program, retypeset, with the source. The search and the planning are an LLM's job; the two fast decisions in the loop are Jev's, and they are what let the card appear before the sentence is finished.
- Input
- My own show, every week; the voice-controlled browser someone built in ~300 ms per decision27
- Desperate
- Anyone producing a live show with a co-host and no producer. That is most of them
- Next test
- Wire the wake-word question to a transcript from last week's episode and count the asks it catches
- Kills it
- Transcription latency, which is the slow part now
-
10
Chat on air, safely
Every viewer message scored for "worth putting on screen", "safe to show" and "names a ticker", fast enough to run per message, so the overlay picks the best question from chat without a human reading chat.
- Input
- The Twitch filter at $0.09 an hour; my own overlay that needs it
- Desperate
- Streamers with a mod who is also the co-host
- Next test
- Run it on one episode's chat log; count what it would have surfaced
- Kills it
- A single unsafe message on air. The safe-to-show threshold is the whole product
-
11
The receipts meter
A live meter over any video where every sentence is scored for "claim", "verifiable", "supported by what is on screen", rendered as an overlay you can post. Someone built the rough version and scores a full debate for five cents.28 For a show whose whole premise is testing claims in public, this is a format, ready-made.
- Input
- The tool that exists; a show built around stamping what is real
- Desperate
- Nobody is desperate for this. It is a format, and formats are judged by whether people share the clip
- Next test
- One clip, posted, watched for shares
- Kills it
- It cannot verify; it can only judge whether a claim is the kind that could be. Say so on screen or it is dishonest
-
12
The pre-publish gate
A prose linter for teams that publish a lot: countable rules run locally, judgement rules go to Jev one paragraph at a time. Closer restates the paragraph, stacked hedges, the not-X-but-Y turn, a cost figure with no source. One that exists flags 1 of 54 clean paragraphs where a chat model flagged 37.29 Sold to content teams drowning in their own AI output.
- Input
- I run every word I publish through a writing standard; the tool exists as a CLI
- Desperate
- Agencies shipping AI-assisted copy who have been burned once
- Next test
- Run my own rules over my last twenty pages; count what I would have changed
- Kills it
- Grammarly adds it as a feature
The software factory
Where I spend most of my hours
The input is the agent harness I build with every day and the thing everyone who runs coding agents complains about: the agent says "done" and it is not done. Vercel measured Jev against the safety reviewer in their coding agent, found it up to 18x faster at p95 and more accurate than the small GPT they were running, and said it is likely to become the default.30 TypeSafe's own staff say the obvious coding use is not writing code but "how does this score against this AGENTS.md".2 Five hook points in Claude Code were filled with Jev within a week: permission gating, output pruning, skill routing, completion verification, compaction. One of those five, compaction, is a mistake in Claude Code specifically, because the judge cannot see the tool result it is judging and every history edit invalidates the prompt cache.31 The other four are right.
-
13
The foreman
A supervisor that watches every coding agent in a fleet and scores each turn on propositions the agent cannot judge about itself: implementation complete, tests sufficient, drifting from the brief, stuck, claiming done without evidence, touched a file it should not. Code decides continue, steer, stop or verify. One open-source version exists and calls itself "an architectural experiment", which is honest.32 The product is the same thing with the gates written by someone who has run a factory, sold to agencies who bill for agent output and eat the cost of unverified work.
- Input
- My own harness, which already asks two questions before every task and could ask fourteen on every diff for $0.00007
- Desperate
- Agencies running five-plus coding agents a day who have shipped an agent's mistake to a client once
- Next test
- Run the gates on my own last hundred agent sessions; count how many "done" claims fail
- Kills it
- Anthropic and OpenAI build it into the harness, which they will. The window is the eighteen months before they do it well
-
14
Evals for every output
An LLM judge at five cents a case is why nobody evaluates continuously. At $0.0004 a case, every output of every agent gets scored against its brief, every time. LangChain measured Jev-as-judge at 500 of 500 against a human oracle with variance a hundred to a thousand times lower than LLM judges.13 Sold as a dashboard, or given away to sell the foreman.
- Input
- The LangChain result; every "did the agent do what I asked" I ask by hand
- Desperate
- Same buyer as the foreman
- Next test
- Score a week of my own agent output; see whether the scores predict which ones I rejected
- Kills it
- A judge that shares the generator's blind spots. One RAG test found Jev agreed with every wrong answer at 0.82 to 1.0 confidence.33 Give the checker evidence, never just the claim
-
15
Taste as a service
An optimiser needs a fast, cheap, consistent scorer, and Jev is one. Given fifty labelled examples of what a client considers good, evolve their agents' system prompts, skills and rules until the outputs match, scored thousands of times for cents. A tool that does this for Jev's own prompts already exists.34 Pointing it at everything else is the business.
- Input
- The specialist agents I build from named practitioners; the jev-align tool
- Desperate
- Teams whose agents are "fine" and cannot say why they are not great
- Next test
- Optimise one of my own skill files against twenty of my own verdicts; measure the before and after
- Kills it
- Overfitting to fifty examples and calling it taste
-
16
Is this repo safe to run
Before an agent clones and executes a dependency or a skill, score the source on propositions: exfiltrates secrets, obfuscated, network calls it should not need, install script does more than install. One rough version exists.35 The market is every team letting agents install things.
- Input
- The supply-chain attacks on agent skills this year; the existing scanner
- Desperate
- Security teams at companies where developers run agents with install permissions
- Next test
- Run it over the 3,574 Jev repos and see what it flags; publish the result
- Kills it
- Static analysis companies do it better, if they bother
Small businesses and services
Where the queue used to be a person
The input here is a purchase that is already happening. A marketing founder wrote that an agent auditing a client's SEO and AI-search visibility cost her about $250 to run and that Jev cut the price of the reads by 90%.36 An outbound team gated 462 leads through 7,068 decisions in 47 seconds for six cents and never emailed 190 of them because the fit was wrong.37 A tax firm classified 261 form types at $0.001 a page with zero errors on 314 filled pages and a confidence gate holding back the 5% of blank pages it was unsure of.38 Each of those was a person's afternoon a month ago.
-
17
The autonomy dial
A WhatsApp assistant for a service business, a boat tour operator say, that answers in the customer's language, holds a booking, and escalates to a human. The product is the dial: because every answer carries a calibrated probability, "how much may the bot do alone" becomes a slider the owner holds instead of a policy the vendor ships. It acts above the line and asks below it, and the owner moves the line as trust grows. I have run the bot half of this for real customers; the dial is the part that makes it a product rather than a project.
- Input
- A tour operator I have built for; the intent-routing and confidence-gating patterns in TypeSafe's own docs
- Desperate
- Owner-operators answering WhatsApp at midnight in a second language. Very
- Next test
- Put the dial in front of the one operator who already uses the bot; watch where they set it and whether they move it
- Kills it
- WhatsApp Business API costs and approval; the bot is cheap, the channel is not
-
18
The $25 audit
The SEO and AI-visibility audit that costs $250 in agent time and a day of a junior's reading, as a self-serve product at a tenth of the price: which pages the AI search engines cite and why, where the gaps are, what to fix first, every judgement scored and thresholded so the report only says what it is sure of.
- Input
- The $250 number, stated by someone selling the audit; the "who ChatGPT cites" tooling that exists
- Desperate
- Agencies with fifty small clients who cannot afford the manual version per client
- Next test
- Run one audit on my own site by hand and by pipeline; compare what each found
- Kills it
- It is a crowded market and the thesis has to be more precise than "cheaper". Mine is: the confidence gate makes it honest where the incumbents pad
-
19
Applications, screened
A hackathon gets four hundred applications and three reviewers. A grants programme gets a thousand. Score every one against the brief on ten propositions, rank, and hand the reviewers the top fifty and the twenty the model was unsure of. The reviewers read forty instead of four hundred and the ones they read are the right ones.
- Input
- A builder chapter I work with running exactly this queue; candidate-to-job matching someone ran at 400 companies in 12 seconds
- Desperate
- The three reviewers, the week before the deadline
- Next test
- Score last cohort's applications and compare to who actually got in
- Kills it
- Fairness. A screen that is 90% right rejects 10% of people wrongly, and the unsure band has to be wide enough to catch them
-
20
Plain-language columns for any database
WHERE jev(customers, 'is likely to churn this quarter'). Postgres and DuckDB extensions doing this exist at a few hundred stars each.39 The product is the hosted version with caching, cost controls and an audit trail, for the analyst who cannot get an ML engineer's time.- Input
- The extensions; every ops person I know with a spreadsheet and a question
- Desperate
- Analysts at companies too small for a data science team
- Next test
- Use the Postgres one on my own data for a week
- Kills it
- Snowflake and Databricks ship it as a function. Probably this quarter
The ideas that need a different frame
Five things that fall out of the primitives rather than the marketing list.
Everything above is a queue with Jev at the front of it, which is the frame Greg Isenberg gave and the one most of the first week's builds fit.40 Five things do not fit it, and they are the ones I keep thinking about.
Ask the whole decision tree at once. Because two hundred questions cost the latency of one, you can evaluate every branch of a workflow speculatively and let code walk the tree afterwards. An agent that makes six sequential model calls to plan a step can ask all six on the current state in one call and only wake the expensive model at the leaf that needs prose. This is why the browser agents went from ten seconds a step to under two hundred milliseconds.41 Any workflow with a chain of small decisions is a candidate, and most business software is that.
Judge the program, not the text. Almost every demo feeds Jev a message. Feed it your application's internal state instead: the task queue, the last five agent turns, the board. "Which task is stalled." "Which agent is going in circles." It reads JSON as well as prose, and that turns monitoring from a dashboard someone has to look at into a decision the system makes.
Filter instead of summarise. Any "summarise this history" step can become "score and drop from this history", which is faster, cheaper and never paraphrases. The Claude Code plugin that did this got the implementation wrong, but Almeida endorsed the direction: freeing agents from designing around the cache.31 Wherever you own the harness, it is the right primitive.
Ambient interfaces. Keystroke latency means a UI can ask a question per keystroke. A launcher where "the pdf I just downloaded" is already the top hit, a paste that knows what it is and where it goes, a find-in-page that finds meaning. Caleb's line on the video explainer stuck with me: it "almost feels like we're back to logic gates and registers, and now we have to build many abstractions on top."42 The abstractions are the products.
Score everything, always. At this price the question is never whether to run the model but what you would do with the answer. Every tweet, every message, every commit, every log line, every note, scored on the questions that matter this month, continuously. The scoring is nearly free. The discipline is writing the questions and then not building a dashboard on top of them.
Which ones I would bet on
Ranked by affordable loss and by whether anyone is hostile to it, which is the sign.
Three, in order, and the reasoning is the same for each: I already have the data pipeline, I already have the people who would use a bad first version, and the test costs a weekend.
The community operating system first, because the desperation is highest, the reference implementation exists, and I am in the groups. A moderation product is boring and has competitors, which Y Combinator would tell you are two of the three properties that make an idea look bad and therefore good.43 The thesis everyone in that market has missed is the pardon loop: a bot that learns each group's culture from its admin's corrections, without a training run, is something the incumbents cannot do because they were built before a model could read runtime-defined labels.
The foreman second, because it is the thing I would build for myself regardless, and the window before the labs do it well is real but short. It is also the one where being wrong costs the most, which is why the first hundred sessions are my own.
Narrative radar third, because traders are hostile to it, the pipeline is already running, and publishing the hit rate in public for a month is a test that cannot be argued with. If the record is bad, I will have learned it for the cost of the scraping I already pay for.
The rest stay on the shelf as tools until one of them makes someone angry.
How this goes wrong
The ways I would talk myself out of the above, in advance.
Starting from the technology. Every idea here began as "Jev exists, what could I do with it", which is the failure mode called solution-first, and I know it. The defence was to insist on a named input for each: a complaint I have heard, a process I have watched people endure, a purchase that is already being made. Four of the twenty I flagged as weak on exactly that test, and I left them in so you can see the difference.
Treating a Flash-class judge as an oracle. It is six points below the best models. Anything where one wrong answer is expensive and nobody will look needs the confidence gate, and the gate needs fifty labelled examples from your own data before it means anything. Two dollars and an afternoon. Skip it and you have built a machine for being confidently wrong at scale.
Forgetting the clones. Five open imitations shipped in 72 hours, and the labs will follow. Nothing here depends on TypeSafe surviving. Everything depends on knowing which questions to ask, in what words, with what threshold, for a group of people you can reach. That is the part that does not commoditise.
Building the system instead of the thing. My own worst habit, and this technology feeds it: it is very cheap to score everything and very tempting to build the dashboard that shows the scores. Every idea above has a test that is cheaper than building, and the rule I am holding myself to is that the test runs before the repo is created.
What I am doing first
Fifty messages from my own groups, hand-labelled. One question. Bin the confidence against the labels. If the top bin is right, the community bot has its first gate and I start selling it to the admins I already know. If it is wrong, I have learned the most important thing about this model for the price of a coffee, and the twenty ideas above get re-read with that in mind.
The model that never writes turns out to be the one that finally lets software decide. Whether that is a revolution or a rebranded classifier depends on what you build on it, and building is the part I am good at.
Sources
Every number above is somebody's measurement. These are the somebodies.
- TypeSafe, "Introducing System One Models & Jev", 15 Sep 2026. typesafe.ai
- Diogo Almeida, AI Engineer talk "Why RLCD beats RLHF" (Jul 2026), and answering as CompleteSkeptic on the HN launch thread. news.ycombinator.com
- GitHub, 3,574 non-fork repositories created 14 to 20 Sep matching Jev or TypeSafe, counted by per-day paginated search. Star counts as of 20 Sep 23:30 UTC.
- TypeSafe docs: API reference, primitives, parallel-questions cookbook. docs.typesafe.ai
- Archer Hume, "Jev's Architecture Unmasked", ~10,000 API calls. archerhume.com · Niels Rogge's mechanism explainer. x.com
- TechCrunch, Tim Fernholz interviewing Almeida and Armin Ronacher, 18 Sep 2026. techcrunch.com
- Sebastian Raschka on X, 20 Sep 2026. x.com
- TypeSafe workflow evals, four workflows, 711 cases, raw data in the page source. evals.typesafe.ai
- Nikhil Mudholkar, Bryo AI, 1,565 emails. x.com
- Emil Lindfors, "A first look at TypeSafe's Jev". lindfors.no
- Omar Mujahid, jev-decision-bench, 49 tasks. reddit.com
- Good Start Labs, "Verification is the bottleneck". goodstartlabs.com
- LangChain, "Jev-as-a-Judge for Agent Evals", 20 Sep 2026. langchain.com
- Jon Taylor via Kwindla Kramer, Pipecat operator comparison. x.com
- geckguy, scam job ads. reddit.com
- Cua, CUA-S1-FORMS, Show HN. news.ycombinator.com
- TypeSafe docs, "Model jaggedness, jev-1.13", reviewed 17 Sep 2026. docs.typesafe.ai
- backnotprop, solver-verified poker eval. backnotprop.com · HelmDeck form-filling benchmark. reddit.com
- Mike Maples Jr., the four-question inflection test, from his talks on pattern breakers. Quoted from machine transcripts; the mechanism is reliable, the exact wording is not.
- Saras Sarasvathy, "What makes entrepreneurs entrepreneurial?", the think-aloud study of 30 expert founders.
- Paul Graham, "How to Get Startup Ideas". paulgraham.com
- itscellou, 10,208 WhatsApp messages in 32 s for $0.065. x.com
- ethanplusai, Twitch chat filter at ~$0.09 an hour, r/vibecoding.
- uehaj, jev-semgrep. x.com
- 3,282 X posts scored on 8 questions for $0.1282, relayed by Nate B. Jones. x.com
- bohutang/sift, DDnim/jev-tweet-radar, elliothux/tweet-911 on GitHub.
- Moritz Kremb, jev-voice-browser. github.com
- ChetasLua/jevmeter. github.com
- DanRWilloughby/snifftest. github.com
- Guillermo Rauch on fx's safety reviewer, 16 Sep 2026. x.com
- Theo Browne on the compaction plugin, and Almeida's reply. x.com
- thruwire/foreman. github.com
- aryanchauhan, SQuAD 2.0 re-ranking and checking experiment, r/Rag. reddit.com
- sutro-sh/jev-align. github.com
- luantak/is-malicious. github.com
- Ira Bodnar, Ryze AI, 18 Sep 2026. Note that Ryze's own blog states it does not run Jev in production as of 19 Sep; the $250 is her stated cost of the existing audit. x.com
- Getlead, 462 leads gated. reddit.com
- kyotofin/tax-doc-classifier, reproducible with
pnpm eval. github.com - realZachi/pg-jev and Hamilton Ulmer's DuckDB extension. github.com
- Greg Isenberg, "find an expensive queue and put Jev at the front of it". x.com
- browser-use/jev-ultrafast, performance notes: median 178 ms per call. github.com
- Caleb Writes Code, "Jev explained in 7min", 19 Sep 2026. youtube.com
- Y Combinator, "How to Get and Evaluate Startup Ideas": hard to start, boring, has competitors.