Skip to content

Writing21 Sep 2026

Essay · Jev, one week in

The model that never writes.

Jev answers closed questions in 100 milliseconds for $42 a billion tokens and cannot produce a sentence. I spent a week reading everything anyone has measured about it, and I think it is the first real inflection since the chat models. Here is what it is, and twenty businesses I would build on it.

By David25 min readSources at the end

On 15 September a company called TypeSafe came out of stealth with a model that does one thing every language model was built to avoid: it refuses to write. You hand it a JSON blob of state and a list of closed questions, and somewhere between 70 and 500 milliseconds later you get one typed answer per question with a probability attached.1 The founder, Diogo Almeida, co-wrote the InstructGPT paper that gave ChatGPT its training recipe, and his position on the thing he helped build is not subtle: "I'm one of the few people at OpenAI who actually hates on ChatGPT."2

The launch tweet did 38 million views in a week. Within six days there were 3,574 repositories on GitHub mentioning it, five open-source imitations, first-party packages from Vercel and LangChain, and a Hacker News thread at 1,927 points arguing about whether it was a revolution or a rebranded classifier.3 Both sides are right, which is the interesting part.

I run a lot of things at once: a live show, a few crypto products, an agent harness I build most of my software with, a scraper that reads 360 accounts every morning, a community bot, a personal site. Every one of them has a step where a program needs a judgement a person would make in a second. Until last week that judgement cost a chat model call: a few seconds, a few cents, and a JSON parse that fails one time in fifty. This piece is what changes when it costs a tenth of a second and a hundredth of a cent, and what I would build now that it does.

01

What it actually is

Three question types, one call, probabilities back. That is the whole product.

The API has two endpoints and the request has three fields: the state, the model, and a map of questions.4 A question is one of three kinds. A Noul is a yes/no proposition and comes back as a probability. A Choice is a set of named options, up to 255, and comes back as a full distribution plus the winner. A Score is an ordered set of described levels, up to ten, and comes back as a probability-weighted position on that scale. Nothing else exists. There is no free text out, no way to get one, and the founder says that is deliberate: strings are "not allowed at all", because that is what lets every answer be computed in parallel.2

Two properties of that call matter more than they look. Every question in a request is evaluated in parallel against the same state, so asking thirteen questions costs about the latency of one; TypeSafe measured the batch as twelve times cheaper and ten times faster than thirteen separate calls.4 And the question key is never shown to the model. urgent is for your code; the model reads only the instructions and the criteria.

How it works is undisclosed. No paper, no base model, no parameter count. What can be reconstructed from outside is convincing enough: a large pretrained transformer reads the state and the schema once, and for each question the final hidden state goes through the language-model head, only the logits for the allowed answers are kept, and a softmax turns them into probabilities. One forward pass per question over a shared cache. That explains all four headline properties at once. No generation, so it is fast. The answer is a softmax over permitted tokens, so the JSON is always valid. A softmax is a distribution, so you get probabilities free. Output tokens never exist, so they cost nothing.5 Archer Hume put about ten thousand calls through the API to confirm the shape: fifteen hundred questions on one short state still came back in a few hundred milliseconds, options are scored jointly rather than independently, and reversing the option order can move a probability from 0.84 to 0.95 on identical evidence.5

The training method has a name, Reinforcement Learning for Calibrated Decisions, and one sentence of description: the probabilities are optimised against outcomes so that higher confidence means higher accuracy. The data is entirely synthetic, which Almeida calls a better bet than RLHF itself.6 Sebastian Raschka's read is the one I trust: encoder classifiers have existed for years, but each was trained for its labels. What is new is a general one that reads arbitrary labels at request time, at roughly Flash-class comprehension, in a tenth of a second, and the moat is almost certainly the data rather than the algorithm.7

02

The honest numbers

The homepage says 193x faster and 444x cheaper. The measured version is smaller and still changes everything.

TypeSafe's own evaluation is unusually candid. Four real workflows, 711 cases, with GPT-6 Astra and Claude Fable 5.1 averaged as the reference answer. Jev scores 67.8% mean accuracy. GPT-5.6 Sol scores 74.1% and Claude Opus 5 scores 73.1%. So it is six points below the best models on judgement, level with Terra and Sonnet, at $0.0004 and 0.4 seconds per case where Opus costs $0.18 and 38 seconds.8 The 193x and 444x on the homepage are Jev against Sonnet on time and against Opus on cost, the worst point on each axis. Their own blog says these are "on the higher end of real world gains".

The independent measurements, all from the last six days, tell a consistent story, and the fair comparator is a Flash-class model rather than a frontier one.

WhoTaskJevComparatorCost and speed
Bryo AI91,565 business emails, 10 categories96.4%Gemini Flash-Lite 97.5%$0.08 vs $0.80 per 1,000
Emil Lindfors10Norwegian consultation responses, 11 questions eachlevelDeepSeek V4.1 Flash6x cheaper, 0.32 s vs 2.7 s
Omar Mujahid1149 tasks, ~8,200 itemswon 42 of 49GPT-5.6 Luna105 ms vs 750 ms, a quarter of the cost
Good Start Labs126,003 rubric checks on financial research91.5% agreement with FableLLMs agree with each other 88 to 95%$160 vs $33,000 per million checks
LangChain13Agent evals, 500 binary decisions500 of 500 matched the human oracleLLM judges, 92 to 913x more variance$0.34 for the run vs $28.17
Pipecat14Voice command routing92.6%GPT-5.6 Luna 81.3%Luna's median was 1,008 ms
geckguy15Scam job ads, 1,000 with 53 scamsF1 0.31Fitted TF-IDF regression 0.70"Confidence is honest, ranking is weak"
Cua16Form-filling decisions83.6%706k-param trained specialist 99.7%260 ms hosted vs 8 ms local

Read the last two rows as carefully as the first six. When you already own labelled data for a fixed task, a trained specialist still beats it. Jev wins when the labels change at runtime, or when there is no training set and never will be. That is most of the judgement in a small company.

The claim that worried me most was calibration, because the whole product is the threshold: act above it, ask a human below it. It holds, in every independent test that checked the top bucket. Bryo's 737 predictions at 99% confidence or above were all correct; below 70% nearly half were wrong. Lindfors found the 0.9 to 1.0 bin right 98% of the time and the 0.3 to 0.7 bin right 34%. Hume measured an expected calibration error of 0.031 on twelve hundred MMLU items.9105 Two studies on their own distributions found worse overall error, 0.11 and 0.14, so you measure it on your data before you trust it. But the shape is real: when it says 0.95 it is right about 95 times in a hundred, and that is the property nobody has been able to buy from a chat model at any price.

And the failures, which TypeSafe lists on a page called "model jaggedness" with a fix beside each one.17 It reads literally. It cannot add, count, or compare dates. It gets worse as you pad the state with things the question does not need. It does not treat the state as hostile, so a message saying "ignore your instructions" can move the answer. A proposition and its negation do not sum to one; their own numbers give 1.19. It is not deterministic, only consistent, and it cannot reason: in a solver-verified poker test it shoved with the nuts sixteen times out of sixteen in a spot where the answer is to check, and a form-filling agent built on it alone completed zero of thirteen steps.18 "Zero hallucination" means the JSON is always valid and nothing else. As Armin Ronacher put it, "it delegates the hallucination problem a little bit to the user."6

LLMs create. Code executes. Jev decides. The whole design space is the arrows between those three.

The pattern every serious user converged on within four days
03

Why this is an inflection and not a feature

The test I use before I let myself get excited about a technology.

Mike Maples has a four-question test for whether something is a real turning point or just an improvement curve, and the fourth question is the one everybody skips.19 Here it is, applied.

What is the specific new thing? A general-purpose judge that reads labels defined at request time, returns a calibrated probability, and costs four hundredths of a cent and a tenth of a second per decision. Classifiers existed. Cheap classifiers existed. A general one with honest confidence, at a price where you never ask "should we run the model on this", did not exist on 14 September.

Who does it newly empower, and how? The person or the two-person team who has judgement-shaped work at volume and no team to do it: moderation, triage, review, scoring, ranking, verification. Until last week that work was priced in human hours or in chat-model seconds, and both prices meant you did it on a sample. Now you do it on everything, continuously, and the marginal decision is free. The Good Start Labs number is the cleanest version: grading a million research answers went from $33,000 to $160.12 That is a queue that was staffed becoming a queue that is computed.

Under what conditions is it realised? The question has to be closed. The input has to be text. Somebody has to write fifty labelled examples to set the threshold, and that somebody has to understand the domain well enough to write criteria a literal reader cannot misread. The struggle has to exist already, visibly, in public: people complaining about the queue, paying for the queue, quitting because of the queue.

Under what conditions might it not be? Four that I can name. OpenAI or Anthropic ship a decisions endpoint on their small models, which the Hacker News consensus expects within months, and every Jev integration becomes a config change; that commoditises the model and leaves the products standing. The $42 price turns out to be subsidised; TypeSafe says it can serve profitably and admits it cannot prove it.1 Calibration fails on your distribution, which you find out for two dollars. And the servers are US-only with no EU option, which kills anything touching regulated European data until that changes.

It passes. The commoditisation risk is the real one, and it cuts the right way: if the model becomes a commodity, the value is in knowing which decisions to ask and how to write them, and that is exactly the part that takes domain knowledge. Which brings me to the part of this I am actually qualified to write.

04

Where I am standing

Ideas are only good for the person who has them. This is the ground I generated from.

Saras Sarasvathy studied thirty expert founders working the same product idea and watched them build companies in eighteen different industries. The idea did not determine the business. The founder's means did: who they were, what they knew, whom they knew.20 So before the list, the means, from the record rather than from my opinion of myself.

Nine years of commits across 109 projects. Scraping and data pipelines since the first year and never stopped: twenty projects. AI on twenty-five projects, all since 2023, and most of what I do now is agent harnesses, the machinery that makes coding agents produce work I would sign. Blockchain on fifteen, trading on thirteen, reverse engineering on six. Two live shows' worth of broadcast tooling built this year. Communities I can reach: a handful of crypto Telegram groups, some of them large, a Solana builder chapter I do work for, and the audience of a weekly show about what is real in crypto that I am building the studio for. And a temperament I have written down enough times to trust: I am better at optimising inside boundaries that already exist than at inventing new ones, and I want to be new by a small margin.

That narrows the search to three lanes, and I generated inside them rather than in the abstract. Every idea below names the input that produced it: an observed complaint, a distortive process people endure, a purchase that is already happening. If an idea could have occurred to anyone who read the launch post, I cut it. Paul Graham's rule: "if all you know about a startup idea is that it sounds plausible, you have to assume it's bad."21

05

Twenty things I would build

Each carries the input it came from, who wants it badly, the next test that is cheaper than building, and what kills it.

Communities and chats

Where I already have the data and the people

The input for this lane is the most-repeated complaint in every crypto group I am in: the mods are volunteers, the scammers are not, and a group above a few thousand members is a full-time job nobody is paid for. Someone on X fed 10,208 WhatsApp messages to Jev and had the scam messages flagged in 32 seconds for six and a half cents.22 A Twitch chat filter runs at nine cents an hour on the busiest stream.23 That is the price of moderation now.

  1. 01

    The community operating system

    A Telegram and Discord bot that scores every message on five propositions (spam, scam link, harassment, off-topic, wallet solicitation) and one severity scale, and applies a policy the admin writes in plain language. Every pardon of a false positive becomes a precedent fed back into the criteria, so it learns the group's culture without anyone training anything. On top of that, member scoring: who is engaged, who is drifting, who is a helper, who is a newcomer who needs a nudge. The weekly health report writes itself from the scores.

    Input
    Volunteer mods burning out; a working Discord reference already on GitHub with the pardon loop built in
    Desperate
    Anyone running a 5,000-plus member token or builder community. They will use a rough v1 from a stranger because the alternative is doing it at 3am
    Next test
    Export one real group's last month, run the scam and spam questions, show the admin the false-positive rate on a page. Sell it before the bot exists
    Kills it
    Adversarial text. Scammers write prompt injections; the model does not treat state as hostile. Mitigation is state hygiene plus a second opinion above a threshold, and it has to be measured on hostile data
  2. 02

    Morning triage for people who run too many groups

    Overnight, every message across every group gets four questions: needs me, about a deal, about a person I track, urgency. One calm screen in the morning with the five things that need you. The LLM writes five one-line summaries at the end; everything before it is Jev and a sort.

    Input
    My own 200 groups; the distortive process is scrolling all of them before coffee
    Desperate
    Founders and BD people in crypto with a hundred-plus active chats
    Next test
    Fifty of my own messages hand-labelled. If the 0.9 bin is right, ship it to five founders
    Kills it
    Telegram's own terms on reading user history, and whether people will connect an account
  3. 03

    Onboarding that routes instead of welcoming

    A newcomer's first three messages classified for intent (builder, investor, job seeker, tourist, bot) and routed to the right sub-channel, person or resource, with a confidence gate so the bot only acts when it is sure.

    Input
    A builder chapter where the welcome message is the same for everyone and nobody reads it
    Desperate
    Chapter leads who lose good builders in week one
    Next test
    Classify last month's newcomers by hand and by Jev; compare
    Kills it
    Three messages may be too few to know anything
  4. 04

    Grep for your own history

    Search your Telegram, WhatsApp and email by proposition rather than keyword, with real boolean operators. "Someone offered me work" AND NOT "I declined". One person built this as a command-line tool for logs in a single Node file.24 An embedding puts "I want a refund" and "your refund was processed" next to each other; a proposition scores them 0.98 and 0.10.

    Input
    My own searches for a deal I half remember; the tool that exists
    Desperate
    Anyone who has ever lost a lead in a chat scrollback. Honestly, not sure they are desperate enough. Marked as a tool first
    Next test
    Wrap the existing tool around my Telegram export; use it for a week
    Kills it
    Cost scales with history size; a full re-scan on every query is wrong, so it needs a cache and a design

Attention and markets

Where I have been scraping for nine years

The input here is a distortive process I know from the inside: people spend eighteen hours a day on X to catch a narrative before a token attaches to it, and pay for alpha groups that do the same thing with a worse hit rate. I already read 360 accounts every morning for five cents. Scoring every one of those tweets on three questions costs about four cents more. One warning first: every "Jev trading bot" on X feeds it an order book and asks buy or sell, and that is the numeric, multi-step shape it is measurably worst at. Nobody has published a backtest. The defensible use is classifying text into typed features and leaving the decision to the maths.

  1. 05

    Narrative radar

    An hourly pipeline that scores the entire X firehose from a curated roster on propositions like "a nameable narrative is forming here", "a token has not attached yet", "this account is early rather than late", and kills 99.8% of what comes back before a person or a bigger model looks at it. The output is a daily brief with the ten things worth a second look and the probabilities beside them. Sold as a subscription, published in public for the first month so the hit rate is on record.

    Input
    My own scraper and my own eighteen-hour days; alpha groups people already pay for
    Desperate
    Traders who pay $100 a month for a Telegram group with a worse signal. They are hostile to it, which is the right sign
    Next test
    Run it for two weeks, publish every call with its timestamp, count subscribers at the end
    Kills it
    The brief is only as good as the roster, and rosters rot. And if the hit rate is public and bad, that is the end
  2. 06

    Semantic features for quants

    Score a million tweets, headlines or on-chain event descriptions on twenty described dimensions once, and sell the columns. A quant fund gets twenty semantic features per asset per hour without an NLP team. TypeSafe's own cookbook trains a CatBoost model on Jev outputs; this is that as a data product.

    Input
    The scraper I already run; the feature-discovery cookbook
    Desperate
    Small quant shops without an NLP hire. Not sure yet; needs a conversation with two of them
    Next test
    Offer one fund one month of one feature for free and ask what they would pay
    Kills it
    Funds want the raw data and the method, not the columns
  3. 07

    The reply desk

    For someone building a presence on X: every hour, which tweets in your niche are worth replying to (scored against your written persona), and whether an LLM-drafted reply sounds like you (scored against your voice rules). Writing the criteria is writing the persona, which is the part most people never do.

    Input
    My own stalled attempt at exactly this; the 3,282-post self-analysis someone ran for $0.1325
    Desperate
    Founders told to "build in public" who hate it
    Next test
    Run it on my own account for two weeks and watch replies per hour spent
    Kills it
    X's rate limits and rules on automation; the line between assisted and automated is thin
  4. 08

    Feed filters as a product

    A browser extension that labels every post in your feed on the propositions you write (substance, humour, promo, AI-written, bait) and hides what you say to hide. Three people built rough ones in the first week.26 The one that wins is the one with the best default rule sets per niche.

    Input
    The three extensions that exist; my own drains list has "Twitter FOMO" on it
    Desperate
    Mild. This is the plausible-sounding one on the list and I am flagging it as such
    Next test
    Install one, use it a week, see if I keep it
    Kills it
    Platforms break extensions; nobody pays for a feed filter

Live shows and content

Where the latency is the product

The input is what I see every week running a live show: the host says "we need to find that tweet", and someone alt-tabs for ninety seconds while the show waits. Every graphic on screen is a screenshot because finding and retypesetting the source takes too long. Chat scrolls past unread. All of that is a decision that has to happen inside a sentence, and until now nothing could make it.

  1. 09

    The standby researcher

    An agent that listens to the live transcript. Every sentence gets one question, "is this a request to find something", and a Choice on what kind: tweet, article, token, chart, person. Above a threshold, it goes and finds it, ranks the twenty candidates against the transcript excerpt, and puts the top three on the operator's desk as proposed cards. One click sends it to program, retypeset, with the source. The search and the planning are an LLM's job; the two fast decisions in the loop are Jev's, and they are what let the card appear before the sentence is finished.

    Input
    My own show, every week; the voice-controlled browser someone built in ~300 ms per decision27
    Desperate
    Anyone producing a live show with a co-host and no producer. That is most of them
    Next test
    Wire the wake-word question to a transcript from last week's episode and count the asks it catches
    Kills it
    Transcription latency, which is the slow part now
  2. 10

    Chat on air, safely

    Every viewer message scored for "worth putting on screen", "safe to show" and "names a ticker", fast enough to run per message, so the overlay picks the best question from chat without a human reading chat.

    Input
    The Twitch filter at $0.09 an hour; my own overlay that needs it
    Desperate
    Streamers with a mod who is also the co-host
    Next test
    Run it on one episode's chat log; count what it would have surfaced
    Kills it
    A single unsafe message on air. The safe-to-show threshold is the whole product
  3. 11

    The receipts meter

    A live meter over any video where every sentence is scored for "claim", "verifiable", "supported by what is on screen", rendered as an overlay you can post. Someone built the rough version and scores a full debate for five cents.28 For a show whose whole premise is testing claims in public, this is a format, ready-made.

    Input
    The tool that exists; a show built around stamping what is real
    Desperate
    Nobody is desperate for this. It is a format, and formats are judged by whether people share the clip
    Next test
    One clip, posted, watched for shares
    Kills it
    It cannot verify; it can only judge whether a claim is the kind that could be. Say so on screen or it is dishonest
  4. 12

    The pre-publish gate

    A prose linter for teams that publish a lot: countable rules run locally, judgement rules go to Jev one paragraph at a time. Closer restates the paragraph, stacked hedges, the not-X-but-Y turn, a cost figure with no source. One that exists flags 1 of 54 clean paragraphs where a chat model flagged 37.29 Sold to content teams drowning in their own AI output.

    Input
    I run every word I publish through a writing standard; the tool exists as a CLI
    Desperate
    Agencies shipping AI-assisted copy who have been burned once
    Next test
    Run my own rules over my last twenty pages; count what I would have changed
    Kills it
    Grammarly adds it as a feature

The software factory

Where I spend most of my hours

The input is the agent harness I build with every day and the thing everyone who runs coding agents complains about: the agent says "done" and it is not done. Vercel measured Jev against the safety reviewer in their coding agent, found it up to 18x faster at p95 and more accurate than the small GPT they were running, and said it is likely to become the default.30 TypeSafe's own staff say the obvious coding use is not writing code but "how does this score against this AGENTS.md".2 Five hook points in Claude Code were filled with Jev within a week: permission gating, output pruning, skill routing, completion verification, compaction. One of those five, compaction, is a mistake in Claude Code specifically, because the judge cannot see the tool result it is judging and every history edit invalidates the prompt cache.31 The other four are right.

  1. 13

    The foreman

    A supervisor that watches every coding agent in a fleet and scores each turn on propositions the agent cannot judge about itself: implementation complete, tests sufficient, drifting from the brief, stuck, claiming done without evidence, touched a file it should not. Code decides continue, steer, stop or verify. One open-source version exists and calls itself "an architectural experiment", which is honest.32 The product is the same thing with the gates written by someone who has run a factory, sold to agencies who bill for agent output and eat the cost of unverified work.

    Input
    My own harness, which already asks two questions before every task and could ask fourteen on every diff for $0.00007
    Desperate
    Agencies running five-plus coding agents a day who have shipped an agent's mistake to a client once
    Next test
    Run the gates on my own last hundred agent sessions; count how many "done" claims fail
    Kills it
    Anthropic and OpenAI build it into the harness, which they will. The window is the eighteen months before they do it well
  2. 14

    Evals for every output

    An LLM judge at five cents a case is why nobody evaluates continuously. At $0.0004 a case, every output of every agent gets scored against its brief, every time. LangChain measured Jev-as-judge at 500 of 500 against a human oracle with variance a hundred to a thousand times lower than LLM judges.13 Sold as a dashboard, or given away to sell the foreman.

    Input
    The LangChain result; every "did the agent do what I asked" I ask by hand
    Desperate
    Same buyer as the foreman
    Next test
    Score a week of my own agent output; see whether the scores predict which ones I rejected
    Kills it
    A judge that shares the generator's blind spots. One RAG test found Jev agreed with every wrong answer at 0.82 to 1.0 confidence.33 Give the checker evidence, never just the claim
  3. 15

    Taste as a service

    An optimiser needs a fast, cheap, consistent scorer, and Jev is one. Given fifty labelled examples of what a client considers good, evolve their agents' system prompts, skills and rules until the outputs match, scored thousands of times for cents. A tool that does this for Jev's own prompts already exists.34 Pointing it at everything else is the business.

    Input
    The specialist agents I build from named practitioners; the jev-align tool
    Desperate
    Teams whose agents are "fine" and cannot say why they are not great
    Next test
    Optimise one of my own skill files against twenty of my own verdicts; measure the before and after
    Kills it
    Overfitting to fifty examples and calling it taste
  4. 16

    Is this repo safe to run

    Before an agent clones and executes a dependency or a skill, score the source on propositions: exfiltrates secrets, obfuscated, network calls it should not need, install script does more than install. One rough version exists.35 The market is every team letting agents install things.

    Input
    The supply-chain attacks on agent skills this year; the existing scanner
    Desperate
    Security teams at companies where developers run agents with install permissions
    Next test
    Run it over the 3,574 Jev repos and see what it flags; publish the result
    Kills it
    Static analysis companies do it better, if they bother

Small businesses and services

Where the queue used to be a person

The input here is a purchase that is already happening. A marketing founder wrote that an agent auditing a client's SEO and AI-search visibility cost her about $250 to run and that Jev cut the price of the reads by 90%.36 An outbound team gated 462 leads through 7,068 decisions in 47 seconds for six cents and never emailed 190 of them because the fit was wrong.37 A tax firm classified 261 form types at $0.001 a page with zero errors on 314 filled pages and a confidence gate holding back the 5% of blank pages it was unsure of.38 Each of those was a person's afternoon a month ago.

  1. 17

    The autonomy dial

    A WhatsApp assistant for a service business, a boat tour operator say, that answers in the customer's language, holds a booking, and escalates to a human. The product is the dial: because every answer carries a calibrated probability, "how much may the bot do alone" becomes a slider the owner holds instead of a policy the vendor ships. It acts above the line and asks below it, and the owner moves the line as trust grows. I have run the bot half of this for real customers; the dial is the part that makes it a product rather than a project.

    Input
    A tour operator I have built for; the intent-routing and confidence-gating patterns in TypeSafe's own docs
    Desperate
    Owner-operators answering WhatsApp at midnight in a second language. Very
    Next test
    Put the dial in front of the one operator who already uses the bot; watch where they set it and whether they move it
    Kills it
    WhatsApp Business API costs and approval; the bot is cheap, the channel is not
  2. 18

    The $25 audit

    The SEO and AI-visibility audit that costs $250 in agent time and a day of a junior's reading, as a self-serve product at a tenth of the price: which pages the AI search engines cite and why, where the gaps are, what to fix first, every judgement scored and thresholded so the report only says what it is sure of.

    Input
    The $250 number, stated by someone selling the audit; the "who ChatGPT cites" tooling that exists
    Desperate
    Agencies with fifty small clients who cannot afford the manual version per client
    Next test
    Run one audit on my own site by hand and by pipeline; compare what each found
    Kills it
    It is a crowded market and the thesis has to be more precise than "cheaper". Mine is: the confidence gate makes it honest where the incumbents pad
  3. 19

    Applications, screened

    A hackathon gets four hundred applications and three reviewers. A grants programme gets a thousand. Score every one against the brief on ten propositions, rank, and hand the reviewers the top fifty and the twenty the model was unsure of. The reviewers read forty instead of four hundred and the ones they read are the right ones.

    Input
    A builder chapter I work with running exactly this queue; candidate-to-job matching someone ran at 400 companies in 12 seconds
    Desperate
    The three reviewers, the week before the deadline
    Next test
    Score last cohort's applications and compare to who actually got in
    Kills it
    Fairness. A screen that is 90% right rejects 10% of people wrongly, and the unsure band has to be wide enough to catch them
  4. 20

    Plain-language columns for any database

    WHERE jev(customers, 'is likely to churn this quarter'). Postgres and DuckDB extensions doing this exist at a few hundred stars each.39 The product is the hosted version with caching, cost controls and an audit trail, for the analyst who cannot get an ML engineer's time.

    Input
    The extensions; every ops person I know with a spreadsheet and a question
    Desperate
    Analysts at companies too small for a data science team
    Next test
    Use the Postgres one on my own data for a week
    Kills it
    Snowflake and Databricks ship it as a function. Probably this quarter
06

The ideas that need a different frame

Five things that fall out of the primitives rather than the marketing list.

Everything above is a queue with Jev at the front of it, which is the frame Greg Isenberg gave and the one most of the first week's builds fit.40 Five things do not fit it, and they are the ones I keep thinking about.

Ask the whole decision tree at once. Because two hundred questions cost the latency of one, you can evaluate every branch of a workflow speculatively and let code walk the tree afterwards. An agent that makes six sequential model calls to plan a step can ask all six on the current state in one call and only wake the expensive model at the leaf that needs prose. This is why the browser agents went from ten seconds a step to under two hundred milliseconds.41 Any workflow with a chain of small decisions is a candidate, and most business software is that.

Judge the program, not the text. Almost every demo feeds Jev a message. Feed it your application's internal state instead: the task queue, the last five agent turns, the board. "Which task is stalled." "Which agent is going in circles." It reads JSON as well as prose, and that turns monitoring from a dashboard someone has to look at into a decision the system makes.

Filter instead of summarise. Any "summarise this history" step can become "score and drop from this history", which is faster, cheaper and never paraphrases. The Claude Code plugin that did this got the implementation wrong, but Almeida endorsed the direction: freeing agents from designing around the cache.31 Wherever you own the harness, it is the right primitive.

Ambient interfaces. Keystroke latency means a UI can ask a question per keystroke. A launcher where "the pdf I just downloaded" is already the top hit, a paste that knows what it is and where it goes, a find-in-page that finds meaning. Caleb's line on the video explainer stuck with me: it "almost feels like we're back to logic gates and registers, and now we have to build many abstractions on top."42 The abstractions are the products.

Score everything, always. At this price the question is never whether to run the model but what you would do with the answer. Every tweet, every message, every commit, every log line, every note, scored on the questions that matter this month, continuously. The scoring is nearly free. The discipline is writing the questions and then not building a dashboard on top of them.

07

Which ones I would bet on

Ranked by affordable loss and by whether anyone is hostile to it, which is the sign.

Three, in order, and the reasoning is the same for each: I already have the data pipeline, I already have the people who would use a bad first version, and the test costs a weekend.

The community operating system first, because the desperation is highest, the reference implementation exists, and I am in the groups. A moderation product is boring and has competitors, which Y Combinator would tell you are two of the three properties that make an idea look bad and therefore good.43 The thesis everyone in that market has missed is the pardon loop: a bot that learns each group's culture from its admin's corrections, without a training run, is something the incumbents cannot do because they were built before a model could read runtime-defined labels.

The foreman second, because it is the thing I would build for myself regardless, and the window before the labs do it well is real but short. It is also the one where being wrong costs the most, which is why the first hundred sessions are my own.

Narrative radar third, because traders are hostile to it, the pipeline is already running, and publishing the hit rate in public for a month is a test that cannot be argued with. If the record is bad, I will have learned it for the cost of the scraping I already pay for.

The rest stay on the shelf as tools until one of them makes someone angry.

08

How this goes wrong

The ways I would talk myself out of the above, in advance.

Starting from the technology. Every idea here began as "Jev exists, what could I do with it", which is the failure mode called solution-first, and I know it. The defence was to insist on a named input for each: a complaint I have heard, a process I have watched people endure, a purchase that is already being made. Four of the twenty I flagged as weak on exactly that test, and I left them in so you can see the difference.

Treating a Flash-class judge as an oracle. It is six points below the best models. Anything where one wrong answer is expensive and nobody will look needs the confidence gate, and the gate needs fifty labelled examples from your own data before it means anything. Two dollars and an afternoon. Skip it and you have built a machine for being confidently wrong at scale.

Forgetting the clones. Five open imitations shipped in 72 hours, and the labs will follow. Nothing here depends on TypeSafe surviving. Everything depends on knowing which questions to ask, in what words, with what threshold, for a group of people you can reach. That is the part that does not commoditise.

Building the system instead of the thing. My own worst habit, and this technology feeds it: it is very cheap to score everything and very tempting to build the dashboard that shows the scores. Every idea above has a test that is cheaper than building, and the rule I am holding myself to is that the test runs before the repo is created.

What I am doing first

Fifty messages from my own groups, hand-labelled. One question. Bin the confidence against the labels. If the top bin is right, the community bot has its first gate and I start selling it to the admins I already know. If it is wrong, I have learned the most important thing about this model for the price of a coffee, and the twenty ideas above get re-read with that in mind.

The model that never writes turns out to be the one that finally lets software decide. Whether that is a revolution or a rebranded classifier depends on what you build on it, and building is the part I am good at.

09

Sources

Every number above is somebody's measurement. These are the somebodies.

  1. TypeSafe, "Introducing System One Models & Jev", 15 Sep 2026. typesafe.ai
  2. Diogo Almeida, AI Engineer talk "Why RLCD beats RLHF" (Jul 2026), and answering as CompleteSkeptic on the HN launch thread. news.ycombinator.com
  3. GitHub, 3,574 non-fork repositories created 14 to 20 Sep matching Jev or TypeSafe, counted by per-day paginated search. Star counts as of 20 Sep 23:30 UTC.
  4. TypeSafe docs: API reference, primitives, parallel-questions cookbook. docs.typesafe.ai
  5. Archer Hume, "Jev's Architecture Unmasked", ~10,000 API calls. archerhume.com · Niels Rogge's mechanism explainer. x.com
  6. TechCrunch, Tim Fernholz interviewing Almeida and Armin Ronacher, 18 Sep 2026. techcrunch.com
  7. Sebastian Raschka on X, 20 Sep 2026. x.com
  8. TypeSafe workflow evals, four workflows, 711 cases, raw data in the page source. evals.typesafe.ai
  9. Nikhil Mudholkar, Bryo AI, 1,565 emails. x.com
  10. Emil Lindfors, "A first look at TypeSafe's Jev". lindfors.no
  11. Omar Mujahid, jev-decision-bench, 49 tasks. reddit.com
  12. Good Start Labs, "Verification is the bottleneck". goodstartlabs.com
  13. LangChain, "Jev-as-a-Judge for Agent Evals", 20 Sep 2026. langchain.com
  14. Jon Taylor via Kwindla Kramer, Pipecat operator comparison. x.com
  15. geckguy, scam job ads. reddit.com
  16. Cua, CUA-S1-FORMS, Show HN. news.ycombinator.com
  17. TypeSafe docs, "Model jaggedness, jev-1.13", reviewed 17 Sep 2026. docs.typesafe.ai
  18. backnotprop, solver-verified poker eval. backnotprop.com · HelmDeck form-filling benchmark. reddit.com
  19. Mike Maples Jr., the four-question inflection test, from his talks on pattern breakers. Quoted from machine transcripts; the mechanism is reliable, the exact wording is not.
  20. Saras Sarasvathy, "What makes entrepreneurs entrepreneurial?", the think-aloud study of 30 expert founders.
  21. Paul Graham, "How to Get Startup Ideas". paulgraham.com
  22. itscellou, 10,208 WhatsApp messages in 32 s for $0.065. x.com
  23. ethanplusai, Twitch chat filter at ~$0.09 an hour, r/vibecoding.
  24. uehaj, jev-semgrep. x.com
  25. 3,282 X posts scored on 8 questions for $0.1282, relayed by Nate B. Jones. x.com
  26. bohutang/sift, DDnim/jev-tweet-radar, elliothux/tweet-911 on GitHub.
  27. Moritz Kremb, jev-voice-browser. github.com
  28. ChetasLua/jevmeter. github.com
  29. DanRWilloughby/snifftest. github.com
  30. Guillermo Rauch on fx's safety reviewer, 16 Sep 2026. x.com
  31. Theo Browne on the compaction plugin, and Almeida's reply. x.com
  32. thruwire/foreman. github.com
  33. aryanchauhan, SQuAD 2.0 re-ranking and checking experiment, r/Rag. reddit.com
  34. sutro-sh/jev-align. github.com
  35. luantak/is-malicious. github.com
  36. Ira Bodnar, Ryze AI, 18 Sep 2026. Note that Ryze's own blog states it does not run Jev in production as of 19 Sep; the $250 is her stated cost of the existing audit. x.com
  37. Getlead, 462 leads gated. reddit.com
  38. kyotofin/tax-doc-classifier, reproducible with pnpm eval. github.com
  39. realZachi/pg-jev and Hamilton Ulmer's DuckDB extension. github.com
  40. Greg Isenberg, "find an expensive queue and put Jev at the front of it". x.com
  41. browser-use/jev-ultrafast, performance notes: median 178 ms per call. github.com
  42. Caleb Writes Code, "Jev explained in 7min", 19 Sep 2026. youtube.com
  43. Y Combinator, "How to Get and Evaluate Startup Ideas": hard to start, boring, has competitors.