If the forecasting models were so good that people were actually consistently beating prediction markets, they wouldn't be starting startups to be selling it.
And even if it is good enough, once you're shelling out thousands of dollars a year in research costs, does that give you any remaining alpha?
The reason is, customer might care a lot more about the prediction than you do, or anyone else does.
For example, your customer might really care a lot about some niche prediction like the number of car break-ins in Walmart parking lots. In practice you won’t have sufficient liquidity in a prediction market to actually profit off of that prediction. But a security company might really want to know the answer to it.
You got it (I was going to say "nailed it" but that's becoming an LLM marker).
This is exactly what I feel about a lot of the paid investment advice out there. Compounding can make any decent alpha worth a ton, to the point that these people would be investment bankers and not advisors if they knew what they were talking about.
> And even if it is good enough, once you're shelling out thousands of dollars a year in research costs, does that give you any remaining alpha?
That's precisely why you would want to make a startup to get investment now rather than self-fund and bootstrap. That alpha isn't going to last forever, especially because everyone has access to the frontier LLMs, which keep getting better, and will eventually beat your fancy harness or specialized finetune.
And also, perhaps more importantly, so you can start developing an alternative to prediction markets and become the new PM; as Scott notes, with superforecaster AI, it's unclear why you really need Kalshi or Manifold or anyone else, with all their fees and overhead. Leave them to the degens, and carve off the socially useful part to do much more efficiently - tokens are cheaper than transactions! This is the big prize, but you need to start now before someone else does it better or commoditizes it.
Agree, to an extent. The link certainly smells like an ad. If the predictions are on lower volume markets (i.e. no institutional investors with actual quants behind) the compounding power stops. Also that means it can't beat institutional investors. So the reasonable option is to monetize what you can.
If a model demonstrates being good by winning on prediction markets I may want to ask the same model questions which are too niche to have markets. That said I don't know if niche questions are enough of a revenue stream to be interesting for model providers.
Perhaps they may enforce a knowledge cut-off for information retrieval and price the service based on how recent the cut-off is, and also use the cut-off as a way to guard their advantage on the markets.
Wait, the original blog post was about competing with top-tier guessers using “AI.” I wonder if there’s more money to be made on the flip side: find the people making dumb bets, at scale, and take the free money they are offering, haha.
The market of trading is smaller than the market of business. I don't think most people have ever actually tried trading for real. The frequency with which you can put in a buy/sell order and nothing happens. Then you raise/lower the price several times and nothing still happens because nobody wants to buy or sell at a price that makes you money is much higher than you would imagine. If you've never tried it yourself.
That said, the very concept of selling such information means that it would eliminate any edge and become zero profit anyway.
I can't tell you the number of times of put in an order on SPY,QQQ,SPX when I found favorable statistical analysis and I could not get filled at any price below the estimated profit potential. Those are some of the most liquid products in the word. I'm not talking pennies either.
Futures are the only thing for me this has never happened on. However no retail broker I'm aware of allows trading futures though API.
So this person was known for thoughtful blog posts, but has since become a total AI booster. It's probably a gonzo-like effect through the various subcultures he aims to explore, but it paints a very bad picture of them. Imagine if Louis Theroux became a scientologist.
For Pete’s sake lets outlaw prediction markets already instead of hyping them in crappy greed-posts like this one
I am embarrassed this “rationalist, I’m so much smarter than you, so I know better” asshole Scott Alexander hasn't been skewered yet for promotion of gambling (prediction markets) that people like Trumps son are making millions of on
Given a powerful enough AI with enough control, can an AI cheat by influencing the real world condition and self-fulfil its prediction?
Eg. Is corp ABC's stock price going to go down by 10% in 30 days?
Orchestrate a disinformation campaign on the 29th day to tank ABC's stock price.
If the forecasting models were so good that people were actually consistently beating prediction markets, they wouldn't be starting startups to be selling it.
And even if it is good enough, once you're shelling out thousands of dollars a year in research costs, does that give you any remaining alpha?
The reason is, customer might care a lot more about the prediction than you do, or anyone else does.
For example, your customer might really care a lot about some niche prediction like the number of car break-ins in Walmart parking lots. In practice you won’t have sufficient liquidity in a prediction market to actually profit off of that prediction. But a security company might really want to know the answer to it.
You got it (I was going to say "nailed it" but that's becoming an LLM marker).
This is exactly what I feel about a lot of the paid investment advice out there. Compounding can make any decent alpha worth a ton, to the point that these people would be investment bankers and not advisors if they knew what they were talking about.
There was an old ad for eTrade that basically said that: https://m.youtube.com/watch?v=dFQ_W4p1XKY
Same with get rich quick books.
With one exception : if it teaches you how to put out get rich quick content (books or otherwise).
> And even if it is good enough, once you're shelling out thousands of dollars a year in research costs, does that give you any remaining alpha?
That's precisely why you would want to make a startup to get investment now rather than self-fund and bootstrap. That alpha isn't going to last forever, especially because everyone has access to the frontier LLMs, which keep getting better, and will eventually beat your fancy harness or specialized finetune.
And also, perhaps more importantly, so you can start developing an alternative to prediction markets and become the new PM; as Scott notes, with superforecaster AI, it's unclear why you really need Kalshi or Manifold or anyone else, with all their fees and overhead. Leave them to the degens, and carve off the socially useful part to do much more efficiently - tokens are cheaper than transactions! This is the big prize, but you need to start now before someone else does it better or commoditizes it.
Agree, to an extent. The link certainly smells like an ad. If the predictions are on lower volume markets (i.e. no institutional investors with actual quants behind) the compounding power stops. Also that means it can't beat institutional investors. So the reasonable option is to monetize what you can.
If a model demonstrates being good by winning on prediction markets I may want to ask the same model questions which are too niche to have markets. That said I don't know if niche questions are enough of a revenue stream to be interesting for model providers.
Perhaps they may enforce a knowledge cut-off for information retrieval and price the service based on how recent the cut-off is, and also use the cut-off as a way to guard their advantage on the markets.
They do. One guy with at least 7 figure PnL is a well known forecaster, SemioticRivalry.
Only news article I found on that suggests the guy is mostly just market making against bets he thinks are dumb? No mention of AI.
Wait, the original blog post was about competing with top-tier guessers using “AI.” I wonder if there’s more money to be made on the flip side: find the people making dumb bets, at scale, and take the free money they are offering, haha.
The market of trading is smaller than the market of business. I don't think most people have ever actually tried trading for real. The frequency with which you can put in a buy/sell order and nothing happens. Then you raise/lower the price several times and nothing still happens because nobody wants to buy or sell at a price that makes you money is much higher than you would imagine. If you've never tried it yourself.
That said, the very concept of selling such information means that it would eliminate any edge and become zero profit anyway.
That only happens if you're trading very illiquid stocks.
I can't tell you the number of times of put in an order on SPY,QQQ,SPX when I found favorable statistical analysis and I could not get filled at any price below the estimated profit potential. Those are some of the most liquid products in the word. I'm not talking pennies either.
Futures are the only thing for me this has never happened on. However no retail broker I'm aware of allows trading futures though API.
Yes, but have you considered the performance of a few lucky outliers? Catch 'em fast before they regress to the mean!
I used AI to forecast that AI forecasters won't beat the market. We can move on now.
Is there a future where AI takes all of these no-value arbitrage games to their limit and there is no longer a market for this type of behavior?
This new forecasting industry is pushed by very dirty people.
So this person was known for thoughtful blog posts, but has since become a total AI booster. It's probably a gonzo-like effect through the various subcultures he aims to explore, but it paints a very bad picture of them. Imagine if Louis Theroux became a scientologist.
This is not even dumb. Unbelievable coming from act....
For Pete’s sake lets outlaw prediction markets already instead of hyping them in crappy greed-posts like this one
I am embarrassed this “rationalist, I’m so much smarter than you, so I know better” asshole Scott Alexander hasn't been skewered yet for promotion of gambling (prediction markets) that people like Trumps son are making millions of on
https://www.theguardian.com/us-news/ng-interactive/2026/may/...
We elected con man so we're becoming a swindler nation. In a just world the Andreesen David Sacks types would be in jail stripped of all their money.
Just out of curiosity, what is your legitimate criticism of Adreessen and Sacks?
I kinda like Taleb’s take on forecasters; get another job.
Tell me you don't understand Taleb without telling me you don't understand Taleb.