Manifold Markets
post by PeterMcCluskey · 2024-02-02T17:48:36.630Z · LW · GW · 9 commentsThis is a link post for https://bayesianinvestor.com/blog/index.php/2024/02/01/manifold-markets/
Contents
Play Money Liquidity 50% Bias Addictiveness Amateurs Resolving Markets Concluding Thoughts None 9 comments
Manifold Markets is a prediction market platform where I've been trading since September. This post will compare it to other prediction markets that I've used.
Play Money
The most important fact about Manifold is that traders bet mana, which is for most purposes not real money. You can buy mana, and use mana to donate real money to charity. That's not attractive enough for most of us to treat it as anything other than play money.
Play money has the important advantage of not being subject to CFTC regulation or gambling laws. That enables a good deal of innovation that is stifled in real-money platforms that are open to US residents.
Play money misses out on an important advantage of large real-money markets: traders who want to manipulate a price face arbitrarily large costs to counter large investors (such as hedge funds) who notice the manipulation. So I trust Manifold prices less than I trust those of the best financial markets.
Actual real-money prediction markets are limited in size, and mostly too small to attract hedge funds. So Manifold is sometimes able to beat real-money markets.
Manifold is structured so that manipulation seems rare. Competent traders who have been active for a long time accumulate enough mana to dominate newer traders. So prices are mostly set by traders who have a significant track record of non-manipulative trading. That's not enough to make Manifold prices a good input for decisions that affect billions of dollars (how hard is it to bribe traders?), but it's good enough for a wide variety of less important decisions.
Liquidity
Another advantage of play money is that Manifold can create more mana whenever they want.
Manifold has taken advantage of that to enable traders to, in effect, buy on margin. In addition, they give daily handouts of mana to people who trade daily. Those two features ensure that I mostly don't end up in the situation that I got into on some other platforms of spending all my money and then waiting for markets to be resolved. My more regular trading on Manifold helps ensure that, at least for markets that get some minimal amount of attention, there are enough regular traders to keep the markets somewhat efficiently priced.
The most important way that Manifold provides liquidity is via an automated market maker. The normal trading mode is that I accept whatever price the system offers. Since Manifold uses play money, it costs them nothing to subsidize the market maker, thereby ensuring that markets have plenty of liquidity.
What's new about the market maker is that the amount of liquidity it provides increases as trading increases. We expect that the first trade on a market produces a less efficient price than the 100th trade. So we want the first few trades to move the price fairly easily. Whereas the hundredth trade is less likely to add new information about what the price should be, so the 100th trade should move the price less than would a similarly sized 2nd trade.
I advocated this kind of approach a decade ago, then forgot about it. I'm glad to see it being implemented well.
I traded for a few months before noticing a mention of limit orders. I had vaguely wanted to enter limit orders, but didn't see anywhere to enter them. (They're hiding under a button that says "%"). This reflects a UI that looks simple to beginners, but has enough power to maybe satisfy experienced traders.
50% Bias
Like many markets, prices on Manifold are too close to 50%.
E.g. as of January 30, Will NASDAQ TMC (The Metals Company) hit 2$ before 1st Febuary 2024? is trading at 10%. It has dropped about 55% in the past week, as the number of remaining trading days dropped from 9 to 2. I think it would ideally have dropped to something closer to 2/9 of last week's price. That would require more people to trade it on a daily basis, in order to overcome the price stickiness of the automated market maker. Attention is spread too thinly for that to happen.
A longer term contract with a similar problem is Will medicine master head transplants in the next 10 years?, currently trading at 7%. Betting NO here looks like a nearly guaranteed win, but it might be less than a 1% annual return on my initial investment (I need to put down 93 mana per 100 shares). That's not an impressive return compared to what I expect on shorter term contracts such as the one I mentioned above.
Why was the head transplant contract ever above 7%? It looks like the automated market maker is always initialized to 50%. One alternative that I've seen (in the original Good Judgment Project?) is to have that initial price set by an auction of traders, with the automated market maker only becoming active after the first trade. That makes the initial price more accurate. The downside is that there is much less incentive for anyone to make the first trade, so some (possibly many?) contracts won't start trading, and maybe traders will generally put less effort into searching for new contracts.
I selected these two examples because they showed the problem most clearly of markets I've been following recently. That's partly because they've hardly attracted any attention. Heavily traded markets show milder versions of this bias.
Addictiveness
Trading on Manifold is mildly addictive. Factors that contribute to this are:
- Having a potentially daily source of new mana.
- Having that mana supply depend on daily trading.
- Having prices that are inefficient enough that I can make frequent profits.
- Having a conspicuous and readable game-like score.
- Having a wide variety of markets, with an adequate UI for finding new markets that interest me.
Amateurs Resolving Markets
Most serious platforms try to ensure that all markets are resolved in accordance with an unambiguous interpretation of the wording of the contract. This usually involves someone who works for the platform acting like a lawyer when each market is first proposed, to rule out any important ambiguity in the wording. That person also acts as a judge when each market is due to be resolved. The overhead associated with this work likely limits the quantity of markets that can be created, while still leaving traders dissatisfied with some market resolutions.
Manifold rejects that approach: any user can create new markets, and resolve them when they come due, with approximately no requirement that market will be resolved fairly. The burden is on traders to check that market resolution criteria are clear, and that the creator is reputable enough to judge it fairly.
This policy generates some complaints. As a trader, I don't feel like I'm affected much by this choice. Other prediction market platforms never managed to handle this well enough that I was more eager to trade there due to a greater expectation of fairness.
One of my earliest memories of a prediction market is the Iowa Electronic Markets, where I lost all my investment ($500?) by betting that Bush would win the 2000 election. I apparently failed to read the fine print that said the market would be resolved based on who won the popular vote.
The difference between play money and real money makes me less worried about similar mistakes on Manifold.
The existence of a wide variety of markets on Manifold enables me to diversify more than I did on other platforms, which also reduces my concern over individual markets being resolved unfairly.
Concluding Thoughts
Manifold's approach of encouraging lots of markets with little thought about quality is working better than I expected it to work.
Manifold seems somewhat likely to become a respected source of predictions for a moderately important set of questions.
However, they don't seem to be close to being profitable. My intuition says they'll find a way to earn enough to sustain some sort of growth. I don't expect them to do well enough that I'll regret not investing in them.
9 comments
Comments sorted by top scores.
comment by the gears to ascension (lahwran) · 2024-02-02T21:50:40.373Z · LW(p) · GW(p)
I have become frustrated with the financial style of prediction manifold encourages; while it produces better predictions, what I want is not good predictions from someone else, but consistent pressure to directly make good predictions myself. A prediction market doesn't incentivize making the best prediction de novo, it incentivizes knowing when you're more right than someone else, which most naturally implies modeling the someone else somewhat. I don't want to deal with this when what I want is practice making predictions. So, I would prefer metaculus -- except that metaculus makes it very hard to make new questions. What I'd really like is metaculus style prediction with manifold style anyone-can-make-a-question. I'd also want a slight change to the metaculus UI to hide most people's predictions[1] and remind people that the community prediction is basically nonsense (it's a median of predictions, lol.) But with those changes, it would become highly possible to recommend the service to friends who are allergic to their market-style prediction aggregation due to aversion to the power accumulation of unregulated markets.
[1] there's already a setting to hide other's predictions, but it's not on by default. Since I think almost all the value in this sort of thing is in training people to do the thinking themselves rather than in informing them what others think, I think it should be hidden by default.
Replies from: NoUsernameSelected↑ comment by NoUsernameSelected · 2024-02-04T06:03:23.049Z · LW(p) · GW(p)
The so-called "nonsense" community prediction is still more accurate on average than Manifold for the same questions.
https://www.metaculus.com/notebooks/15359/predictive-performance-on-metaculus-vs-manifold-markets/
Replies from: lahwran↑ comment by the gears to ascension (lahwran) · 2024-02-04T06:07:41.646Z · LW(p) · GW(p)
wow, what! I really didn't see that coming. it ... is in fact the median of the community predictions, though, right?
Replies from: NoUsernameSelected↑ comment by NoUsernameSelected · 2024-02-04T06:17:13.981Z · LW(p) · GW(p)
Replies from: lahwranI compared the Manifold forecasts with the community prediction on Metaculus and calculated a time-averaged Brier Score to score forecasts over time.
↑ comment by the gears to ascension (lahwran) · 2024-02-04T06:24:23.545Z · LW(p) · GW(p)
For Binary Questions, the Community Prediction is a weighted median of the individual forecaster probabilities.
This is where I got the idea it was a median. Looks a little more complex than I remembered. Very interesting. https://www.metaculus.com/help/faq/#community-prediction
comment by romeostevensit · 2024-02-02T20:09:06.965Z · LW(p) · GW(p)
Played around with it a bit this past week. Main problem is I can't find much to bet on. The markets that will close in 2030 etc are profoundly uninteresting and the short term stuff is mostly in the genre of various horse races (sports, politics, celebrities, crypto prices).
I guess I agree with Tetlock that the main hurdle for these is the lack of interesting questions. One obvious hypothesis is that short term alpha is almost always kept quiet, so it wouldn't be trickling into a public market.
comment by Mikhail Samin (mikhail-samin) · 2024-02-02T20:32:58.072Z · LW(p) · GW(p)
Since Manifold uses play money, it costs them nothing to subsidize the market maker
IIRC, the market maker is subsidised by the market creator (M$50 of the cost of creating the market goes to the automated market maker)
amount of liquidity it provides increases as trading increases
I'm not sure, but I think this is not exactly true; if 50 people bet M$10 Yes at 50% and 50 people bet M$10 No at 50%, a new trade will move the market just like the first trade would, with the original M$50 in liquidity
Replies from: Bohaska↑ comment by Bohaska · 2024-02-03T12:33:39.434Z · LW(p) · GW(p)
But Manifold adds 20 mana to liquidity per new trader, so it'll eventually become more inelastic over time. The liquidity doesn't stay at 50 mana.
Replies from: mikhail-samin↑ comment by Mikhail Samin (mikhail-samin) · 2024-02-03T17:29:29.563Z · LW(p) · GW(p)
Oops! ok!