What's up with Arbital?
post by Alexei · 2017-03-29T17:22:21.751Z · LW · GW · Legacy · 91 commentsContents
So what now? None 91 comments
This post is for all the people who have been following Arbital's progress since 2015 via whispers, rumors, and clairvoyant divination. That is to say: we didn't do a very good job of communicating on our part. I hope this posts corrects some of that.
The top question on your mind is probably: "Man, I was promised that Arbital will solve X! Why hasn't it solved X already?" Where X could be intuitive explanations, online debate, all LessWrong problems, AGI, or just cancer. Well, we did try to solve the first two and it didn't work. Math explanations didn't work because we couldn't find enough people who would spend the time to write good math explanations. (That said, we did end up with some decent posts on abstract algebra. Thank you to everyone who contributed!) Debates didn't work because... well, it's a very complicated problem. There was also some disagreement within the team about the best approach, and we ended up moving too slowly.
So what now?
You are welcome to use Arbital in its current version. It's mostly stable, though a little slow sometimes. It has a few features some might find very helpful for their type of content. Eliezer is still writing AI Alignment content on it, and he heavily relies on the specific Arbital features, so it's pretty certain that the platform is not going away. In fact, if the venture fails completely, it's likely MIRI will adopt Arbital for their personal use.
I'm starting work on Arbital 2.0. It's going to be a (micro-)blogging platform. (If you are a serious blogger / Tumblr user, let me know; I'd love to ask you some questions!) I'm not trying to solve online debates, build LW 2.0, or cure cancer. It's just going to be a damn good blogging platform. If it goes well, then at some point I'd love to revisit the Arbital dream.
I'm happy to answer any and all questions in the comments.
91 comments
Comments sorted by top scores.
comment by WhySpace_duplicate0.9261692129075527 · 2017-03-30T03:49:02.023Z · LW(p) · GW(p)
This is really sad. I'm sorry to hear things didn't work out, but I'm still left wondering why not.
I guess I was really hoping for a couple thousand+ word post-mortem, describing the history of the project, and which hypotheses you tested, with a thorough explanation of the results.
If you weren't getting enough math input, why do you think that throwing more people at the problem wouldn't generate better content? Just having a bunch of links to the most intuitive and elegant explanations, gathered in one place, would be a huge help to both readers and writers. Students trying to learn are already doing this through blind googling, so the marginal work to drop the links is low.
Pulling all the info together into a good explanation still requires one dedicated person, but perhaps that task can be broken down into chunks too. Like, once one version is written, translating it for non-mathy people should be relatively easy. Same for condensing things for mathy people.
But, why wouldn't adding more mathematicians mean a few would be good at and interested in writing new articles? Where did you do outreach? What did you do? There are entire communities, scattered across the web, who exist to try and learn and teach math. Have you tried partnering with any of them, or recruiting members?
If not, why do you think it won't work? Do you see promising alternative approaches, or are good explanations impossible even in principle?
Sorry for the flood of questions. I've just been waiting with baited breath for Arbital to stop pushing me away and start pulling people in. I even linked some people, but felt guilty about it for putting a strain on your overloaded servers before you were ready for the general public.
Replies from: Alexei↑ comment by Alexei · 2017-03-30T14:49:36.188Z · LW(p) · GW(p)
Yes, many students would benefit from a math explanation platform. But it was hard for us to find writers, and we weren't getting as much traction with them as we wanted. We reached out to some forums and to many individuals. That version of Arbital was also promoted by Eliezer on FB. When we switched away from math, it wasn't because we thought it was hopeless. We had a lot of ideas left to try out. But when it's not going well, you have to call it quits at some point, and so we did. There was also the consideration that if we built a platform for (math) explanations, it would be hard to eventually transition to a platform that solved debates (which always seemed like the more important part).
I think if someone wanted to give it a shot with another explanation platform and had a good strategy for getting writers, I'd feel pretty optimistic about their chance of success.
comment by Viliam · 2017-03-30T12:02:53.663Z · LW(p) · GW(p)
I feel sad that the project is gone before I even understood how it was supposed to work.
I was like: "I have absolutely no idea what this is supposed to be or to do, but smart people seem enthusiastic about it, so it's probably a smart thing, and maybe later when I have more time, I will examine it more closely."
Now, my question is... how much should I use this as an outside view for other activities of MIRI?
Replies from: pcm, Alexei, ChristianKl↑ comment by pcm · 2017-03-30T16:37:00.640Z · LW(p) · GW(p)
how much should I use this as an outside view for other activities of MIRI?
I'm unsure whether you should think of it as a MIRI activity, but to the extent you should, then it seems like moderate evidence that MIRI will try many uncertain approaches, and be somewhat sensible about abandoning the ones that reach a dead end.
↑ comment by Alexei · 2017-03-30T15:15:55.467Z · LW(p) · GW(p)
Don't use the outside view. Use your brain. If Arbital was confusing, but you didn't look closer at it, then you didn't use your brain. If MIRI seems confusing and you don't look closer at it, then you aren't using your brain. The whole concept of "smart people" whom you can trust with anything is just wrong. There are only niche experts.
My two cents: Arbital had very little to do with MIRI, aside from Arbital being Eliezer's idea. But this was definitely out of his realm of expertise. MIRI/AI stuff is not.
Replies from: gjm↑ comment by gjm · 2017-03-30T22:43:06.126Z · LW(p) · GW(p)
One of the things people (rightly) use their brains for is deciding what things merit closer attention. I don't think it's fair to say that Viliam didn't use his brain, merely because the conclusion from using his brain was "I don't care enough about this to examine it more closely right now". And his question about the outside view isn't about how he should have evaluated Arbital before but about how he should evaluate MIRI activities in the future. (Where, again, "not worth looking closer right now" is a perfectly legitimate evaluation.)
Are you suggesting that as a matter of general policy one shouldn't use the outside view to evaluate how likely something is to succeed, to have large impact, etc.? Or does that only apply to certain projects, and if so which ones?
↑ comment by ChristianKl · 2017-03-30T18:26:10.637Z · LW(p) · GW(p)
The fact that a startup pivots doesn't automatically mean that it's founders are bad at what they are doing. Most startups fail or pivot from the outside view.
Replies from: gjm↑ comment by gjm · 2017-03-30T22:35:39.629Z · LW(p) · GW(p)
I don't think Viliam was claiming it means the founders are bad at what they're doing (in any sense stronger than that they aren't able to do it in such a way as to make a commercial success). Only that "smart people seem enthusiastic about it" is perfectly consistent with "nothing will come of it in the end".
comment by michaelkeenan · 2017-03-29T18:19:51.210Z · LW(p) · GW(p)
Debates didn't work because... well, it's a very complicated problem.
I'd love to hear about this in more detail. What have you learned about the problem? Do you know what good solutions would look like, but they're too hard or expensive to implement? Or have you learned that it isn't feasible?
Replies from: Alexei↑ comment by Alexei · 2017-03-29T18:36:44.021Z · LW(p) · GW(p)
Here is my person take on why it's complicated:
When you ask someone if they would like a debate platform and describe all the features and content it'll have, they go: "Hell yeah I'd love that!" And it took me a while to realize that what they are imagining is someone else writing all the content and doing all the heavy lifting. Then they would come along, read some of it, and may be leave a comment or two. And basically everyone is like that: they want it, but they are not willing to put in the work. And I don't blame them, because I'm not willing to put in the work (of writing) either. There are just a handful of people who are.
So the problem is definitely not on the technical side. It's a problem with the community / society in general. Except I'm hesitant to even call it a "problem," because that feels like calling gravity a "problem." This is just the way humans are. They want to do things they want to do.
Replies from: ChristianKl, VAuroch, Viliam, ChristianKl, plethora↑ comment by ChristianKl · 2017-03-29T20:07:57.451Z · LW(p) · GW(p)
It seems to me like you never really tried to seriously invite people to participate and write content. The fact that people had to follow Arbitals process through "whispers, rumors, and clairvoyant divination" gave the impression that it was more in a closed state than that it was inviting people to participate.
Replies from: Alexei↑ comment by Alexei · 2017-03-29T20:23:51.801Z · LW(p) · GW(p)
That's a very good point. When we were doing math explanations, we did reach out to a lot of people (just not via LW). When we were doing debates, we reached out to a few people, because we didn't quite know what shape we wanted to the debate to take. So we didn't need that many people. (It would be a bit silly to move a community from one platform to another that's basically the same.)
So, yes, there were multiple times where we thought that we should invite more people / throw open the doors. Some of those times we postponed it because we weren't ready; one of the other times we probably should have done it.
You can think of this post as an invitation to use the platform.
Replies from: ChristianKl, math_viking↑ comment by ChristianKl · 2017-03-29T20:42:17.508Z · LW(p) · GW(p)
How about writing a "top 10 posts on Arbital" post for LW discussion? That way it's easier for people to see discussions to which they might want to contribute.
When we were doing debates, we reached out to a few people, because we didn't quite know what shape we wanted to the debate to take. So we didn't need that many people.
That's a valid strategy but if that's what you did, why do you think your experience proves that it's hard to get people to contribute to the discussion?
Replies from: Alexei↑ comment by Alexei · 2017-03-29T20:49:19.279Z · LW(p) · GW(p)
How about writing a "top 10 posts on Arbital" post for LW discussion? That way it's easier for people to see discussions to which they might want to contribute.
I think that's better done by people who are actively writing and want to invite commenters.
That's a valid strategy but if that's what you did, why do you think your experience proves that it's hard to get people to contribute to the discussion?
Because we reached out to people who were pretty excited about the platform and who were already spending a lot of their time blogging / doing discussions. I imagine if we reached out to people who are less excited / who write less, we would have gotten even less of a response.
Replies from: None↑ comment by [deleted] · 2017-03-30T05:40:28.262Z · LW(p) · GW(p)
I think that's better done by people who are actively writing and want to invite commenters.
Given that you've been so involved, I don't think anyone would think it out of place for you to make a post. I, for one, would be happy to have a general "Introduction to the top 10 Arbital posts".
Aside from the haziness and uncertainty, I also often felt off-put because of a lack of a prominent wiki / introduction to the vast space of things Arbital offers.
↑ comment by math_viking · 2017-04-01T05:59:36.499Z · LW(p) · GW(p)
If you're still looking for content, I could be persuaded to start (slowly) working on some set theory/analysis concepts.
Replies from: Alexei↑ comment by Alexei · 2017-04-01T17:01:40.983Z · LW(p) · GW(p)
I'm not into persuading people. :) If you want to write, go for it. I still think Arbital is a really good platform for writing up math explanations.
Replies from: math_viking↑ comment by math_viking · 2017-06-04T03:13:17.078Z · LW(p) · GW(p)
I rather forgot about this due to being accidentally logged out of this account and not realizing so until later. If I were to try my hand at this, what would be the best place to see what's already been done (without having to click through arbital) and submit my contributions?
Replies from: Alexei↑ comment by Alexei · 2017-08-10T19:19:56.537Z · LW(p) · GW(p)
This will take a long time to load, but it's comprehensive: https://arbital.com/explore/math/
Replies from: math_viking↑ comment by math_viking · 2017-08-11T04:02:55.001Z · LW(p) · GW(p)
I'll take a look, thanks!
↑ comment by Viliam · 2017-03-30T11:40:59.062Z · LW(p) · GW(p)
Yeah, I can imagine myself doing a similar mistake. For websites, both the engine and the content are important. A bad engine can ruin otherwise good content (just look at the damage done to LW but not being able to effectively moderate sockpuppets and karma assasinations), but if you don't have enough content, it does not matter what engine you have, people will not come there.
And the more options you want to provide for the reader, the more text needs to be written.
↑ comment by ChristianKl · 2017-03-29T20:25:36.987Z · LW(p) · GW(p)
The start page also direct me to the latest discussions the way the reddit start page does. It's hard to actually find the discussions.
If I go to a discussion like https://arbital.com/p/requisites_for_personal_growth/, there's no text field in which I can leave my comment, like there's on reddit (and here) or blogs that have a comment sections. I can click the button "Propose comment" but that design suggests to me that commenting isn't supposed to be my default reaction.
Replies from: Alexei↑ comment by Alexei · 2017-03-29T20:44:01.013Z · LW(p) · GW(p)
Correct. We (somewhat prematurely) worried about trolls, so by default people can only propose comments. And it would be up to Toon to approve them. (If there is sufficient demand, I can add a feature to let users have open commenting. But in general adding features to old Arbital is not high on my priority list.)
Replies from: Lumifer, ChristianKl↑ comment by Lumifer · 2017-03-30T03:35:55.759Z · LW(p) · GW(p)
So, if I understand this correctly, you had a non-promoted invite-only platform which you think failed because not enough people contributed content?
I am confused. Surely it crossed someone's mind at some point...
Replies from: Alexei↑ comment by Alexei · 2017-03-30T03:42:43.274Z · LW(p) · GW(p)
See this comment: http://lesswrong.com/lw/otq/whats_up_with_arbital/dq9h
I think we likely made a mistake with respect to openness, but it's not obvious when/how. Probably the biggest problem is that we couldn't settle on what we wanted the users to do once they were on the platform.
Replies from: Lumifer↑ comment by Lumifer · 2017-03-30T14:36:21.325Z · LW(p) · GW(p)
but it's not obvious when/how
Any. Fucking. Time.
I notice that you tell people to come to Arbital, but it is still invite-only.
we couldn't settle on what we wanted the users to do once they were on the platform
"...the street finds its own uses for things" -- William Gibson
Have you considered letting users play freely and then learning from them instead of trying to construct an optimal-by-some-criteria maze that mice surely will joyfully choose to run through?
Replies from: Alexei↑ comment by Alexei · 2017-03-30T15:29:46.778Z · LW(p) · GW(p)
How is it invite only? Are you talking about the comment section?
Originally the plan was to do exactly that if we couldn't figure how to build a "joyful maze": just throw open the doors and see what people do with it. Unfortunately there is still a significant amount of work left to do that well, and right now I'm more optimistic about the new platform than I am about scavenging the current version.
Replies from: gilch, Lumifer↑ comment by Lumifer · 2017-03-30T15:44:34.456Z · LW(p) · GW(p)
Didn't you say
so by default people can only propose comments. And it would be up to Toon to approve them
which is an explicit whitelisting system?
Replies from: Alexei↑ comment by Alexei · 2017-03-30T16:20:00.003Z · LW(p) · GW(p)
Yes, but that's not "invite-only".
Replies from: Lumifer↑ comment by Lumifer · 2017-03-30T16:45:11.532Z · LW(p) · GW(p)
You can knock on the door. But you have to be invited (=whitelisted) by someone with sufficient authority in order to enter.
Replies from: Alexei↑ comment by Alexei · 2017-03-30T16:48:15.776Z · LW(p) · GW(p)
Not someone with sufficient authority, just the blog owner. That seems fair though. You can create you own blog and then you would be in charge of which comments to approve.
Replies from: Lumifer, ChristianKl↑ comment by ChristianKl · 2017-03-30T17:11:26.073Z · LW(p) · GW(p)
That doesn't seem the default way most blogs work. Most blogs simply allow you to leave a comment (or they don't have comment sections at all).
↑ comment by ChristianKl · 2017-03-30T08:40:12.233Z · LW(p) · GW(p)
Why do you think it's a better decision to switch strategy to a microblogging platform instead of switching strategy to being as open and as inviting of contribution as possible?
Replies from: Alexei↑ comment by Alexei · 2017-03-30T15:07:04.730Z · LW(p) · GW(p)
- Currently it's not clear to anyone what Arbital is, what it can do, who it's for, etc.. It needs to solve a real problem and present itself as solving that clear problem.
- The tech we used is now somewhat obsolete. The codebase has accumulated a lot of unnecessary features. Also Google Material UI turned out to be too heavyweight and not as pleasant to design with as I thought initially. (These are all arguments for remaking the platform.)
- The blogging platform will be "as open and as inviting of contribution as possible."
↑ comment by Yosarian2 · 2017-04-06T10:24:27.520Z · LW(p) · GW(p)
Ok, but when you do create "Arbital 2.0", the best thing you can do to help it succeed is to have a pre-existing base of users who are interested in using it, especially the smaller number but extremly important "power users" who will be the ones who generate most of your content, and a lot of good content you can move over from your old site.
Anything you can do to encourage people to be more active now at creating content (including comments) and interacting with the site in general probably included your odds of success long-term.
↑ comment by plethora · 2017-03-31T01:45:42.559Z · LW(p) · GW(p)
When you ask someone if they would like a debate platform and describe all the features and content it'll have, they go: "Hell yeah I'd love that!" And it took me a while to realize that what they are imagining is someone else writing all the content and doing all the heavy lifting. Then they would come along, read some of it, and may be leave a comment or two. And basically everyone is like that: they want it, but they are not willing to put in the work. And I don't blame them, because I'm not willing to put in the work (of writing) either. There are just a handful of people who are.
This is what incentive structures are for. There are quite a few people who have strong incentives to publish high-quality writing, you know...
An open-access journal for debates seems like it ought to be possible, although it'd have to actively solicit contributions (an encyclopedia for debates?) and reward them with academic status, which means you'd need solid academic backing.
comment by cousin_it · 2017-03-30T07:13:05.076Z · LW(p) · GW(p)
That sure was an expensive way to test demand for Arbital 1.0. Have you thought about cheaper ways to test demand for Arbital 2.0?
Replies from: Alexei↑ comment by Alexei · 2017-03-30T14:55:42.162Z · LW(p) · GW(p)
Yes. There is already a pretty large demand for blogging platforms, and Arbital 2.0 will have features which will make it a much better option for some users. I'll also be personally reaching out to a lot of bloggers to interview them about their experience / wishes. I'll also be testing the key value propositions with a graphic that's being created right now.
But also sometimes you just have to go ahead and build the thing to really test it.
comment by VAuroch · 2017-03-29T20:13:24.542Z · LW(p) · GW(p)
It seems disingenuous to call this new project Arbital.
Replies from: Alexei↑ comment by Alexei · 2017-03-29T20:25:07.111Z · LW(p) · GW(p)
Why?
Replies from: gjm, VAuroch↑ comment by gjm · 2017-03-29T23:06:31.640Z · LW(p) · GW(p)
Well, what does it have in common with the already-existing thing called Arbital?
Replies from: Alexei↑ comment by Alexei · 2017-03-29T23:16:33.642Z · LW(p) · GW(p)
It's a blogging platform, it's done by me with some support from Eliezer, and I'm doing it because it will help with x-risk. This is essentially identical to what we had in 2015.
Replies from: gjm↑ comment by gjm · 2017-03-30T01:26:07.505Z · LW(p) · GW(p)
because it will help with x-risk
A new microblogging platform will help with x-risk?
I mean, I know Tumblr is bad, but it's hardly an existential threat.
Replies from: MakoYass, Alexei↑ comment by mako yass (MakoYass) · 2017-04-17T01:12:34.288Z · LW(p) · GW(p)
Any platform that contributes to poisoning public discourse antagonizes coordination efforts. I think entering that space is a valid EA pursuit. Anyone who's read meditations on moloch will do a better job of promoting the spread of truth and preventing spurious conflicts and than, EG, twitter.
↑ comment by Alexei · 2017-03-30T01:28:16.778Z · LW(p) · GW(p)
That's step 1. Steps 2 and after involve slowly converging towards the original Arbital vision. I just don't think you can get there without mass adoption.
Replies from: gjm, ChristianKl↑ comment by gjm · 2017-03-30T12:49:40.846Z · LW(p) · GW(p)
Is there actually any sort of obvious path from a microblogging platform to "the original Arbital vision"? I confess I don't really see one, but maybe I haven't understood what the original Arbital vision was.
Replies from: Alexei↑ comment by Alexei · 2017-03-30T15:20:44.189Z · LW(p) · GW(p)
Here are like 5 pages explaining all the visions: https://arbital.com/p/more_about_arbital/
Basically what we tried is: "let's figure out how people are supposed to have truth-seeking conversations, build a platform that facilities that, and then grow it." Step 1 is very hard. Step 3 is made harder because your platform only attracts truth-seeking people.
New approach: "build a platform that facilities communication, grow it, then shape the ongoing discussion to be more truth-seeking." Step 1 is still hard, but not made harder. Step 3 sounds a lot more doable.
↑ comment by ChristianKl · 2017-03-30T08:40:54.935Z · LW(p) · GW(p)
I just don't think you can get there without mass adoption.
Why do you believe that your new microblogging service will get mass adoption?
Replies from: Alexei↑ comment by Alexei · 2017-03-30T15:09:05.739Z · LW(p) · GW(p)
It's a complicated answer and also somewhat outside of the topic I want to discuss here (which is Arbital 1.0). For part of the answer see: http://lesswrong.com/lw/otq/whats_up_with_arbital/dqbc
Replies from: VAuroch↑ comment by VAuroch · 2017-03-30T01:18:45.487Z · LW(p) · GW(p)
Arbital has vague positive affect from being an attempt to solve a big problem in a potentially really impactful way.
Yet Another Blogging Platform, without the special features envisioned originally, is not solving a big problem (or actually any problem), and has a maximum plausible impact of "makes you a bunch of money and you donate that somewhere". Re-using the name is a self-serving attempt to redirect the positive affect from the ambitious, failed, altruistic project to the mundane, new, purely-capitalistic project.
Why aren't you just admitting defeat and going on to build something different?
Replies from: Alexei↑ comment by Alexei · 2017-03-30T01:29:27.480Z · LW(p) · GW(p)
See my reply to gjm: http://lesswrong.com/lw/otq/whats_up_with_arbital/dqa0?context=3
Replies from: VAuroch↑ comment by VAuroch · 2017-03-30T03:04:17.764Z · LW(p) · GW(p)
If you can't succeed without first getting mass adoption, then you can't succeed. See the 'success' of Medium, and how it required losing everything they set out to do.
If Arbital has failed, Arbital has failed. Building neoTumblr and hoping to turn it into Arbital later won't make it fail any less, it will just produce neoTumblr.
Replies from: Douglas_Knight, Alexei↑ comment by Douglas_Knight · 2017-03-30T04:25:20.099Z · LW(p) · GW(p)
Could you detail what you mean about Medium? This doesn't sound like a claim that is very easy to look up.
Replies from: None↑ comment by [deleted] · 2017-03-30T05:35:09.237Z · LW(p) · GW(p)
Somewhat recently Medium laid off about a third of their team as they tried to re-orient to figure out what happened when their original vision went away.
Replies from: Lumifer↑ comment by Lumifer · 2017-03-30T14:31:51.731Z · LW(p) · GW(p)
Isn't this a pretty well-worn path by now? Start with lofty visions, discover that your incentive system rewards for eyeballs and clicks, start to optimize for eyeballs and clicks, become shit soon afterwards.
Replies from: None↑ comment by [deleted] · 2017-03-30T15:18:35.199Z · LW(p) · GW(p)
I do think we see this pattern across a lot of content platforms, like YouTube, as well. My impression is that earnest creators who try to make quality things often get out-competed by attention-hijackers / things that optimize for the action rather than the intent (ala Goodhart's Law).
comment by Brendan Long (korin43) · 2017-03-29T19:38:22.181Z · LW(p) · GW(p)
As a software engineer, it seems strange to me that Arbital is trying to be an encyclopedia, debate system, and blogging site at the same time. What made you decide to put those features together in one piece of software?
Replies from: Alexei, MakoYass↑ comment by mako yass (MakoYass) · 2017-04-17T02:59:29.088Z · LW(p) · GW(p)
Resources required for each application would tend to be useful to the others
The debate system settles disputes over encyclopedia maintenance
Monitoring activity in the encyclopedia can potentially feed the debate system with user qualification metrics for use in filtering comments
A sufficiently well structured debate effectively is an outline of an explanation
Systems for presenting articles and displaying structured debates are blog-complete: Blogs and articles are basically the same kind of information, and the debating stuff could presumably be simplified into a comment section.
comment by MugaSofer · 2017-03-29T20:46:54.094Z · LW(p) · GW(p)
Will this "Arbital 2.0" be an entirely unrelated microblogging platform, or are you simply re-branding Arbital 1.0 to focus on the microblogging features?
Replies from: Alexei↑ comment by Alexei · 2017-03-29T20:52:38.299Z · LW(p) · GW(p)
I'm thinking of it as a completely new, unrelated platform. Whether or not it will live at arbital.com and be called Arbital is not yet decided, though currently I'm leaning towards yes. (But if, for example, some people are using the old Arbital, then it would probably be easier for me to put the new platform under a different domain & name.)
comment by hoghoghoghoghog · 2017-03-29T22:55:58.523Z · LW(p) · GW(p)
Is there a description anywhere of the history of Arbital development?
Specifically I once heard a 4th-hand description of Arbital as "the Stacks Project, but for everything." It seemed to me at the time that a good step would be to 'simply' extend the Stacks project until it encompasses all of math[*]. I'd like to know which of Arbital's difficulties would still apply there.
Replies from: Alexei↑ comment by Alexei · 2017-03-29T23:04:24.062Z · LW(p) · GW(p)
We don't have Arbital history anywhere, although I guess there is the blog, which captures a fraction of it.
"The Stacks Project, but for everything" was a decent description for part of our first approach. However, it's relatively easy for people to answer questions: doesn't take much time and you get instant credit. It's much harder to get people to write wiki pages / explanations: it takes a long time and you don't get that much credit.
comment by Martin-2 · 2017-03-29T22:04:53.487Z · LW(p) · GW(p)
What were some specific ideas you had for "solving debates"? I was hoping Arbital would take the debate around a given topic and organize it into a tree. You start with an assertion that branches into supporting and opposing arguments, then those branch into rebuttals, then those branch into counter-rebuttals, etc.
Replies from: Alexei↑ comment by Alexei · 2017-03-29T23:00:03.150Z · LW(p) · GW(p)
That's one approach we ruled out pretty much from the start because that kind of structure is hard to read and laborious to create and maintain. However that mechanic on the blog level makes sense and that's basically how debates work right now in the wild.
Our main approach was creating "claims". Blogs would reuse claims and the discussion around each claim. I'd say that part was actually moderately successful.
One idea we played around with but didn't get to implement was allowing comments to easily leverage double-crux structure.
comment by Riothamus · 2017-04-12T18:28:46.560Z · LW(p) · GW(p)
I see finding high-quality content producers was a problem; you reference math explanations specifically.
I notice that people are usually good at providing thorough and comprehensible explanations in only their chosen domains. That being said, people are interested in subjects beyond those they have mastered.
I wonder if it is possible to approach quality content producers with the question of what content they would like to passively consume, and then try and approach networks of content producers at once. For example: find a game theory explainer who wants to read about complex analysis; a complex analysis explainer who wants to read about music theory; a music theory explainer who wants to read about game theory.
Then you can approach all three at once with the premise that if they explain the thing they are good at, they will also be able to read the thing they want to be explained well to them, on the same platform. There's a similar trick being explored for networks of organ donations.
Also, was there any consideration given to the simple mechanism of paying people for quality explanations? I expect a reasonable core of value could be had for low cost.
Replies from: Alexei↑ comment by Alexei · 2017-04-13T20:56:48.530Z · LW(p) · GW(p)
Hmm, I'm skeptical a barter system would work. I don't think I've seen a successful implementation of it anywhere, though I do hear about people trying.
Yes, we've considered paying people, but that's not scalable. (A good 3-5 page explanation might take 10 hours to write.)
Replies from: Riothamus↑ comment by Riothamus · 2017-04-14T19:02:18.889Z · LW(p) · GW(p)
I had not imagined a strict barter system or scaling of paid content; the objective in both cases is only to make up the difference between the value content producers want versus the value they expect for the first wave.
The point of diminishing returns would be hard to judge for paid content, but perhaps the two strategies could work together: survey prospective content producers for the content they want to see, and then pay for the most popular subjects to draw the rest. Once you have enough content established to draw the first wave of voluntary content producers, everything else can build off of that for no/minimal further investment.
That being said, it would probably be a good idea to keep surveying and perhaps paying for content on a case by case, say to alleviate a dry spell of contributions or if there is some particular thing which is in high demand but no one is volunteering to produce.
What about a contest with a cash award of some kind? This could drive a lot of content for a fixed upfront investment, and then you would also have the ability to select among the entries for the appropriate style and nuance, which reduces the risk of getting unsatisfactory work.
comment by hamnox · 2017-04-01T17:02:37.320Z · LW(p) · GW(p)
I expect that micro-blogging will be an excellent combination with the arbital-style of voting on things. I especially think that you could get very good results from voting on per-post 'related links' submitted by users. Tumblr has reblogs for responding to things, but those naturally become mediated by viralness instead of internal coherence.
I can imagine a neural-activation-like effect coming out of that, where frequently co-active posts naturally rise to the top of each other's links and become threads or topics.
Are you planning anything like that?
Replies from: Alexeicomment by efenj · 2017-04-01T16:59:12.362Z · LW(p) · GW(p)
Thank you for the summary of the state of Arbital!
It seems that while you haven't achieved your full goals, you have created a system that Eliezer is happy with, which is of non-zero value in itself (or, depending on what you think of MIRI, the AI alignment problem etc., of very large value).
It'd be interesting to work out why projects like Wikipedia and StackOveflow succeeded, while Arbital didn't, to such an extent. Unfortunately, I don't really have much of an idea how to answer my own question, so I'll be among those who want all the answers, but don't want to write them... (Too niche a target? Luck? Lack of openness to contributors???)
Finally — this is obviously a huge request considering the amount of work you must have put into Arbital — if you're not planning to re-use much of the existing code and if you don't think that it would harm the new "Arbital 2.0", would you consider open-sourcing the existing platform? (This is distinct from the content being under CC BY-SA, though kudos to whoever made that decision!)
Replies from: ChristianKl, Alexei↑ comment by ChristianKl · 2017-04-01T17:17:48.771Z · LW(p) · GW(p)
It'd be interesting to work out why projects like Wikipedia and StackOveflow succeeded, while Arbital didn't, to such an extent.
I had some experience being involved in Citizendium which failed. To me it feels like the key difference is openness to contribution.
Both Wikipedia and StackOverflow make it easy for anybody to get involved.
Eric recently shared a link to a post he wrote on Arbital on Facebook. I could either answer on Facebook or an Arbital. Given that Arbital didn't gave me a text field in which I could write my comment it was easier to answer on facebook and that's what I did.
Arbital also might be too slow. It's a general pattern that page loading time matters a great deal and I'm not aware of any successful website that is that slow in 2017.
↑ comment by Alexei · 2017-04-01T17:06:32.277Z · LW(p) · GW(p)
My guess for Wikipedia's success is that they were one of the first; and there was more of a sense of an online community back then. Also it's easier to create Wikipedia content than, say, a good explanation. StackOverflow succeeded because asking and answering questions is pretty easy, you get instant feedback, and they got community management right. (They solved exactly one problem well!) The founders were also really well known so it was easy for them to seed the platform.
I can't open-source the platform as long as I'm doing the for-profit venture, since the platforms are too similar. However, if at some point I have to stop, then I'll be happy to open source everything at that point.
Replies from: efenj↑ comment by efenj · 2017-04-01T17:55:47.773Z · LW(p) · GW(p)
Thanks for the fast reply!
The founders were also really well known so it was easy for them to seed the platform.
OTOH Eliezer is also quite well-known, at least in the relevant circles. For example, at my non-American university, almost everyone doing a technical subject, that I know, has heard of and usually read HPMoR (I didn't introduce them to it). Most don't agree with the MIRI view on AI risk (or don't care about it...), but are broadly on board with rationalist principles and definitely do agree that science needs fixing, which is all that you need to think that something like Arbital is a Good Idea. It's a bit of a shame that HPMoR was finished before Arbital was ready.
I'm also not entirely sure about the comparison with Wikipedia, regarding ease of creating entries vs. writing explanations — in some cases, writing a logical explanation, deriving things from first (relevant) principles is easier than writing an encyclopaedic entry, having the appropriate citations (with Wikipedia policy encouraging secondary over primary sources). Writing things well is another challenge, but that's the case for both.
The remaining arguments are probably sufficient, in themselves, though.
I can't open-source the platform as long as I'm doing the for-profit venture, since the platforms are too similar. However, if at some point I have to stop, then I'll be happy to open source everything at that point.
That makes sense!
comment by ChristianKl · 2017-03-29T17:37:25.532Z · LW(p) · GW(p)
Why do you not continue on "solving online debates" but try to shift to micro-blogging?
Replies from: Alexei↑ comment by Alexei · 2017-03-29T18:37:07.843Z · LW(p) · GW(p)
See my reply to michaelkeenan: http://lesswrong.com/r/discussion/lw/otq/whats_up_with_arbital/dq91
comment by JoshuaFox · 2017-03-29T17:35:11.754Z · LW(p) · GW(p)
Eliezer is still writing AI Alignment content on it, ... MIRI ... adopt Arbital ...
How does Eliezer's work on Arbital relate to MIRI? Little is publicly visible of what is is doing in MIRI. Is he focusing on Arbital? What is the strategic purpose?
Replies from: Alexei↑ comment by Alexei · 2017-03-29T18:41:37.396Z · LW(p) · GW(p)
See MIRI's recent post under "Going Forward": https://intelligence.org/2017/03/28/2016-in-review/
- AGI alignment overviews: “Eliezer Yudkowsky and I will be splitting our time between working on these problems and doing expository writing. Eliezer is writing about alignment theory, while I’ll be writing about MIRI strategy and forecasting questions.”
Basically explaining why people still don't get AI safety is a very important task and Eliezer is particularly well suited for it.
comment by PhilGoetz · 2017-04-04T19:49:53.120Z · LW(p) · GW(p)
This sounds great! There is no FAQ on the linked-to website, though. Is Arbital open-source? What are the key licensing terms? How's it implemented? How does voting work?
If we're all supposed to use the same website, there are advantages to that, but I would be less excited about that.
Also, the home page links to https://arbital.com/explore/math, but that page is blank. Er... https://arbital.com/explore/ai_alignment is also blank for me. Perhaps Arbital doesn't work for Chrome on Windows 7 without flash installed.
Replies from: Alexei↑ comment by Alexei · 2017-04-10T23:09:43.374Z · LW(p) · GW(p)
It's not open sourced.
The pages might take a while to load (up to 30 seconds).
Replies from: gjm↑ comment by gjm · 2017-04-11T13:25:21.771Z · LW(p) · GW(p)
I get:
- First, what looks like a blank page with a navigation/search bar at the top.
- This stays there for ~10s with absolutely no indication that more might be coming.
- Then an extra rectangular thingy gets overlaid and my browser window stops responding to me.
- This stays for maybe another 10s.
- Finally, some actual content appears.
(This is with Firefox on Windows, on a reasonably beefy machine.)
comment by ThoughtSpeed · 2017-04-25T21:34:40.882Z · LW(p) · GW(p)
I had asked someone how I could contribute, and they said there was a waitlist or whatever. Like others have mentioned, I would recommend prioritizing maximal user involvement. Try to iterate quickly and get as many eyeballs on it as you can so you can see what works and what breaks. You can't control people.